Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-05-03T07:52:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-03T07:52:43Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260503 07:52:43.520594 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:44841
--webserver_interface=127.0.105.62
--webserver_port=0
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260503 07:52:43.851567 428 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:43.851872 428 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:43.852010 428 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:43.860757 428 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 07:52:43.860838 428 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:43.860920 428 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:52:43.861016 428 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 07:52:43.871260 428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:44841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:43.872910 428 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:43.874627 428 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:43.882632 433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:43.882696 434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:43.882937 436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:43.884212 428 server_base.cc:1061] running on GCE node
I20260503 07:52:43.884961 428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:43.886328 428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:43.887652 428 hybrid_clock.cc:648] HybridClock initialized: now 1777794763887472 us; error 145 us; skew 500 ppm
I20260503 07:52:43.888144 428 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:43.890436 428 webserver.cc:492] Webserver started at http://127.0.105.62:39175/ using document root <none> and password file <none>
I20260503 07:52:43.891150 428 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:43.891247 428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:43.891593 428 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:43.893862 428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/instance:
uuid: "65adddd546eb49779519c7f7378d0e60"
format_stamp: "Formatted at 2026-05-03 07:52:43 on dist-test-slave-xxz1"
I20260503 07:52:43.894657 428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal/instance:
uuid: "65adddd546eb49779519c7f7378d0e60"
format_stamp: "Formatted at 2026-05-03 07:52:43 on dist-test-slave-xxz1"
I20260503 07:52:43.900090 428 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260503 07:52:43.903734 442 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:43.905062 428 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260503 07:52:43.905200 428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
uuid: "65adddd546eb49779519c7f7378d0e60"
format_stamp: "Formatted at 2026-05-03 07:52:43 on dist-test-slave-xxz1"
I20260503 07:52:43.905350 428 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:43.919988 428 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:43.920804 428 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:43.921025 428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:43.941643 428 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.62:44841
I20260503 07:52:43.941659 493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.62:44841 every 8 connection(s)
I20260503 07:52:43.942987 428 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
I20260503 07:52:43.946934 494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:43.947101 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 428
I20260503 07:52:43.947389 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal/instance
I20260503 07:52:43.949826 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--webserver_interface=127.0.105.61
--webserver_port=0
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260503 07:52:43.952975 494 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:43.973269 494 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
W20260503 07:52:43.974228 444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
W20260503 07:52:43.975749 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
I20260503 07:52:44.025075 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } attempt: 1
W20260503 07:52:44.026979 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
I20260503 07:52:44.095326 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } attempt: 2
W20260503 07:52:44.097235 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
I20260503 07:52:44.188617 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } attempt: 3
W20260503 07:52:44.190588 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
W20260503 07:52:44.280421 496 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:44.280742 496 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:44.280865 496 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:44.289466 496 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 07:52:44.289573 496 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:44.289647 496 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:52:44.289729 496 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 07:52:44.299597 496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:44.301344 496 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:44.303122 496 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:44.311694 504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:44.311694 505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:44.311898 507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:44.312680 496 server_base.cc:1061] running on GCE node
I20260503 07:52:44.313380 496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:44.314695 496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:44.315930 496 hybrid_clock.cc:648] HybridClock initialized: now 1777794764315903 us; error 62 us; skew 500 ppm
I20260503 07:52:44.316313 496 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:44.318329 496 webserver.cc:492] Webserver started at http://127.0.105.61:38399/ using document root <none> and password file <none>
I20260503 07:52:44.319006 496 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:44.319128 496 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:44.319449 496 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:44.321789 496 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/instance:
uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.322520 496 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal/instance:
uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.327981 496 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260503 07:52:44.331275 513 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:44.332562 496 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260503 07:52:44.332733 496 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.332932 496 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:44.333843 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } attempt: 4
W20260503 07:52:44.335669 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111)
I20260503 07:52:44.352985 496 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:44.353767 496 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:44.354023 496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:44.374686 496 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.61:41759
I20260503 07:52:44.374693 564 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.61:41759 every 8 connection(s)
I20260503 07:52:44.376655 496 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
I20260503 07:52:44.377431 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 496
I20260503 07:52:44.377655 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal/instance
I20260503 07:52:44.378768 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.60:40873
--webserver_interface=127.0.105.60
--webserver_port=0
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260503 07:52:44.380996 565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:44.386296 565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:44.399222 565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:44.408135 565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } has no permanent_uuid. Determining permanent_uuid...
W20260503 07:52:44.409219 516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
W20260503 07:52:44.410794 565 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.460111 565 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 1
W20260503 07:52:44.462222 565 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.530464 565 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 2
W20260503 07:52:44.532536 565 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.623804 565 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 3
W20260503 07:52:44.626133 565 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.634909 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } attempt: 5
I20260503 07:52:44.641384 494 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } has no permanent_uuid. Determining permanent_uuid...
W20260503 07:52:44.643294 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.694518 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 1
W20260503 07:52:44.696424 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
W20260503 07:52:44.709004 567 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:44.709336 567 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:44.709472 567 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:44.717971 567 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 07:52:44.718082 567 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:44.718195 567 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:52:44.718291 567 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 07:52:44.727763 567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.60:40873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:44.729369 567 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:44.731070 567 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:44.739022 576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:44.739018 575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:44.739943 578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:44.740496 567 server_base.cc:1061] running on GCE node
I20260503 07:52:44.741179 567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:44.742430 567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:44.743645 567 hybrid_clock.cc:648] HybridClock initialized: now 1777794764743687 us; error 129 us; skew 500 ppm
I20260503 07:52:44.743983 567 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:44.746018 567 webserver.cc:492] Webserver started at http://127.0.105.60:34223/ using document root <none> and password file <none>
I20260503 07:52:44.746752 567 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:44.746892 567 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:44.747699 567 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:44.749857 567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data/instance:
uuid: "04ac6a9a921d4741bacf707b8f217874"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.750540 567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal/instance:
uuid: "04ac6a9a921d4741bacf707b8f217874"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.755381 567 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260503 07:52:44.758541 584 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:44.759826 567 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:44.759999 567 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal
uuid: "04ac6a9a921d4741bacf707b8f217874"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:44.760216 567 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:44.764639 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 2
W20260503 07:52:44.766575 494 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.769351 565 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 4
W20260503 07:52:44.770911 565 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.60:40873: Network error: Client connection negotiation failed: client connection to 127.0.105.60:40873: connect: Connection refused (error 111)
I20260503 07:52:44.776558 567 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:44.777280 567 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:44.777536 567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:44.798962 567 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.60:40873
I20260503 07:52:44.799002 635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.60:40873 every 8 connection(s)
I20260503 07:52:44.800513 567 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/data/info.pb
I20260503 07:52:44.804664 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 567
I20260503 07:52:44.804687 636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:44.804827 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-2/wal/instance
I20260503 07:52:44.811292 636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:44.831410 636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:44.838433 636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } has no permanent_uuid. Determining permanent_uuid...
I20260503 07:52:44.849458 636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Bootstrap starting.
I20260503 07:52:44.852393 636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:44.853526 636 log.cc:826] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:44.855815 636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: No bootstrap required, opened a new log
I20260503 07:52:44.860613 636 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:44.860954 636 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:44.861079 636 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04ac6a9a921d4741bacf707b8f217874, State: Initialized, Role: FOLLOWER
I20260503 07:52:44.861636 636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:44.862340 645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:44.863143 645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:44.863517 636 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:52:44.872907 494 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 3
I20260503 07:52:44.878407 567 master_runner.cc:186] Error getting master registration for 127.0.105.62:44841: OK, instance_id { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" instance_seqno: 1777794763936065 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260503 07:52:44.884886 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Bootstrap starting.
I20260503 07:52:44.884987 567 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260503 07:52:44.886513 656 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260503 07:52:44.886644 656 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260503 07:52:44.887799 494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:44.888837 494 log.cc:826] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:44.891621 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: No bootstrap required, opened a new log
I20260503 07:52:44.896836 494 raft_consensus.cc:359] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:44.897104 494 raft_consensus.cc:385] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:44.897228 494 raft_consensus.cc:740] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65adddd546eb49779519c7f7378d0e60, State: Initialized, Role: FOLLOWER
I20260503 07:52:44.897807 494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:44.898725 659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:44.898999 659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:44.899784 494 sys_catalog.cc:565] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: configured and running, proceeding with master startup.
W20260503 07:52:44.910804 670 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260503 07:52:44.910923 670 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260503 07:52:44.909137 428 master_runner.cc:186] Error getting master registration for 127.0.105.61:41759: OK, instance_id { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" instance_seqno: 1777794764368985 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260503 07:52:44.914114 428 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260503 07:52:44.923467 448 tablet.cc:2404] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260503 07:52:45.029541 590 tablet.cc:2404] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:52:45.070498 565 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } attempt: 5
I20260503 07:52:45.080104 565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Bootstrap starting.
I20260503 07:52:45.083474 565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:45.084997 565 log.cc:826] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:45.087289 565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: No bootstrap required, opened a new log
I20260503 07:52:45.093569 565 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.094188 565 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:45.094344 565 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4eda3aaddc4d46a7e8b24b782a7e5c, State: Initialized, Role: FOLLOWER
I20260503 07:52:45.094949 565 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.095830 673 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.096155 673 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:45.096938 565 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: configured and running, proceeding with master startup.
W20260503 07:52:45.106351 519 tablet.cc:2404] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:52:45.119751 496 master_runner.cc:263] No leader master found from master cd4eda3aaddc4d46a7e8b24b782a7e5c
I20260503 07:52:45.119925 496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260503 07:52:45.122298 684 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260503 07:52:45.122439 684 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260503 07:52:45.137451 645 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:45.137746 645 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.139923 645 leader_election.cc:290] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841), cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759)
I20260503 07:52:45.141398 469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ac6a9a921d4741bacf707b8f217874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65adddd546eb49779519c7f7378d0e60" is_pre_election: true
I20260503 07:52:45.141901 469 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04ac6a9a921d4741bacf707b8f217874 in term 0.
I20260503 07:52:45.142501 540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ac6a9a921d4741bacf707b8f217874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" is_pre_election: true
I20260503 07:52:45.142905 540 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04ac6a9a921d4741bacf707b8f217874 in term 0.
I20260503 07:52:45.143849 586 leader_election.cc:304] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04ac6a9a921d4741bacf707b8f217874, 65adddd546eb49779519c7f7378d0e60; no voters:
I20260503 07:52:45.144657 645 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:45.144811 645 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:45.144907 645 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:45.148129 645 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.151549 469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ac6a9a921d4741bacf707b8f217874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65adddd546eb49779519c7f7378d0e60"
I20260503 07:52:45.151753 469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:45.154889 469 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04ac6a9a921d4741bacf707b8f217874 in term 1.
I20260503 07:52:45.155346 586 leader_election.cc:304] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04ac6a9a921d4741bacf707b8f217874, 65adddd546eb49779519c7f7378d0e60; no voters:
I20260503 07:52:45.158152 645 leader_election.cc:290] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [CANDIDATE]: Term 1 election: Requested vote from peers 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841), cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759)
I20260503 07:52:45.158730 645 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:45.159137 645 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [term 1 LEADER]: Becoming Leader. State: Replica: 04ac6a9a921d4741bacf707b8f217874, State: Running, Role: LEADER
I20260503 07:52:45.160257 645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.170416 540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ac6a9a921d4741bacf707b8f217874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
I20260503 07:52:45.170655 540 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:45.175634 540 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04ac6a9a921d4741bacf707b8f217874 in term 1.
I20260503 07:52:45.179975 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac6a9a921d4741bacf707b8f217874. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.180413 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:52:45.187374 688 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 07:52:45.189823 688 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 07:52:45.208391 540 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Refusing update from remote peer 04ac6a9a921d4741bacf707b8f217874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:45.209462 686 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:52:45.217702 469 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Refusing update from remote peer 04ac6a9a921d4741bacf707b8f217874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:45.218633 686 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:45.251716 659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac6a9a921d4741bacf707b8f217874. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.251967 659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:45.255092 689 mvcc.cc:204] Tried to move back new op lower bound from 7281847358282575872 to 7281847358109151232. Current Snapshot: MvccSnapshot[applied={T|T < 7281847358282575872}]
I20260503 07:52:45.260584 645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.260861 645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:52:45.260970 691 mvcc.cc:204] Tried to move back new op lower bound from 7281847358282575872 to 7281847358109151232. Current Snapshot: MvccSnapshot[applied={T|T < 7281847358282575872}]
I20260503 07:52:45.262893 688 catalog_manager.cc:1357] Generated new cluster ID: e159b1db76c34313bb974acd3f2dcf52
I20260503 07:52:45.263012 688 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 07:52:45.272836 659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.273063 659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:45.285676 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.285691 673 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac6a9a921d4741bacf707b8f217874. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.285912 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:52:45.285926 673 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:45.287436 690 mvcc.cc:204] Tried to move back new op lower bound from 7281847358282575872 to 7281847358109151232. Current Snapshot: MvccSnapshot[applied={T|T < 7281847358282575872}]
I20260503 07:52:45.305243 673 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:45.305456 673 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:45.346374 688 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 07:52:45.348268 688 catalog_manager.cc:1514] Loading token signing keys...
I20260503 07:52:45.376430 688 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Generated new TSK 0
I20260503 07:52:45.377483 688 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 07:52:45.409811 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:0
--local_ip_for_outbound_sockets=127.0.105.1
--webserver_interface=127.0.105.1
--webserver_port=0
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260503 07:52:45.780441 698 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:45.780779 698 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:45.780929 698 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:45.789222 698 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:45.789443 698 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 07:52:45.799964 698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:45.801525 698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:45.803319 698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:45.812852 704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:45.812827 703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:45.814168 706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:45.814895 698 server_base.cc:1061] running on GCE node
I20260503 07:52:45.815397 698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:45.816332 698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:45.817548 698 hybrid_clock.cc:648] HybridClock initialized: now 1777794765817505 us; error 35 us; skew 500 ppm
I20260503 07:52:45.817839 698 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:45.819932 698 webserver.cc:492] Webserver started at http://127.0.105.1:39263/ using document root <none> and password file <none>
I20260503 07:52:45.821141 698 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:45.821278 698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:45.821628 698 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:45.823918 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data/instance:
uuid: "4a924c2134c54fa0bb164825da53bdd0"
format_stamp: "Formatted at 2026-05-03 07:52:45 on dist-test-slave-xxz1"
I20260503 07:52:45.824703 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/instance:
uuid: "4a924c2134c54fa0bb164825da53bdd0"
format_stamp: "Formatted at 2026-05-03 07:52:45 on dist-test-slave-xxz1"
I20260503 07:52:45.829753 698 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260503 07:52:45.832907 712 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:45.834116 698 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260503 07:52:45.834285 698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal
uuid: "4a924c2134c54fa0bb164825da53bdd0"
format_stamp: "Formatted at 2026-05-03 07:52:45 on dist-test-slave-xxz1"
I20260503 07:52:45.834474 698 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:45.858446 698 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:45.859290 698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:45.859529 698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:45.860543 698 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:52:45.862135 698 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:52:45.862218 698 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:45.862295 698 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:52:45.862347 698 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:45.880522 749 raft_consensus.cc:493] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04ac6a9a921d4741bacf707b8f217874)
I20260503 07:52:45.880736 749 raft_consensus.cc:515] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:45.882238 749 leader_election.cc:290] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759), 04ac6a9a921d4741bacf707b8f217874 (127.0.105.60:40873)
I20260503 07:52:45.882596 540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65adddd546eb49779519c7f7378d0e60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" is_pre_election: true
I20260503 07:52:45.882992 611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65adddd546eb49779519c7f7378d0e60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04ac6a9a921d4741bacf707b8f217874" is_pre_election: true
I20260503 07:52:45.883821 445 leader_election.cc:304] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65adddd546eb49779519c7f7378d0e60; no voters: 04ac6a9a921d4741bacf707b8f217874, cd4eda3aaddc4d46a7e8b24b782a7e5c
I20260503 07:52:45.884240 749 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:45.907547 698 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:42215
I20260503 07:52:45.907640 825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:42215 every 8 connection(s)
I20260503 07:52:45.908968 698 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/data/info.pb
I20260503 07:52:45.912021 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 698
I20260503 07:52:45.912245 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/instance
I20260503 07:52:45.913115 670 catalog_manager.cc:1269] Loaded cluster ID: e159b1db76c34313bb974acd3f2dcf52
I20260503 07:52:45.913203 670 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: loading cluster ID for follower catalog manager: success
I20260503 07:52:45.918361 670 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: acquiring CA information for follower catalog manager: success
I20260503 07:52:45.919064 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:0
--local_ip_for_outbound_sockets=127.0.105.2
--webserver_interface=127.0.105.2
--webserver_port=0
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260503 07:52:45.924603 670 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260503 07:52:45.940932 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:52:45.941346 827 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:45.941726 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:45.941864 828 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:45.942171 826 heartbeater.cc:344] Connected to a master server at 127.0.105.60:40873
I20260503 07:52:45.942289 826 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:45.942545 828 heartbeater.cc:507] Master 127.0.105.61:41759 requested a full tablet report, sending...
I20260503 07:52:45.942756 826 heartbeater.cc:507] Master 127.0.105.60:40873 requested a full tablet report, sending...
I20260503 07:52:45.943166 827 heartbeater.cc:507] Master 127.0.105.62:44841 requested a full tablet report, sending...
I20260503 07:52:45.944835 601 ts_manager.cc:194] Registered new tserver with Master: 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:45.945358 459 ts_manager.cc:194] Registered new tserver with Master: 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:45.946199 530 ts_manager.cc:194] Registered new tserver with Master: 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:45.947297 601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:41325
I20260503 07:52:46.125414 684 catalog_manager.cc:1269] Loaded cluster ID: e159b1db76c34313bb974acd3f2dcf52
I20260503 07:52:46.125546 684 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: loading cluster ID for follower catalog manager: success
I20260503 07:52:46.130519 684 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: acquiring CA information for follower catalog manager: success
I20260503 07:52:46.132875 684 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260503 07:52:46.267002 834 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:46.267278 834 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:46.267355 834 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:46.275959 834 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:46.276113 834 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
I20260503 07:52:46.285599 834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:46.287165 834 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:46.288916 834 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:46.298116 841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:46.298090 842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:46.298971 844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:46.299750 834 server_base.cc:1061] running on GCE node
I20260503 07:52:46.300412 834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:46.301393 834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:46.302629 834 hybrid_clock.cc:648] HybridClock initialized: now 1777794766302585 us; error 55 us; skew 500 ppm
I20260503 07:52:46.302959 834 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:46.305640 834 webserver.cc:492] Webserver started at http://127.0.105.2:36357/ using document root <none> and password file <none>
I20260503 07:52:46.306378 834 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:46.306511 834 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:46.306878 834 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:46.309330 834 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data/instance:
uuid: "48acfab19cf04a069d5166d663adb3c3"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.310206 834 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/instance:
uuid: "48acfab19cf04a069d5166d663adb3c3"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.315187 834 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260503 07:52:46.318374 850 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.319630 834 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:46.319792 834 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal
uuid: "48acfab19cf04a069d5166d663adb3c3"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.319986 834 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:46.333796 834 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:46.335037 834 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:46.335294 834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:46.336223 834 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:52:46.337750 834 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:52:46.337868 834 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.337993 834 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:52:46.338076 834 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.373025 834 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:44381
I20260503 07:52:46.373067 962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:44381 every 8 connection(s)
I20260503 07:52:46.374603 834 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/data/info.pb
I20260503 07:52:46.380702 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 834
I20260503 07:52:46.380894 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/instance
I20260503 07:52:46.389897 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:0
--local_ip_for_outbound_sockets=127.0.105.3
--webserver_interface=127.0.105.3
--webserver_port=0
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260503 07:52:46.397418 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:52:46.397939 964 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.399062 964 heartbeater.cc:507] Master 127.0.105.62:44841 requested a full tablet report, sending...
I20260503 07:52:46.401618 459 ts_manager.cc:194] Registered new tserver with Master: 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:46.407307 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:46.407467 965 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.407927 965 heartbeater.cc:507] Master 127.0.105.61:41759 requested a full tablet report, sending...
I20260503 07:52:46.408990 530 ts_manager.cc:194] Registered new tserver with Master: 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:46.410284 967 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04ac6a9a921d4741bacf707b8f217874)
I20260503 07:52:46.410454 967 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:46.411918 967 leader_election.cc:290] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841), 04ac6a9a921d4741bacf707b8f217874 (127.0.105.60:40873)
I20260503 07:52:46.411985 468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65adddd546eb49779519c7f7378d0e60" is_pre_election: true
I20260503 07:52:46.412457 611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04ac6a9a921d4741bacf707b8f217874" is_pre_election: true
I20260503 07:52:46.413004 963 heartbeater.cc:344] Connected to a master server at 127.0.105.60:40873
I20260503 07:52:46.413125 963 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.413077 516 leader_election.cc:304] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd4eda3aaddc4d46a7e8b24b782a7e5c; no voters: 04ac6a9a921d4741bacf707b8f217874, 65adddd546eb49779519c7f7378d0e60
I20260503 07:52:46.414072 963 heartbeater.cc:507] Master 127.0.105.60:40873 requested a full tablet report, sending...
I20260503 07:52:46.414340 967 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:46.416904 601 ts_manager.cc:194] Registered new tserver with Master: 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:46.417759 601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:51725
I20260503 07:52:46.449721 826 heartbeater.cc:499] Master 127.0.105.60:40873 was elected leader, sending a full tablet report...
W20260503 07:52:46.740077 971 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:46.740370 971 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:46.740454 971 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 07:52:46.749336 971 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:46.749493 971 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
I20260503 07:52:46.759477 971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:46.761168 971 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:46.762800 971 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:52:46.773025 976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:46.773015 977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:46.773622 979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:46.774355 971 server_base.cc:1061] running on GCE node
I20260503 07:52:46.774848 971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:46.775794 971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:46.777015 971 hybrid_clock.cc:648] HybridClock initialized: now 1777794766776993 us; error 57 us; skew 500 ppm
I20260503 07:52:46.777304 971 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:46.779353 971 webserver.cc:492] Webserver started at http://127.0.105.3:40949/ using document root <none> and password file <none>
I20260503 07:52:46.780084 971 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:46.780233 971 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:46.780571 971 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:52:46.782840 971 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data/instance:
uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.783619 971 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/instance:
uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.788487 971 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260503 07:52:46.792295 985 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.793637 971 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260503 07:52:46.793819 971 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal
uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
format_stamp: "Formatted at 2026-05-03 07:52:46 on dist-test-slave-xxz1"
I20260503 07:52:46.794040 971 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:46.812359 971 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:46.813743 971 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:46.814023 971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:46.814950 971 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:52:46.816586 971 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:52:46.816707 971 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.816833 971 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:52:46.816926 971 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:46.853168 971 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:40179
I20260503 07:52:46.853219 1097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:40179 every 8 connection(s)
I20260503 07:52:46.854533 971 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/data/info.pb
I20260503 07:52:46.855042 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 971
I20260503 07:52:46.855288 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/instance
I20260503 07:52:46.873884 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:46.873924 1098 heartbeater.cc:344] Connected to a master server at 127.0.105.60:40873
I20260503 07:52:46.873939 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:52:46.874379 1100 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.874374 1099 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.874377 1098 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:46.875427 1100 heartbeater.cc:507] Master 127.0.105.61:41759 requested a full tablet report, sending...
I20260503 07:52:46.875468 1098 heartbeater.cc:507] Master 127.0.105.60:40873 requested a full tablet report, sending...
I20260503 07:52:46.875515 1099 heartbeater.cc:507] Master 127.0.105.62:44841 requested a full tablet report, sending...
I20260503 07:52:46.877027 601 ts_manager.cc:194] Registered new tserver with Master: 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:46.877187 459 ts_manager.cc:194] Registered new tserver with Master: 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:46.877213 530 ts_manager.cc:194] Registered new tserver with Master: 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:46.878170 601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:37895
I20260503 07:52:46.883879 420 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260503 07:52:46.915621 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4970e857e3644e2abdfbcd56a68c172b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.915648 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_803f4afc7fe54de1b26d0db40e0343c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.916965 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_00981c6e5db54dc9a473a4b8bc0cc541"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:46.917454 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4970e857e3644e2abdfbcd56a68c172b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.917451 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_803f4afc7fe54de1b26d0db40e0343c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:46.918253 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_797ff7ac526e4ae6a63ad5b24e7dc20a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.919771 963 heartbeater.cc:499] Master 127.0.105.60:40873 was elected leader, sending a full tablet report...
I20260503 07:52:46.919868 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_54874b9f38a64c62b6aa8c1d814ba78a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.920775 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3a7ee67fb7884d878eb97e3cc72ec686"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.921813 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_80f4b5153c5146d693360d098dcc229e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:46.917493 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00981c6e5db54dc9a473a4b8bc0cc541 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.918898 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_797ff7ac526e4ae6a63ad5b24e7dc20a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.920431 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54874b9f38a64c62b6aa8c1d814ba78a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:46.927107 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e2e7a28a95df4276968622fa6298069a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:46.927157 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c175d2fa83ce4d26b9791e60c0ad773c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:46.927788 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2e7a28a95df4276968622fa6298069a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.927939 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c175d2fa83ce4d26b9791e60c0ad773c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.921476 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a7ee67fb7884d878eb97e3cc72ec686 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:46.922438 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80f4b5153c5146d693360d098dcc229e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:46.928519 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fba6c212c05d43abb6f1f6343f0de387"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:46.930872 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fba6c212c05d43abb6f1f6343f0de387 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:46.962716 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskCEB381/build/asan/bin/kudu pid 496
I20260503 07:52:46.964648 560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 07:52:46.965628 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4970e857e3644e2abdfbcd56a68c172b" } new_table_name: "default.Table_713a5e9e9f634aa18604c62214fcaa37" modify_external_catalogs: true
I20260503 07:52:46.992986 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_797ff7ac526e4ae6a63ad5b24e7dc20a" } new_table_name: "default.Table_98ac7c0b7f884c4cbac38650bee1d10a" modify_external_catalogs: true
I20260503 07:52:46.993048 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_803f4afc7fe54de1b26d0db40e0343c7" } new_table_name: "default.Table_095b67a40f494bf5816c169f6c2931c1" modify_external_catalogs: true
I20260503 07:52:46.994271 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_00981c6e5db54dc9a473a4b8bc0cc541" } new_table_name: "default.Table_96a8509a352f4764995d0b3b9be3b76e" modify_external_catalogs: true
I20260503 07:52:46.996191 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_54874b9f38a64c62b6aa8c1d814ba78a" } new_table_name: "default.Table_a6f61ab7e3764c1993b226a9cdba35f7" modify_external_catalogs: true
I20260503 07:52:46.997263 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80f4b5153c5146d693360d098dcc229e" } modify_external_catalogs: true
I20260503 07:52:46.997463 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80f4b5153c5146d693360d098dcc229e" } modify_external_catalogs: true
I20260503 07:52:46.997524 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fba6c212c05d43abb6f1f6343f0de387" } modify_external_catalogs: true
I20260503 07:52:46.997694 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fba6c212c05d43abb6f1f6343f0de387" } modify_external_catalogs: true
I20260503 07:52:46.998860 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3a7ee67fb7884d878eb97e3cc72ec686" } modify_external_catalogs: true
I20260503 07:52:46.999051 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3a7ee67fb7884d878eb97e3cc72ec686" } modify_external_catalogs: true
I20260503 07:52:47.001469 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2e7a28a95df4276968622fa6298069a" } modify_external_catalogs: true
I20260503 07:52:47.001641 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2e7a28a95df4276968622fa6298069a" } modify_external_catalogs: true
W20260503 07:52:47.001783 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 796cda9860564570af279f6ac351b97a consensus state has no leader
I20260503 07:52:47.002728 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c175d2fa83ce4d26b9791e60c0ad773c" } modify_external_catalogs: true
I20260503 07:52:47.002949 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c175d2fa83ce4d26b9791e60c0ad773c" } modify_external_catalogs: true
W20260503 07:52:47.009425 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 635ab42e600c4cadb5de8dae40f051cd has no consensus state
W20260503 07:52:47.010228 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3557e3ab9241eb8f76488b6a5390a5 has no consensus state
W20260503 07:52:47.013579 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 457e4ddbab8b4241ab8ea947442f7171 has no consensus state
I20260503 07:52:47.014284 594 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet a83e612e5bed424bac4d4fdd6f3a3d34
W20260503 07:52:47.015110 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b131227ef39e4cf383e705bb0ed3f158 has no consensus state
I20260503 07:52:47.015823 595 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet f419a01d0ce549e8a6d8b97150dd2d53
I20260503 07:52:47.016157 592 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet c9c59b0bb72b47d69e1ec36e6ce30566
I20260503 07:52:47.016466 596 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 27aade08ca5e424e85755b9c97d0f4b2
I20260503 07:52:47.016729 598 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 2abe4eac723c41379154e8f67b376f4e
W20260503 07:52:47.033949 586 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 796cda9860564570af279f6ac351b97a (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 796cda9860564570af279f6ac351b97a consensus state has no leader
I20260503 07:52:47.041491 896 tablet_service.cc:1511] Processing CreateTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 (DEFAULT_TABLE table=default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.041301 759 tablet_service.cc:1511] Processing CreateTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 (DEFAULT_TABLE table=default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.041841 894 tablet_service.cc:1511] Processing CreateTablet for tablet b131227ef39e4cf383e705bb0ed3f158 (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.041846 761 tablet_service.cc:1511] Processing CreateTablet for tablet 796cda9860564570af279f6ac351b97a (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.041204 758 tablet_service.cc:1511] Processing CreateTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 (DEFAULT_TABLE table=default.Table_98ac7c0b7f884c4cbac38650bee1d10a [id=2403919936864afb980b1c2528f2877d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.042193 757 tablet_service.cc:1511] Processing CreateTablet for tablet b131227ef39e4cf383e705bb0ed3f158 (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.042765 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e4ddbab8b4241ab8ea947442f7171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.042790 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131227ef39e4cf383e705bb0ed3f158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.042831 760 tablet_service.cc:1511] Processing CreateTablet for tablet 635ab42e600c4cadb5de8dae40f051cd (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.043185 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3557e3ab9241eb8f76488b6a5390a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.043385 897 tablet_service.cc:1511] Processing CreateTablet for tablet 635ab42e600c4cadb5de8dae40f051cd (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.043871 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635ab42e600c4cadb5de8dae40f051cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.045105 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e4ddbab8b4241ab8ea947442f7171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.045683 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131227ef39e4cf383e705bb0ed3f158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.046435 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635ab42e600c4cadb5de8dae40f051cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.041206 895 tablet_service.cc:1511] Processing CreateTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 (DEFAULT_TABLE table=default.Table_98ac7c0b7f884c4cbac38650bee1d10a [id=2403919936864afb980b1c2528f2877d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.052525 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3557e3ab9241eb8f76488b6a5390a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.056671 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cda9860564570af279f6ac351b97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.060087 898 tablet_service.cc:1511] Processing CreateTablet for tablet 796cda9860564570af279f6ac351b97a (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.064761 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cda9860564570af279f6ac351b97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.074183 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b131227ef39e4cf383e705bb0ed3f158 (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.075747 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131227ef39e4cf383e705bb0ed3f158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.076328 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 635ab42e600c4cadb5de8dae40f051cd (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.076704 1166 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.076839 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635ab42e600c4cadb5de8dae40f051cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.076865 1165 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.079474 1165 tablet_bootstrap.cc:654] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.080518 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 (DEFAULT_TABLE table=default.Table_98ac7c0b7f884c4cbac38650bee1d10a [id=2403919936864afb980b1c2528f2877d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.080680 1165 log.cc:826] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:47.081029 1166 tablet_bootstrap.cc:654] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.080950 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3557e3ab9241eb8f76488b6a5390a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.082161 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 (DEFAULT_TABLE table=default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.082290 1166 log.cc:826] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:47.082613 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e4ddbab8b4241ab8ea947442f7171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.083386 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 796cda9860564570af279f6ac351b97a (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.083945 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cda9860564570af279f6ac351b97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.088016 1166 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.088341 1166 ts_tablet_manager.cc:1403] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20260503 07:52:47.094457 1165 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.094751 1165 ts_tablet_manager.cc:1403] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20260503 07:52:47.096611 1166 raft_consensus.cc:359] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.097002 1166 raft_consensus.cc:385] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.097110 1166 raft_consensus.cc:740] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.097891 1166 consensus_queue.cc:260] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.102047 1165 raft_consensus.cc:359] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.102430 1165 raft_consensus.cc:385] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.102540 1165 raft_consensus.cc:740] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.103718 1165 consensus_queue.cc:260] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.106115 1166 ts_tablet_manager.cc:1434] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.018s user 0.008s sys 0.007s
I20260503 07:52:47.109797 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet b131227ef39e4cf383e705bb0ed3f158 (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]). Expected version 1 got 0
I20260503 07:52:47.121048 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 796cda9860564570af279f6ac351b97a from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.125500 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 796cda9860564570af279f6ac351b97a from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.125770 595 master_service.cc:954] ReplaceTablet: received request to replace tablet b131227ef39e4cf383e705bb0ed3f158 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.126129 1171 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.127142 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 635ab42e600c4cadb5de8dae40f051cd from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.131088 1171 tablet_bootstrap.cc:654] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.132475 1171 log.cc:826] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:47.138401 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b131227ef39e4cf383e705bb0ed3f158
I20260503 07:52:47.139261 595 catalog_manager.cc:6741] ReplaceTablet: tablet b131227ef39e4cf383e705bb0ed3f158 deleted and replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b
I20260503 07:52:47.140547 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.141248 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.141772 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.141927 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.142421 597 catalog_manager.cc:6741] ReplaceTablet: tablet 635ab42e600c4cadb5de8dae40f051cd deleted and replaced by tablet 3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.143123 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.143354 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.144659 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 796cda9860564570af279f6ac351b97a
W20260503 07:52:47.144687 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b131227ef39e4cf383e705bb0ed3f158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b131227ef39e4cf383e705bb0ed3f158 already in progress: creating tablet
I20260503 07:52:47.145076 596 catalog_manager.cc:6741] ReplaceTablet: tablet 796cda9860564570af279f6ac351b97a deleted and replaced by tablet c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:47.145262 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:47.146471 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 796cda9860564570af279f6ac351b97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796cda9860564570af279f6ac351b97a already in progress: creating tablet
I20260503 07:52:47.147766 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.147982 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.149758 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.150831 1166 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:47.152082 970 tablet.cc:2404] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:52:47.154120 1166 tablet_bootstrap.cc:654] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.156034 895 tablet_service.cc:1511] Processing CreateTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.156427 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d0125d2adf4e269e7cec0b2a34f14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.157595 1171 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.157924 1171 ts_tablet_manager.cc:1403] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.006s
I20260503 07:52:47.160705 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.161111 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d0125d2adf4e269e7cec0b2a34f14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.164700 1165 ts_tablet_manager.cc:1434] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.070s user 0.025s sys 0.029s
I20260503 07:52:47.164857 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.165249 1165 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:47.165458 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.167407 1165 tablet_bootstrap.cc:654] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.168408 757 tablet_service.cc:1511] Processing CreateTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b (DEFAULT_TABLE table=default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.168772 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d0125d2adf4e269e7cec0b2a34f14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.173089 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.176738 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_335f08e1f80641eaab02a7b35c11abdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.177055 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ab846d88446e4a99b44c12f643417612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.177295 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_335f08e1f80641eaab02a7b35c11abdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:47.177508 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab846d88446e4a99b44c12f643417612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.179899 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_88fa0464fa1d4156ba3e7e65f3ce9bb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.180032 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b131227ef39e4cf383e705bb0ed3f158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b131227ef39e4cf383e705bb0ed3f158 already in progress: creating tablet
W20260503 07:52:47.180356 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88fa0464fa1d4156ba3e7e65f3ce9bb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.180996 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 796cda9860564570af279f6ac351b97a from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.181001 1173 tablet_replica.cc:333] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.182063 1173 raft_consensus.cc:2243] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.182538 1173 raft_consensus.cc:2272] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.183086 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_652078ea08d84344a2655eb386fad8c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.183526 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 635ab42e600c4cadb5de8dae40f051cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 635ab42e600c4cadb5de8dae40f051cd already in progress: creating tablet
W20260503 07:52:47.183589 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_652078ea08d84344a2655eb386fad8c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:47.184209 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 796cda9860564570af279f6ac351b97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796cda9860564570af279f6ac351b97a already in progress: creating tablet
I20260503 07:52:47.186650 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_82b1e6aeba834c489a4aa1c15be7d5a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.187168 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82b1e6aeba834c489a4aa1c15be7d5a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.187297 1173 ts_tablet_manager.cc:1916] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.191746 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87d5c787df2e4057934312a204ca3ec9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.192207 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87d5c787df2e4057934312a204ca3ec9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.193331 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4d5cbf3e54f140e7a7712d5281d4bed2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.193209 1171 raft_consensus.cc:359] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.193701 1171 raft_consensus.cc:385] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:52:47.193751 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d5cbf3e54f140e7a7712d5281d4bed2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.193821 1171 raft_consensus.cc:740] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.194730 1171 consensus_queue.cc:260] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.194835 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f16f9f3d92d14e6c8240bc4928c42475"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.195266 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f16f9f3d92d14e6c8240bc4928c42475 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.196708 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8a0149ba551e45f8a897ba90adbf4b87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.197129 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a0149ba551e45f8a897ba90adbf4b87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.201810 1173 ts_tablet_manager.cc:1929] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.201988 1173 log.cc:1199] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b131227ef39e4cf383e705bb0ed3f158
I20260503 07:52:47.202500 1173 ts_tablet_manager.cc:1950] T b131227ef39e4cf383e705bb0ed3f158 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:47.205699 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_652078ea08d84344a2655eb386fad8c7" } new_table_name: "default.Table_576079e212ed4fb3a5c4a0ddd4aee2be" modify_external_catalogs: true
I20260503 07:52:47.206408 1171 ts_tablet_manager.cc:1434] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.048s user 0.013s sys 0.004s
I20260503 07:52:47.206885 1098 heartbeater.cc:499] Master 127.0.105.60:40873 was elected leader, sending a full tablet report...
I20260503 07:52:47.208271 1165 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.209806 1165 ts_tablet_manager.cc:1403] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.045s user 0.022s sys 0.000s
I20260503 07:52:47.210330 761 tablet_service.cc:1511] Processing CreateTablet for tablet c17bc19639ba40dfb98298264ccfb217 (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.210762 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17bc19639ba40dfb98298264ccfb217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.211858 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_98ac7c0b7f884c4cbac38650bee1d10a [id=2403919936864afb980b1c2528f2877d]). Expected version 1 got 0
I20260503 07:52:47.212191 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 457e4ddbab8b4241ab8ea947442f7171 (table default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]). Expected version 1 got 0
I20260503 07:52:47.212800 1165 raft_consensus.cc:359] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.213071 1165 raft_consensus.cc:385] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.213209 1165 raft_consensus.cc:740] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.214536 896 tablet_service.cc:1511] Processing CreateTablet for tablet c17bc19639ba40dfb98298264ccfb217 (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.214808 1165 consensus_queue.cc:260] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.215090 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17bc19639ba40dfb98298264ccfb217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.215478 1165 ts_tablet_manager.cc:1434] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:47.215813 1165 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.217646 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.217940 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:47.218828 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 796cda9860564570af279f6ac351b97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796cda9860564570af279f6ac351b97a already in progress: creating tablet
W20260503 07:52:47.219168 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b131227ef39e4cf383e705bb0ed3f158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b131227ef39e4cf383e705bb0ed3f158 already in progress: creating tablet
I20260503 07:52:47.221197 1165 tablet_bootstrap.cc:654] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.221256 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskCEB381/build/asan/bin/kudu with pid 496
I20260503 07:52:47.224443 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ab846d88446e4a99b44c12f643417612" } new_table_name: "default.Table_ba1703633e274a70a5d6fbf35822d164" modify_external_catalogs: true
I20260503 07:52:47.224931 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_98ac7c0b7f884c4cbac38650bee1d10a [id=2403919936864afb980b1c2528f2877d]). Expected version 1 got 0
I20260503 07:52:47.228060 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6f61ab7e3764c1993b226a9cdba35f7" } modify_external_catalogs: true
I20260503 07:52:47.228261 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6f61ab7e3764c1993b226a9cdba35f7" } modify_external_catalogs: true
I20260503 07:52:47.229298 1171 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.230244 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_98ac7c0b7f884c4cbac38650bee1d10a" } new_table_name: "default.Table_9cbf1d7c9e9540fc9c58cddde8f56d03" modify_external_catalogs: true
I20260503 07:52:47.231128 1171 tablet_bootstrap.cc:654] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.231503 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_88fa0464fa1d4156ba3e7e65f3ce9bb3" } new_table_name: "default.Table_0cbb59b16d8742eab3579f34635e10b1" modify_external_catalogs: true
I20260503 07:52:47.232133 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:47.232771 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 635ab42e600c4cadb5de8dae40f051cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 635ab42e600c4cadb5de8dae40f051cd already in progress: creating tablet
I20260503 07:52:47.234882 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b131227ef39e4cf383e705bb0ed3f158 (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]) successfully deleted
W20260503 07:52:47.235217 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 635ab42e600c4cadb5de8dae40f051cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 635ab42e600c4cadb5de8dae40f051cd already in progress: creating tablet
W20260503 07:52:47.235482 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 796cda9860564570af279f6ac351b97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796cda9860564570af279f6ac351b97a already in progress: creating tablet
I20260503 07:52:47.235661 1171 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.235827 1171 ts_tablet_manager.cc:1403] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260503 07:52:47.236654 1165 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.236896 1165 ts_tablet_manager.cc:1403] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20260503 07:52:47.237210 757 tablet_service.cc:1511] Processing CreateTablet for tablet 3c010814b6704a249dfb8b081131f240 (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.237583 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c010814b6704a249dfb8b081131f240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.237879 1165 raft_consensus.cc:359] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.238161 1165 raft_consensus.cc:385] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.238292 1165 raft_consensus.cc:740] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.239240 1165 consensus_queue.cc:260] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.239616 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3c010814b6704a249dfb8b081131f240 (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.239881 1170 raft_consensus.cc:493] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:47.240074 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c010814b6704a249dfb8b081131f240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.240104 1170 raft_consensus.cc:515] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.247787 1171 raft_consensus.cc:359] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.248013 1171 raft_consensus.cc:385] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.248437 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c17bc19639ba40dfb98298264ccfb217 (DEFAULT_TABLE table=default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.248508 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_96a8509a352f4764995d0b3b9be3b76e" } new_table_name: "default.Table_7c6f8d585e5545b2aca05812e1fffebe" modify_external_catalogs: true
I20260503 07:52:47.248881 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17bc19639ba40dfb98298264ccfb217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.251188 1170 leader_election.cc:290] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:47.251252 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3c010814b6704a249dfb8b081131f240 (DEFAULT_TABLE table=default.Table_96a8509a352f4764995d0b3b9be3b76e [id=cf7e85f403f044c88e5482ede91a1c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.251711 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c010814b6704a249dfb8b081131f240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.248111 1171 raft_consensus.cc:740] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.259719 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_335f08e1f80641eaab02a7b35c11abdd" } modify_external_catalogs: true
I20260503 07:52:47.259922 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_335f08e1f80641eaab02a7b35c11abdd" } modify_external_catalogs: true
I20260503 07:52:47.260744 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_095b67a40f494bf5816c169f6c2931c1" } modify_external_catalogs: true
I20260503 07:52:47.260898 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_095b67a40f494bf5816c169f6c2931c1" } modify_external_catalogs: true
I20260503 07:52:47.261723 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_713a5e9e9f634aa18604c62214fcaa37" } modify_external_catalogs: true
I20260503 07:52:47.261860 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_713a5e9e9f634aa18604c62214fcaa37" } modify_external_catalogs: true
I20260503 07:52:47.262912 1171 consensus_queue.cc:260] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.263469 1171 ts_tablet_manager.cc:1434] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260503 07:52:47.266717 1171 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.268617 1171 tablet_bootstrap.cc:654] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.269251 1165 ts_tablet_manager.cc:1434] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.032s user 0.000s sys 0.002s
I20260503 07:52:47.272102 1165 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.273990 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a9d0125d2adf4e269e7cec0b2a34f14b
I20260503 07:52:47.274932 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb" } modify_external_catalogs: true
I20260503 07:52:47.275115 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb" } modify_external_catalogs: true
W20260503 07:52:47.275650 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3557e3ab9241eb8f76488b6a5390a5 consensus state has no leader
W20260503 07:52:47.275720 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d37da070cc41438b84dc09ea74e38fe9 has no consensus state
W20260503 07:52:47.276048 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 689f9fbe38c9459b8e07b6124443f546 has no consensus state
W20260503 07:52:47.276434 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee0842dda8fb47ee828189e25a0a2ead has no consensus state
I20260503 07:52:47.276813 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.277582 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:47.277748 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet a9d0125d2adf4e269e7cec0b2a34f14b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9d0125d2adf4e269e7cec0b2a34f14b already in progress: creating tablet
I20260503 07:52:47.278280 1165 tablet_bootstrap.cc:654] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.279433 1171 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.279649 1171 ts_tablet_manager.cc:1403] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260503 07:52:47.280514 1171 raft_consensus.cc:359] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.280735 1171 raft_consensus.cc:385] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.280839 1171 raft_consensus.cc:740] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.278402 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.281160 1171 consensus_queue.cc:260] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.284308 1171 ts_tablet_manager.cc:1434] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:52:47.286347 1171 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:47.287716 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 635ab42e600c4cadb5de8dae40f051cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 635ab42e600c4cadb5de8dae40f051cd already in progress: creating tablet
I20260503 07:52:47.288661 1171 tablet_bootstrap.cc:654] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.288655 1174 tablet_replica.cc:333] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.289274 1174 raft_consensus.cc:2243] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.289811 1174 raft_consensus.cc:2272] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:47.292407 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a9d0125d2adf4e269e7cec0b2a34f14b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9d0125d2adf4e269e7cec0b2a34f14b already in progress: creating tablet
I20260503 07:52:47.292917 1171 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.293063 1171 ts_tablet_manager.cc:1403] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:52:47.293823 1171 raft_consensus.cc:359] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.294006 1171 raft_consensus.cc:385] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.294103 1171 raft_consensus.cc:740] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.294354 1171 consensus_queue.cc:260] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.297310 1165 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.297461 1165 ts_tablet_manager.cc:1403] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260503 07:52:47.298755 1165 raft_consensus.cc:359] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.298949 1165 raft_consensus.cc:385] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.299041 1165 raft_consensus.cc:740] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.299250 1165 consensus_queue.cc:260] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.300087 1171 ts_tablet_manager.cc:1434] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:52:47.301008 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.301397 1175 tablet_replica.cc:333] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.301741 1165 ts_tablet_manager.cc:1434] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:47.302050 1175 raft_consensus.cc:2243] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.302269 1171 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.302572 1175 raft_consensus.cc:2272] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.302970 1165 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:47.303952 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c010814b6704a249dfb8b081131f240 consensus state has no leader
I20260503 07:52:47.304486 1175 ts_tablet_manager.cc:1916] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.305099 1171 tablet_bootstrap.cc:654] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.306327 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e4ddbab8b4241ab8ea947442f7171" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:47.306792 1165 tablet_bootstrap.cc:654] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.306861 1053 raft_consensus.cc:2468] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:47.307687 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e4ddbab8b4241ab8ea947442f7171" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:47.309186 1174 ts_tablet_manager.cc:1916] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.309119 716 leader_election.cc:304] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:52:47.309693 715 leader_election.cc:343] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:47.310062 1170 raft_consensus.cc:2804] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:47.310204 1170 raft_consensus.cc:493] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:47.310289 1170 raft_consensus.cc:3060] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:47.311322 1175 ts_tablet_manager.cc:1929] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.311470 1175 log.cc:1199] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.311933 1175 ts_tablet_manager.cc:1950] T 635ab42e600c4cadb5de8dae40f051cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:47.313643 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 635ab42e600c4cadb5de8dae40f051cd (table default.Table_7c6f8d585e5545b2aca05812e1fffebe [id=cf7e85f403f044c88e5482ede91a1c50]) successfully deleted
I20260503 07:52:47.314268 1170 raft_consensus.cc:515] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.315094 1170 leader_election.cc:290] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:47.316290 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e4ddbab8b4241ab8ea947442f7171" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:47.316509 1053 raft_consensus.cc:3060] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:47.320926 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e4ddbab8b4241ab8ea947442f7171" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:47.321610 715 leader_election.cc:343] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:47.322243 1053 raft_consensus.cc:2468] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:47.322738 716 leader_election.cc:304] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:47.323262 1170 raft_consensus.cc:2804] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:47.332000 1170 raft_consensus.cc:697] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:47.332069 757 tablet_service.cc:1511] Processing CreateTablet for tablet 689f9fbe38c9459b8e07b6124443f546 (DEFAULT_TABLE table=default.Table_0cbb59b16d8742eab3579f34635e10b1 [id=55e54e5631d94a849236a5cb69ada911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.332283 761 tablet_service.cc:1511] Processing CreateTablet for tablet ee0842dda8fb47ee828189e25a0a2ead (DEFAULT_TABLE table=default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.332484 760 tablet_service.cc:1511] Processing CreateTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 (DEFAULT_TABLE table=default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.332563 1170 consensus_queue.cc:237] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.333062 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ee0842dda8fb47ee828189e25a0a2ead (DEFAULT_TABLE table=default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.333474 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0842dda8fb47ee828189e25a0a2ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.333810 895 tablet_service.cc:1511] Processing CreateTablet for tablet 689f9fbe38c9459b8e07b6124443f546 (DEFAULT_TABLE table=default.Table_0cbb59b16d8742eab3579f34635e10b1 [id=55e54e5631d94a849236a5cb69ada911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.334225 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f9fbe38c9459b8e07b6124443f546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.336438 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 (DEFAULT_TABLE table=default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.336437 897 tablet_service.cc:1511] Processing CreateTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 (DEFAULT_TABLE table=default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.336651 1171 tablet_bootstrap.cc:492] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.336767 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cde484c8a045aeac133bac6f1b90d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.336774 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cde484c8a045aeac133bac6f1b90d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.336853 1171 ts_tablet_manager.cc:1403] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260503 07:52:47.337875 1171 raft_consensus.cc:359] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.338135 1171 raft_consensus.cc:385] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.338243 1171 raft_consensus.cc:740] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.338588 1171 consensus_queue.cc:260] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.340456 896 tablet_service.cc:1511] Processing CreateTablet for tablet ee0842dda8fb47ee828189e25a0a2ead (DEFAULT_TABLE table=default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.340801 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0842dda8fb47ee828189e25a0a2ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.341957 1171 ts_tablet_manager.cc:1434] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:47.343748 1171 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.344810 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 689f9fbe38c9459b8e07b6124443f546 (DEFAULT_TABLE table=default.Table_0cbb59b16d8742eab3579f34635e10b1 [id=55e54e5631d94a849236a5cb69ada911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.345177 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f9fbe38c9459b8e07b6124443f546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.347644 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:47.348304 898 tablet_service.cc:1511] Processing CreateTablet for tablet 06670a873e994cbea50627dc7eb02e0e (DEFAULT_TABLE table=default.Table_82b1e6aeba834c489a4aa1c15be7d5a3 [id=a73654d3dcae49909e766eb795334a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.348690 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06670a873e994cbea50627dc7eb02e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.348985 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.352332 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.353763 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.356220 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:47.356537 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 635ab42e600c4cadb5de8dae40f051cd from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.357182 594 master_service.cc:954] ReplaceTablet: received request to replace tablet a9d0125d2adf4e269e7cec0b2a34f14b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.357334 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.357916 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 635ab42e600c4cadb5de8dae40f051cd from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.358166 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:47.358522 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 457e4ddbab8b4241ab8ea947442f7171 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.358479 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 06670a873e994cbea50627dc7eb02e0e (DEFAULT_TABLE table=default.Table_82b1e6aeba834c489a4aa1c15be7d5a3 [id=a73654d3dcae49909e766eb795334a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.358841 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06670a873e994cbea50627dc7eb02e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.359488 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 457e4ddbab8b4241ab8ea947442f7171
W20260503 07:52:47.361342 1101 tablet.cc:2404] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:52:47.363006 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.364277 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.364801 759 tablet_service.cc:1511] Processing CreateTablet for tablet 06670a873e994cbea50627dc7eb02e0e (DEFAULT_TABLE table=default.Table_82b1e6aeba834c489a4aa1c15be7d5a3 [id=a73654d3dcae49909e766eb795334a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.365365 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.365799 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.366093 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.366335 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.366725 755 tablet_service.cc:1511] Processing CreateTablet for tablet 1abbb083010f476b8a0803fabc3279bb (DEFAULT_TABLE table=default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:47.367036 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1abbb083010f476b8a0803fabc3279bb because the tablet was not found. No further retry: Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb
W20260503 07:52:47.367296 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c17bc19639ba40dfb98298264ccfb217 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c17bc19639ba40dfb98298264ccfb217 already in progress: creating tablet
I20260503 07:52:47.369616 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.369879 1175 tablet_replica.cc:333] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.370101 1175 raft_consensus.cc:2243] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.370286 1175 raft_consensus.cc:2272] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.371272 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1abbb083010f476b8a0803fabc3279bb (DEFAULT_TABLE table=default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.371716 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abbb083010f476b8a0803fabc3279bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.373382 1175 ts_tablet_manager.cc:1916] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.374122 1171 tablet_bootstrap.cc:654] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.374861 1165 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.375351 1165 ts_tablet_manager.cc:1403] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.072s user 0.019s sys 0.037s
I20260503 07:52:47.376649 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cde484c8a045aeac133bac6f1b90d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.377058 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06670a873e994cbea50627dc7eb02e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.377251 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f9fbe38c9459b8e07b6124443f546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.377730 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abbb083010f476b8a0803fabc3279bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.380330 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0842dda8fb47ee828189e25a0a2ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.380482 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.381096 894 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.381410 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.381742 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1abbb083010f476b8a0803fabc3279bb (DEFAULT_TABLE table=default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.382457 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abbb083010f476b8a0803fabc3279bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.384061 1165 raft_consensus.cc:359] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.384296 1165 raft_consensus.cc:385] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.384380 1165 raft_consensus.cc:740] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.384662 1165 consensus_queue.cc:260] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.385344 1165 ts_tablet_manager.cc:1434] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:52:47.385676 1165 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.387493 1165 tablet_bootstrap.cc:654] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.391712 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_53d4f41a64b746c39ed8ef110ccc4b6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.392076 597 master_service.cc:954] ReplaceTablet: received request to replace tablet c17bc19639ba40dfb98298264ccfb217 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:47.392498 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53d4f41a64b746c39ed8ef110ccc4b6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.397455 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c36955b6400a4df98f08dcbaeb082c5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.398097 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c36955b6400a4df98f08dcbaeb082c5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.401091 1165 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.401234 1165 ts_tablet_manager.cc:1403] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.008s
I20260503 07:52:47.402056 1165 raft_consensus.cc:359] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.402271 1165 raft_consensus.cc:385] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.402361 1165 raft_consensus.cc:740] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.402585 1165 consensus_queue.cc:260] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.404256 1165 ts_tablet_manager.cc:1434] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:52:47.404520 1165 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.406234 1165 tablet_bootstrap.cc:654] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.408983 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d603048462fb48e1a3b3e598a27578c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.409639 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d603048462fb48e1a3b3e598a27578c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.412810 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_362fde0797b34598b60edaa65684a580"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.413080 760 tablet_service.cc:1511] Processing CreateTablet for tablet d37da070cc41438b84dc09ea74e38fe9 (DEFAULT_TABLE table=default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:47.413115 829 tablet.cc:2404] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260503 07:52:47.413308 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_362fde0797b34598b60edaa65684a580 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.413493 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37da070cc41438b84dc09ea74e38fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.414558 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9316d28baa15464dab512f62ff026c9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.415212 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9316d28baa15464dab512f62ff026c9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.417516 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.419309 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b131227ef39e4cf383e705bb0ed3f158 with delete_type TABLET_DATA_DELETED (replaced by tablet a9d0125d2adf4e269e7cec0b2a34f14b) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.422786 1175 ts_tablet_manager.cc:1929] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.425416 897 tablet_service.cc:1511] Processing CreateTablet for tablet d37da070cc41438b84dc09ea74e38fe9 (DEFAULT_TABLE table=default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.426055 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37da070cc41438b84dc09ea74e38fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.431511 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d37da070cc41438b84dc09ea74e38fe9 (DEFAULT_TABLE table=default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.432299 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37da070cc41438b84dc09ea74e38fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.433578 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.434309 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:47.437839 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1abbb083010f476b8a0803fabc3279bb because the tablet was not found. No further retry: Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb
W20260503 07:52:47.438634 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 457e4ddbab8b4241ab8ea947442f7171 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 457e4ddbab8b4241ab8ea947442f7171 already in progress: creating tablet
I20260503 07:52:47.438938 1175 log.cc:1199] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/457e4ddbab8b4241ab8ea947442f7171
W20260503 07:52:47.439371 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c17bc19639ba40dfb98298264ccfb217 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c17bc19639ba40dfb98298264ccfb217 already in progress: creating tablet
I20260503 07:52:47.439927 1175 ts_tablet_manager.cc:1950] T 457e4ddbab8b4241ab8ea947442f7171 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:47.440935 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 44cde484c8a045aeac133bac6f1b90d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cde484c8a045aeac133bac6f1b90d2 already in progress: creating tablet
I20260503 07:52:47.442312 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 457e4ddbab8b4241ab8ea947442f7171 (table default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]) successfully deleted
I20260503 07:52:47.443281 1175 tablet_replica.cc:333] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.443452 1175 raft_consensus.cc:2243] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.443641 1175 raft_consensus.cc:2272] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.444454 1175 ts_tablet_manager.cc:1916] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.448856 1166 tablet_bootstrap.cc:492] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.449016 1166 ts_tablet_manager.cc:1403] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.298s user 0.062s sys 0.088s
I20260503 07:52:47.449790 1166 raft_consensus.cc:359] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.449987 1166 raft_consensus.cc:385] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.450071 1166 raft_consensus.cc:740] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.450289 1166 consensus_queue.cc:260] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.450611 1175 ts_tablet_manager.cc:1929] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.450744 1175 log.cc:1199] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/796cda9860564570af279f6ac351b97a
I20260503 07:52:47.450868 1166 ts_tablet_manager.cc:1434] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:47.451151 1175 ts_tablet_manager.cc:1950] T 796cda9860564570af279f6ac351b97a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:47.452004 1165 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.452222 1165 ts_tablet_manager.cc:1403] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.020s
I20260503 07:52:47.453075 1165 raft_consensus.cc:359] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.453316 1165 raft_consensus.cc:385] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.453428 1165 raft_consensus.cc:740] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.453725 1165 consensus_queue.cc:260] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.455891 1165 ts_tablet_manager.cc:1434] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:47.456249 1165 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.458312 1165 tablet_bootstrap.cc:654] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.459257 1175 tablet_replica.cc:333] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.460398 1175 raft_consensus.cc:2243] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.460398 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 796cda9860564570af279f6ac351b97a (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
I20260503 07:52:47.460546 1166 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.460613 1175 raft_consensus.cc:2272] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:47.460733 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 44cde484c8a045aeac133bac6f1b90d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cde484c8a045aeac133bac6f1b90d2 already in progress: creating tablet
I20260503 07:52:47.460872 1170 raft_consensus.cc:493] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:47.461028 1170 raft_consensus.cc:515] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.461668 1170 leader_election.cc:290] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:47.462368 1166 tablet_bootstrap.cc:654] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:47.462680 716 leader_election.cc:343] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.463496 1175 ts_tablet_manager.cc:1916] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.465569 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7a0470e45012432ca480392d9aafa244"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.467038 1174 ts_tablet_manager.cc:1929] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.467171 1174 log.cc:1199] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b131227ef39e4cf383e705bb0ed3f158
I20260503 07:52:47.467576 1174 ts_tablet_manager.cc:1950] T b131227ef39e4cf383e705bb0ed3f158 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.468470 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_666b4a99d24544c2a0a8f2e466eda7c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.469053 1174 tablet_replica.cc:333] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:52:47.469116 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_666b4a99d24544c2a0a8f2e466eda7c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.469310 1174 raft_consensus.cc:2243] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.469501 1174 raft_consensus.cc:2272] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.469533 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6c53939001264a67847b3e2f051ef279"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.470047 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c53939001264a67847b3e2f051ef279 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.470496 1174 ts_tablet_manager.cc:1916] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:47.470619 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a0470e45012432ca480392d9aafa244 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.472441 1175 ts_tablet_manager.cc:1929] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.473322 1175 log.cc:1199] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b131227ef39e4cf383e705bb0ed3f158
I20260503 07:52:47.473899 1175 ts_tablet_manager.cc:1950] T b131227ef39e4cf383e705bb0ed3f158 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:47.477411 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b131227ef39e4cf383e705bb0ed3f158 (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]) successfully deleted
I20260503 07:52:47.478952 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d1a33e487b8f41e289685a17a649fbb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.479413 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1a33e487b8f41e289685a17a649fbb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.483074 1174 ts_tablet_manager.cc:1929] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:47.483767 987 connection.cc:570] client connection to 127.0.105.61:41759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:52:47.483916 965 heartbeater.cc:646] Failed to heartbeat to 127.0.105.61:41759 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.105.61:41759 (error 108)
W20260503 07:52:47.484416 714 connection.cc:570] client connection to 127.0.105.61:41759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 07:52:47.484426 1174 log.cc:1199] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/a9d0125d2adf4e269e7cec0b2a34f14b
W20260503 07:52:47.484660 586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.61:41759 (error 108)
W20260503 07:52:47.485121 1100 heartbeater.cc:646] Failed to heartbeat to 127.0.105.61:41759 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:52:47.485705 828 heartbeater.cc:646] Failed to heartbeat to 127.0.105.61:41759 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 07:52:47.486198 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_53d4f41a64b746c39ed8ef110ccc4b6d" } modify_external_catalogs: true
I20260503 07:52:47.486388 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_53d4f41a64b746c39ed8ef110ccc4b6d" } modify_external_catalogs: true
W20260503 07:52:47.488484 1162 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 07:52:47.485998 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.61:41759 (local address 127.0.0.1:46918)
0503 07:52:47.486212 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0503 07:52:47.486233 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0503 07:52:47.486340 (+ 107us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0503 07:52:47.487762 (+ 1422us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":109}
I20260503 07:52:47.488413 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635ab42e600c4cadb5de8dae40f051cd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:47.488510 1181 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 07:52:47.486442 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.61:41759 (local address 127.0.105.1:42597)
0503 07:52:47.486768 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0503 07:52:47.486790 (+ 22us) client_negotiation.cc:175] Beginning negotiation
0503 07:52:47.486916 (+ 126us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0503 07:52:47.487564 (+ 648us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":196}
W20260503 07:52:47.488901 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:47.485178 1174 ts_tablet_manager.cc:1950] T a9d0125d2adf4e269e7cec0b2a34f14b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.490101 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.490425 1173 tablet_replica.cc:333] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.490710 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet a9d0125d2adf4e269e7cec0b2a34f14b (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]) successfully deleted
I20260503 07:52:47.490779 918 raft_consensus.cc:2468] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:52:47.491067 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1abbb083010f476b8a0803fabc3279bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1abbb083010f476b8a0803fabc3279bb already in progress: creating tablet
I20260503 07:52:47.493261 1173 raft_consensus.cc:2243] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.493844 1173 raft_consensus.cc:2272] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:47.493891 1197 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 07:52:47.487311 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.61:41759 (local address 127.0.105.3:53809)
0503 07:52:47.492636 (+ 5325us) negotiation.cc:107] Waiting for socket to connect
0503 07:52:47.492764 (+ 128us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":5213,"thread_start_us":5072,"threads_started":1}
I20260503 07:52:47.494469 1174 tablet_replica.cc:333] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.494815 1174 raft_consensus.cc:2243] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.494784 1173 ts_tablet_manager.cc:1916] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:47.494803 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 44cde484c8a045aeac133bac6f1b90d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cde484c8a045aeac133bac6f1b90d2 already in progress: creating tablet
I20260503 07:52:47.494369 715 leader_election.cc:304] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f
I20260503 07:52:47.495327 1174 raft_consensus.cc:2272] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.495628 1170 raft_consensus.cc:2804] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:47.495802 1170 raft_consensus.cc:493] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:47.495936 1170 raft_consensus.cc:3060] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:47.499526 1170 raft_consensus.cc:515] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.500994 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635ab42e600c4cadb5de8dae40f051cd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:47.501680 715 leader_election.cc:343] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:52:47.502341 1174 ts_tablet_manager.cc:1916] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.502991 1173 ts_tablet_manager.cc:1929] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:47.503015 716 leader_election.cc:343] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.503168 716 leader_election.cc:304] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:47.503422 1187 raft_consensus.cc:2749] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:52:47.503453 1170 leader_election.cc:290] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:47.509011 1174 ts_tablet_manager.cc:1929] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.509982 1174 log.cc:1199] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:47.510581 1174 ts_tablet_manager.cc:1950] T c17bc19639ba40dfb98298264ccfb217 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.511034 1173 log.cc:1199] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.511543 1173 ts_tablet_manager.cc:1950] T 635ab42e600c4cadb5de8dae40f051cd P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:47.511911 1174 tablet_replica.cc:333] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.512106 1174 raft_consensus.cc:2243] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:47.512562 1174 pending_rounds.cc:70] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:47.513022 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 635ab42e600c4cadb5de8dae40f051cd (table default.Table_7c6f8d585e5545b2aca05812e1fffebe [id=cf7e85f403f044c88e5482ede91a1c50]) successfully deleted
I20260503 07:52:47.514413 1174 pending_rounds.cc:77] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847367000080384 op_type: NO_OP noop_request { }
W20260503 07:52:47.514828 1196 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 07:52:47.485329 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.61:41759 (local address 127.0.105.2:56143)
0503 07:52:47.486917 (+ 1588us) negotiation.cc:107] Waiting for socket to connect
0503 07:52:47.486934 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0503 07:52:47.487064 (+ 130us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0503 07:52:47.513424 (+ 26360us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1469,"thread_start_us":1347,"threads_started":1}
I20260503 07:52:47.517177 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4d5cbf3e54f140e7a7712d5281d4bed2" } new_table_name: "default.Table_1bcc06588d644890939cad19e7fc29e1" modify_external_catalogs: true
I20260503 07:52:47.519018 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9cbf1d7c9e9540fc9c58cddde8f56d03" } new_table_name: "default.Table_eb80b26e4e04423f8945101fe5f5f3c4" modify_external_catalogs: true
I20260503 07:52:47.519788 1174 raft_consensus.cc:2889] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:47.519937 1174 raft_consensus.cc:2272] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.520394 891 tablet_service.cc:1511] Processing CreateTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (DEFAULT_TABLE table=default.Table_4d5cbf3e54f140e7a7712d5281d4bed2 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.520588 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_82b1e6aeba834c489a4aa1c15be7d5a3" } new_table_name: "default.Table_ba6d0cc847134b939a7a5d1c6183a485" modify_external_catalogs: true
I20260503 07:52:47.520931 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5999c4e4e9408b9c8c6fe27b2dac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.522287 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0cbb59b16d8742eab3579f34635e10b1" } new_table_name: "default.Table_22aaab5413f84321b9598fd533c78dcd" modify_external_catalogs: true
I20260503 07:52:47.523871 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_87d5c787df2e4057934312a204ca3ec9" } new_table_name: "default.Table_c60afbb5b3b24b6aa5af112059e3ef55" modify_external_catalogs: true
I20260503 07:52:47.524773 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 635ab42e600c4cadb5de8dae40f051cd with delete_type TABLET_DATA_DELETED (replaced by tablet 3c010814b6704a249dfb8b081131f240) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.525132 895 tablet_service.cc:1511] Processing CreateTablet for tablet 934a0b41c303482daba10a7acd91fb9d (DEFAULT_TABLE table=default.Table_87d5c787df2e4057934312a204ca3ec9 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.525290 1174 ts_tablet_manager.cc:1916] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.525465 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934a0b41c303482daba10a7acd91fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.527160 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (DEFAULT_TABLE table=default.Table_4d5cbf3e54f140e7a7712d5281d4bed2 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.527267 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 34b18184e1a3492888e173481fca5411 (DEFAULT_TABLE table=default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.527621 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5999c4e4e9408b9c8c6fe27b2dac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.527668 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 934a0b41c303482daba10a7acd91fb9d (DEFAULT_TABLE table=default.Table_87d5c787df2e4057934312a204ca3ec9 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.528978 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c17bc19639ba40dfb98298264ccfb217 (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
I20260503 07:52:47.530344 760 tablet_service.cc:1511] Processing CreateTablet for tablet 15714a97dd7749bb8e2ca20f795c760a (DEFAULT_TABLE table=default.Table_f16f9f3d92d14e6c8240bc4928c42475 [id=0430785b327e401aa28af2b2a66e4163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.530717 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15714a97dd7749bb8e2ca20f795c760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.531245 1174 ts_tablet_manager.cc:1929] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:47.531379 1174 log.cc:1199] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/457e4ddbab8b4241ab8ea947442f7171
I20260503 07:52:47.531656 896 tablet_service.cc:1511] Processing CreateTablet for tablet 34b18184e1a3492888e173481fca5411 (DEFAULT_TABLE table=default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.531841 1174 ts_tablet_manager.cc:1950] T 457e4ddbab8b4241ab8ea947442f7171 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.532027 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b18184e1a3492888e173481fca5411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.532871 1174 tablet_replica.cc:333] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.533058 1174 raft_consensus.cc:2243] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.533207 1174 raft_consensus.cc:2272] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.534868 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 457e4ddbab8b4241ab8ea947442f7171 (table default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]) successfully deleted
I20260503 07:52:47.535288 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 15714a97dd7749bb8e2ca20f795c760a (DEFAULT_TABLE table=default.Table_f16f9f3d92d14e6c8240bc4928c42475 [id=0430785b327e401aa28af2b2a66e4163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.536492 761 tablet_service.cc:1511] Processing CreateTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (DEFAULT_TABLE table=default.Table_4d5cbf3e54f140e7a7712d5281d4bed2 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.536618 897 tablet_service.cc:1511] Processing CreateTablet for tablet 15714a97dd7749bb8e2ca20f795c760a (DEFAULT_TABLE table=default.Table_f16f9f3d92d14e6c8240bc4928c42475 [id=0430785b327e401aa28af2b2a66e4163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.536979 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15714a97dd7749bb8e2ca20f795c760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.536937 757 tablet_service.cc:1511] Processing CreateTablet for tablet 934a0b41c303482daba10a7acd91fb9d (DEFAULT_TABLE table=default.Table_87d5c787df2e4057934312a204ca3ec9 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.536938 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5999c4e4e9408b9c8c6fe27b2dac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.537472 755 tablet_service.cc:1511] Processing CreateTablet for tablet 34b18184e1a3492888e173481fca5411 (DEFAULT_TABLE table=default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.537628 1165 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.537779 1165 ts_tablet_manager.cc:1403] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.082s user 0.029s sys 0.020s
I20260503 07:52:47.537813 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b18184e1a3492888e173481fca5411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.538627 1165 raft_consensus.cc:359] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.538818 1165 raft_consensus.cc:385] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.539276 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934a0b41c303482daba10a7acd91fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.539521 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15714a97dd7749bb8e2ca20f795c760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.544384 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b18184e1a3492888e173481fca5411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.544862 1171 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.545019 1171 ts_tablet_manager.cc:1403] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.201s user 0.041s sys 0.012s
I20260503 07:52:47.545943 1171 raft_consensus.cc:359] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.546182 1171 raft_consensus.cc:385] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.546298 1171 raft_consensus.cc:740] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.546645 1171 consensus_queue.cc:260] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.547184 1171 ts_tablet_manager.cc:1434] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:47.549410 1166 tablet_bootstrap.cc:492] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.549641 1166 ts_tablet_manager.cc:1403] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.006s
I20260503 07:52:47.550500 1166 raft_consensus.cc:359] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
W20260503 07:52:47.551138 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 635ab42e600c4cadb5de8dae40f051cd because the tablet was not found. No further retry: Not found: Tablet not found: 635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.551481 1166 raft_consensus.cc:385] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.551656 1166 raft_consensus.cc:740] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.551981 1166 consensus_queue.cc:260] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.553973 1166 ts_tablet_manager.cc:1434] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:47.555187 1171 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.554258 1166 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.556998 1171 tablet_bootstrap.cc:654] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.558552 1166 tablet_bootstrap.cc:654] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.561182 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934a0b41c303482daba10a7acd91fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.570596 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c6f8d585e5545b2aca05812e1fffebe" } modify_external_catalogs: true
I20260503 07:52:47.570842 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c6f8d585e5545b2aca05812e1fffebe" } modify_external_catalogs: true
I20260503 07:52:47.571549 600 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 8f4fab4c213a49de9c7cdeb3831f8817
I20260503 07:52:47.573578 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.574121 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 796cda9860564570af279f6ac351b97a with delete_type TABLET_DATA_DELETED (replaced by tablet c17bc19639ba40dfb98298264ccfb217) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.575722 1175 tablet_replica.cc:333] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.575904 1175 raft_consensus.cc:2243] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.576072 1175 raft_consensus.cc:2272] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.577131 1171 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.577313 1171 ts_tablet_manager.cc:1403] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.007s
I20260503 07:52:47.577286 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_362fde0797b34598b60edaa65684a580" } modify_external_catalogs: true
I20260503 07:52:47.577443 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_362fde0797b34598b60edaa65684a580" } modify_external_catalogs: true
I20260503 07:52:47.578754 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8a0149ba551e45f8a897ba90adbf4b87" } modify_external_catalogs: true
I20260503 07:52:47.578900 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8a0149ba551e45f8a897ba90adbf4b87" } modify_external_catalogs: true
I20260503 07:52:47.580368 1175 ts_tablet_manager.cc:1916] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.580551 1171 raft_consensus.cc:359] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.580785 1171 raft_consensus.cc:385] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.580864 1171 raft_consensus.cc:740] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.581100 1171 consensus_queue.cc:260] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.581579 1171 ts_tablet_manager.cc:1434] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:52:47.581920 1171 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.583750 1171 tablet_bootstrap.cc:654] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.584751 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ba1703633e274a70a5d6fbf35822d164" } modify_external_catalogs: true
I20260503 07:52:47.585002 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ba1703633e274a70a5d6fbf35822d164" } modify_external_catalogs: true
I20260503 07:52:47.586831 1175 ts_tablet_manager.cc:1929] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.587006 1175 log.cc:1199] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/a9d0125d2adf4e269e7cec0b2a34f14b
I20260503 07:52:47.587442 1175 ts_tablet_manager.cc:1950] T a9d0125d2adf4e269e7cec0b2a34f14b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:47.588442 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad5999c4e4e9408b9c8c6fe27b2dac21 consensus state has no leader
I20260503 07:52:47.588765 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 44cde484c8a045aeac133bac6f1b90d2 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:47.589160 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3557e3ab9241eb8f76488b6a5390a5 consensus state has no leader
I20260503 07:52:47.589211 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 457e4ddbab8b4241ab8ea947442f7171 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.589399 598 master_service.cc:954] ReplaceTablet: received request to replace tablet ad5999c4e4e9408b9c8c6fe27b2dac21 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.589603 597 master_service.cc:954] ReplaceTablet: received request to replace tablet d37da070cc41438b84dc09ea74e38fe9 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.588459 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet a9d0125d2adf4e269e7cec0b2a34f14b (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]) successfully deleted
W20260503 07:52:47.590827 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06670a873e994cbea50627dc7eb02e0e consensus state has no leader
W20260503 07:52:47.591224 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 934a0b41c303482daba10a7acd91fb9d consensus state has no leader
W20260503 07:52:47.591280 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 689f9fbe38c9459b8e07b6124443f546 consensus state has no leader
I20260503 07:52:47.594329 1174 ts_tablet_manager.cc:1916] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.594710 1171 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.594854 1171 ts_tablet_manager.cc:1403] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260503 07:52:47.595645 1171 raft_consensus.cc:359] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.595811 1171 raft_consensus.cc:385] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.595919 1171 raft_consensus.cc:740] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.596122 1171 consensus_queue.cc:260] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.596647 1171 ts_tablet_manager.cc:1434] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:47.596959 1171 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.598623 1171 tablet_bootstrap.cc:654] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.599830 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2919cf168bac48e5abbd261590487e8f (DEFAULT_TABLE table=default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.600378 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919cf168bac48e5abbd261590487e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.604485 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2919cf168bac48e5abbd261590487e8f (DEFAULT_TABLE table=default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.604971 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919cf168bac48e5abbd261590487e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.606544 1174 ts_tablet_manager.cc:1929] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.607029 1173 tablet_replica.cc:333] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.607311 1173 raft_consensus.cc:2243] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.607717 1174 log.cc:1199] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/796cda9860564570af279f6ac351b97a
I20260503 07:52:47.608031 1173 raft_consensus.cc:2272] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.608610 1174 ts_tablet_manager.cc:1950] T 796cda9860564570af279f6ac351b97a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.609625 1173 ts_tablet_manager.cc:1916] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.606752 1165 raft_consensus.cc:740] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.610230 1165 consensus_queue.cc:260] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.612982 596 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 36cc2dc635f841a7a121b17bc47366d3
I20260503 07:52:47.615926 1165 ts_tablet_manager.cc:1434] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.078s user 0.001s sys 0.001s
I20260503 07:52:47.621595 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 934a0b41c303482daba10a7acd91fb9d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.625993 1165 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.626832 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2919cf168bac48e5abbd261590487e8f (DEFAULT_TABLE table=default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.628535 1165 tablet_bootstrap.cc:654] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.630795 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 796cda9860564570af279f6ac351b97a (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
I20260503 07:52:47.631291 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919cf168bac48e5abbd261590487e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.635233 1178 raft_consensus.cc:493] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:47.635464 1178 raft_consensus.cc:515] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.636430 1174 tablet_replica.cc:333] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.636682 1174 raft_consensus.cc:2243] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.636893 1174 raft_consensus.cc:2272] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.637815 1174 ts_tablet_manager.cc:1916] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.638042 1178 leader_election.cc:290] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:47.647284 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c5018bd960184e978049b6a6fb07ea20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.648129 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5018bd960184e978049b6a6fb07ea20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.650367 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 934a0b41c303482daba10a7acd91fb9d
I20260503 07:52:47.651005 599 catalog_manager.cc:6741] ReplaceTablet: tablet 934a0b41c303482daba10a7acd91fb9d deleted and replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2
I20260503 07:52:47.651041 1165 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.651254 1165 ts_tablet_manager.cc:1403] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260503 07:52:47.652220 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ad5999c4e4e9408b9c8c6fe27b2dac21
I20260503 07:52:47.652820 598 catalog_manager.cc:6741] ReplaceTablet: tablet ad5999c4e4e9408b9c8c6fe27b2dac21 deleted and replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:47.653695 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.653880 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:47.654354 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 934a0b41c303482daba10a7acd91fb9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 934a0b41c303482daba10a7acd91fb9d already in progress: creating tablet
W20260503 07:52:47.654968 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5999c4e4e9408b9c8c6fe27b2dac21 already in progress: creating tablet
I20260503 07:52:47.658440 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.660145 1165 raft_consensus.cc:359] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.660638 1165 raft_consensus.cc:385] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.660733 1165 raft_consensus.cc:740] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.662777 755 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.663419 1165 consensus_queue.cc:260] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.663694 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.664340 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c010814b6704a249dfb8b081131f240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.664773 1175 tablet_replica.cc:333] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.665024 1175 raft_consensus.cc:2243] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.665237 1175 raft_consensus.cc:2272] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.666093 1175 ts_tablet_manager.cc:1916] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.667061 1165 ts_tablet_manager.cc:1434] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
W20260503 07:52:47.668802 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet a9d0125d2adf4e269e7cec0b2a34f14b because the tablet was not found. No further retry: Not found: Tablet not found: a9d0125d2adf4e269e7cec0b2a34f14b
I20260503 07:52:47.670435 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.670811 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c010814b6704a249dfb8b081131f240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.670811 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.672868 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.673789 1175 ts_tablet_manager.cc:1929] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.674057 1175 log.cc:1199] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.674525 1175 ts_tablet_manager.cc:1950] T 3c010814b6704a249dfb8b081131f240 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:47.675467 1175 tablet_replica.cc:333] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:47.675696 1175 raft_consensus.cc:2243] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.675933 1175 raft_consensus.cc:2272] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.676508 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 3c010814b6704a249dfb8b081131f240 (table default.Table_7c6f8d585e5545b2aca05812e1fffebe [id=cf7e85f403f044c88e5482ede91a1c50]) successfully deleted
I20260503 07:52:47.676578 1175 ts_tablet_manager.cc:1916] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.677350 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3557e3ab9241eb8f76488b6a5390a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:47.678097 988 leader_election.cc:343] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:47.682937 1173 ts_tablet_manager.cc:1929] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.683070 1173 log.cc:1199] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/796cda9860564570af279f6ac351b97a
I20260503 07:52:47.683074 1166 tablet_bootstrap.cc:492] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.683251 1166 ts_tablet_manager.cc:1403] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.129s user 0.034s sys 0.047s
I20260503 07:52:47.683488 1173 ts_tablet_manager.cc:1950] T 796cda9860564570af279f6ac351b97a P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:47.684237 1166 raft_consensus.cc:359] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.684417 1166 raft_consensus.cc:385] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.684506 1166 raft_consensus.cc:740] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.684762 1166 consensus_queue.cc:260] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.685134 1165 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.685499 1166 ts_tablet_manager.cc:1434] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:47.686728 1166 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.686756 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.688637 1166 tablet_bootstrap.cc:654] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.690963 1175 ts_tablet_manager.cc:1929] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.691140 1175 log.cc:1199] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:47.691567 1175 ts_tablet_manager.cc:1950] T c17bc19639ba40dfb98298264ccfb217 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:47.692538 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c17bc19639ba40dfb98298264ccfb217 (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
I20260503 07:52:47.692863 1165 tablet_bootstrap.cc:654] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.696324 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:47.696913 1166 tablet_bootstrap.cc:492] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.696997 1174 ts_tablet_manager.cc:1929] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.697129 1166 ts_tablet_manager.cc:1403] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260503 07:52:47.697202 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.698139 1166 raft_consensus.cc:359] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.698340 1166 raft_consensus.cc:385] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.698422 1166 raft_consensus.cc:740] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.698748 1166 consensus_queue.cc:260] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.698881 1171 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.698758 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 457e4ddbab8b4241ab8ea947442f7171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.699064 1171 ts_tablet_manager.cc:1403] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.102s user 0.035s sys 0.057s
I20260503 07:52:47.700038 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:47.700318 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 796cda9860564570af279f6ac351b97a (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
W20260503 07:52:47.700672 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d37da070cc41438b84dc09ea74e38fe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37da070cc41438b84dc09ea74e38fe9 already in progress: creating tablet
I20260503 07:52:47.701242 1174 log.cc:1199] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/635ab42e600c4cadb5de8dae40f051cd
I20260503 07:52:47.701200 1171 raft_consensus.cc:359] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.701408 1171 raft_consensus.cc:385] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.701485 1171 raft_consensus.cc:740] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.701642 1174 ts_tablet_manager.cc:1950] T 635ab42e600c4cadb5de8dae40f051cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.701723 1171 consensus_queue.cc:260] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.702075 1166 ts_tablet_manager.cc:1434] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260503 07:52:47.703207 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5999c4e4e9408b9c8c6fe27b2dac21 already in progress: creating tablet
I20260503 07:52:47.703532 1171 ts_tablet_manager.cc:1434] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:47.699247 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3557e3ab9241eb8f76488b6a5390a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:47.703842 1171 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.703886 781 raft_consensus.cc:2468] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:47.704411 1165 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.699847 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c010814b6704a249dfb8b081131f240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.700639 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.704566 1165 ts_tablet_manager.cc:1403] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260503 07:52:47.705042 986 leader_election.cc:304] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:47.705253 1174 tablet_replica.cc:333] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:47.705505 1171 tablet_bootstrap.cc:654] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.705873 1178 raft_consensus.cc:2804] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:47.705879 1165 raft_consensus.cc:359] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.705996 1178 raft_consensus.cc:493] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:47.706060 1165 raft_consensus.cc:385] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.706140 1165 raft_consensus.cc:740] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.706337 1165 consensus_queue.cc:260] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.706125 1178 raft_consensus.cc:3060] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:47.707130 1174 raft_consensus.cc:2243] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.707280 1174 raft_consensus.cc:2272] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.708010 1174 ts_tablet_manager.cc:1916] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.711163 1165 ts_tablet_manager.cc:1434] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260503 07:52:47.711447 1165 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:47.711613 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 934a0b41c303482daba10a7acd91fb9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 934a0b41c303482daba10a7acd91fb9d already in progress: creating tablet
I20260503 07:52:47.713280 1165 tablet_bootstrap.cc:654] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:47.713413 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d37da070cc41438b84dc09ea74e38fe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37da070cc41438b84dc09ea74e38fe9 already in progress: creating tablet
I20260503 07:52:47.715333 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_ba6d0cc847134b939a7a5d1c6183a485 [id=a73654d3dcae49909e766eb795334a56]). Expected version 1 got 0
I20260503 07:52:47.716161 1174 ts_tablet_manager.cc:1929] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.716352 1174 log.cc:1199] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.716766 1174 ts_tablet_manager.cc:1950] T 3c010814b6704a249dfb8b081131f240 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.718591 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:47.718695 1165 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:47.719523 897 tablet_service.cc:1511] Processing CreateTablet for tablet d3a35d4033e24b95962a2acf9d19c13f (DEFAULT_TABLE table=default.Table_d1a33e487b8f41e289685a17a649fbb8 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.718833 1165 ts_tablet_manager.cc:1403] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.003s
I20260503 07:52:47.720391 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb (DEFAULT_TABLE table=default.Table_6c53939001264a67847b3e2f051ef279 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.721143 896 tablet_service.cc:1511] Processing CreateTablet for tablet d7807da20d4c4b90a9e387cb72813557 (DEFAULT_TABLE table=default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.711148 1178 raft_consensus.cc:515] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.722431 1178 leader_election.cc:290] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:47.723374 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb (DEFAULT_TABLE table=default.Table_6c53939001264a67847b3e2f051ef279 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.723889 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eca7f88573745c5ae68fdb32cda2feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.724414 895 tablet_service.cc:1511] Processing CreateTablet for tablet c37459b741904a8696064201992d4591 (DEFAULT_TABLE table=default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.725165 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (DEFAULT_TABLE table=default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.725585 893 tablet_service.cc:1511] Processing CreateTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 (DEFAULT_TABLE table=default.Table_7a0470e45012432ca480392d9aafa244 [id=93956c0b5ffb404e8b44ef9a0a324c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.726090 1166 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.727738 1166 tablet_bootstrap.cc:654] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.728709 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3557e3ab9241eb8f76488b6a5390a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:47.728911 918 raft_consensus.cc:3060] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:47.729486 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.732339 918 raft_consensus.cc:2468] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:47.732743 988 leader_election.cc:304] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:47.732977 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943498e981f341d0aa279f8a37c5d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.733049 1178 raft_consensus.cc:2804] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:47.733186 1173 tablet_replica.cc:333] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.733382 1173 raft_consensus.cc:2243] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.733536 1173 raft_consensus.cc:2272] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.734230 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_eb80b26e4e04423f8945101fe5f5f3c4 [id=2403919936864afb980b1c2528f2877d]). Expected version 3 got 0
W20260503 07:52:47.734385 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 934a0b41c303482daba10a7acd91fb9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 934a0b41c303482daba10a7acd91fb9d already in progress: creating tablet
W20260503 07:52:47.734622 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3c010814b6704a249dfb8b081131f240 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c010814b6704a249dfb8b081131f240 already in progress: creating tablet
W20260503 07:52:47.734812 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5999c4e4e9408b9c8c6fe27b2dac21 already in progress: creating tablet
W20260503 07:52:47.735044 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d37da070cc41438b84dc09ea74e38fe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37da070cc41438b84dc09ea74e38fe9 already in progress: creating tablet
I20260503 07:52:47.735446 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5690198617de4f568132e24708d77418 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.735778 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5690198617de4f568132e24708d77418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.736387 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eca7f88573745c5ae68fdb32cda2feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.736689 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3c010814b6704a249dfb8b081131f240 (table default.Table_7c6f8d585e5545b2aca05812e1fffebe [id=cf7e85f403f044c88e5482ede91a1c50]) successfully deleted
I20260503 07:52:47.736860 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d7807da20d4c4b90a9e387cb72813557 (DEFAULT_TABLE table=default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.737023 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b89b9f7fb8b8435485a75bce914f0edd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.737214 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7807da20d4c4b90a9e387cb72813557. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:47.737591 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b89b9f7fb8b8435485a75bce914f0edd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.738794 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9aac441308aa450a8796690b388843e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.739251 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aac441308aa450a8796690b388843e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.740377 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7807da20d4c4b90a9e387cb72813557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.740432 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c37459b741904a8696064201992d4591 (DEFAULT_TABLE table=default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.740764 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37459b741904a8696064201992d4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.741466 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.741844 755 tablet_service.cc:1511] Processing CreateTablet for tablet d3a35d4033e24b95962a2acf9d19c13f (DEFAULT_TABLE table=default.Table_d1a33e487b8f41e289685a17a649fbb8 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.742247 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb (DEFAULT_TABLE table=default.Table_6c53939001264a67847b3e2f051ef279 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.742329 761 tablet_service.cc:1511] Processing CreateTablet for tablet c37459b741904a8696064201992d4591 (DEFAULT_TABLE table=default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.741794 760 tablet_service.cc:1511] Processing CreateTablet for tablet d7807da20d4c4b90a9e387cb72813557 (DEFAULT_TABLE table=default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.742915 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (DEFAULT_TABLE table=default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.743014 758 tablet_service.cc:1511] Processing CreateTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 (DEFAULT_TABLE table=default.Table_7a0470e45012432ca480392d9aafa244 [id=93956c0b5ffb404e8b44ef9a0a324c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.743558 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5690198617de4f568132e24708d77418 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.743852 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:47.744279 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7c27827418e046c5b6adefb0a1da904f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.744465 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (DEFAULT_TABLE table=default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.744544 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3557e3ab9241eb8f76488b6a5390a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:47.744721 781 raft_consensus.cc:3060] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:47.744833 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c27827418e046c5b6adefb0a1da904f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.744858 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.745244 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d3a35d4033e24b95962a2acf9d19c13f (DEFAULT_TABLE table=default.Table_d1a33e487b8f41e289685a17a649fbb8 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.745608 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a35d4033e24b95962a2acf9d19c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.746007 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3b227a9ce91a4483ac9b59c1efe6f11b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.746461 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.747746 781 raft_consensus.cc:2468] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:47.748383 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d10da72f53fd44a8a70ef6aad3bffc09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.748855 1174 tablet_replica.cc:333] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:52:47.748883 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d10da72f53fd44a8a70ef6aad3bffc09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.749029 1174 raft_consensus.cc:2243] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.749210 1174 raft_consensus.cc:2272] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.749956 1171 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.749959 1174 ts_tablet_manager.cc:1916] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.750109 1171 ts_tablet_manager.cc:1403] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.015s
I20260503 07:52:47.750227 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a35d4033e24b95962a2acf9d19c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.750378 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5690198617de4f568132e24708d77418 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.750713 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5690198617de4f568132e24708d77418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.751011 1171 raft_consensus.cc:359] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.751190 1171 raft_consensus.cc:385] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.751283 1171 raft_consensus.cc:740] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.751514 1171 consensus_queue.cc:260] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.750118 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 (DEFAULT_TABLE table=default.Table_7a0470e45012432ca480392d9aafa244 [id=93956c0b5ffb404e8b44ef9a0a324c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.756651 1173 ts_tablet_manager.cc:1916] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.756728 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943498e981f341d0aa279f8a37c5d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.756804 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37459b741904a8696064201992d4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.758386 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a35d4033e24b95962a2acf9d19c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.760393 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eca7f88573745c5ae68fdb32cda2feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.762384 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_eb80b26e4e04423f8945101fe5f5f3c4 [id=2403919936864afb980b1c2528f2877d]). Expected version 3 got 0
I20260503 07:52:47.764305 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37459b741904a8696064201992d4591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.764453 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 34b18184e1a3492888e173481fca5411
I20260503 07:52:47.756145 1174 ts_tablet_manager.cc:1929] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.765121 1174 log.cc:1199] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:47.765775 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.766070 1174 ts_tablet_manager.cc:1950] T 44cde484c8a045aeac133bac6f1b90d2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:47.766147 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:47.766788 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 34b18184e1a3492888e173481fca5411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b18184e1a3492888e173481fca5411 already in progress: creating tablet
I20260503 07:52:47.767355 1165 raft_consensus.cc:359] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.767586 1165 raft_consensus.cc:385] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.767702 1165 raft_consensus.cc:740] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.768013 1165 consensus_queue.cc:260] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.768380 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7807da20d4c4b90a9e387cb72813557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.768572 1165 ts_tablet_manager.cc:1434] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.048s user 0.000s sys 0.002s
I20260503 07:52:47.768936 1165 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:47.770742 1165 tablet_bootstrap.cc:654] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.773070 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.773319 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5690198617de4f568132e24708d77418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.778276 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943498e981f341d0aa279f8a37c5d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.778672 1166 tablet_bootstrap.cc:492] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.778841 1166 ts_tablet_manager.cc:1403] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20260503 07:52:47.785334 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cbed35e0626b45f3a6fc814f1d50250c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.785954 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbed35e0626b45f3a6fc814f1d50250c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.787252 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb80b26e4e04423f8945101fe5f5f3c4" } modify_external_catalogs: true
I20260503 07:52:47.787429 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb80b26e4e04423f8945101fe5f5f3c4" } modify_external_catalogs: true
I20260503 07:52:47.787955 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9cc79885fac84a68b5c4c0472d6b7d64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.788439 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cc79885fac84a68b5c4c0472d6b7d64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.788794 1173 ts_tablet_manager.cc:1929] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.788964 1173 log.cc:1199] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/457e4ddbab8b4241ab8ea947442f7171
I20260503 07:52:47.789294 1173 ts_tablet_manager.cc:1950] T 457e4ddbab8b4241ab8ea947442f7171 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:47.790266 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 457e4ddbab8b4241ab8ea947442f7171 (table default.Table_095b67a40f494bf5816c169f6c2931c1 [id=306e9134c9254af9a811f8113cefb8b7]) successfully deleted
I20260503 07:52:47.793710 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e2f05a247b054a01ac35ef7fad79ccb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.794188 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2f05a247b054a01ac35ef7fad79ccb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.797508 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d1a33e487b8f41e289685a17a649fbb8" } new_table_name: "default.Table_0dbfb8d8cca647a59092127133865999" modify_external_catalogs: true
I20260503 07:52:47.800477 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1bcc06588d644890939cad19e7fc29e1" } new_table_name: "default.Table_f389f4d06f6d413c997b931a58167f84" modify_external_catalogs: true
I20260503 07:52:47.801788 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6c53939001264a67847b3e2f051ef279" } new_table_name: "default.Table_15bde81ecc7240a6a53f23d1b6e71dd0" modify_external_catalogs: true
I20260503 07:52:47.803036 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7a0470e45012432ca480392d9aafa244" } new_table_name: "default.Table_b08a70d722804edf8e4d44f5e8f00efd" modify_external_catalogs: true
I20260503 07:52:47.807962 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:47.808300 1166 raft_consensus.cc:359] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.808503 1166 raft_consensus.cc:385] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.808593 1166 raft_consensus.cc:740] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.808722 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6a5bd7a5b6674de6814dbeed0bc7c8b0" } new_table_name: "default.Table_0f1b5e9a0c4846f880cb398a6ada413c" modify_external_catalogs: true
I20260503 07:52:47.808830 1166 consensus_queue.cc:260] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.809363 1166 ts_tablet_manager.cc:1434] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260503 07:52:47.809671 1166 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.811511 1166 tablet_bootstrap.cc:654] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.819861 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 (DEFAULT_TABLE table=default.Table_c60afbb5b3b24b6aa5af112059e3ef55 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.820492 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4328cceebfa466fb6f56d0ffbc09bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.824838 1029 tablet_service.cc:1511] Processing CreateTablet for tablet dd76629713d747b490c83581cc03596c (DEFAULT_TABLE table=default.Table_c5018bd960184e978049b6a6fb07ea20 [id=e9446550434243a09cb7a71f278edef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.825309 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd76629713d747b490c83581cc03596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.826170 894 tablet_service.cc:1511] Processing CreateTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (DEFAULT_TABLE table=default.Table_1bcc06588d644890939cad19e7fc29e1 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.826654 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbf3231ab114ce59de775f3dcc1e8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.827867 1166 tablet_bootstrap.cc:492] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.828056 1166 ts_tablet_manager.cc:1403] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20260503 07:52:47.828933 1166 raft_consensus.cc:359] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.829142 1166 raft_consensus.cc:385] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.829229 1166 raft_consensus.cc:740] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:52:47.829339 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 34b18184e1a3492888e173481fca5411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b18184e1a3492888e173481fca5411 already in progress: creating tablet
I20260503 07:52:47.829509 1166 consensus_queue.cc:260] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:47.830127 893 tablet_service.cc:1511] Processing CreateTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 (DEFAULT_TABLE table=default.Table_c60afbb5b3b24b6aa5af112059e3ef55 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.830119 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (DEFAULT_TABLE table=default.Table_1bcc06588d644890939cad19e7fc29e1 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.830473 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4328cceebfa466fb6f56d0ffbc09bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.830534 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbf3231ab114ce59de775f3dcc1e8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.832836 1166 ts_tablet_manager.cc:1434] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:47.835467 1166 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.835543 1178 raft_consensus.cc:697] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:47.835561 898 tablet_service.cc:1511] Processing CreateTablet for tablet dd76629713d747b490c83581cc03596c (DEFAULT_TABLE table=default.Table_c5018bd960184e978049b6a6fb07ea20 [id=e9446550434243a09cb7a71f278edef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.835937 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd76629713d747b490c83581cc03596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.836084 1178 consensus_queue.cc:237] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.836769 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_751c5cfb0064496c88d7ea0dcdbb9425"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:47.837302 1166 tablet_bootstrap.cc:654] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:47.837518 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_751c5cfb0064496c88d7ea0dcdbb9425 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.840498 1211 raft_consensus.cc:493] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:47.843232 1211 raft_consensus.cc:515] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.844949 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cde484c8a045aeac133bac6f1b90d2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:47.845649 1166 tablet_bootstrap.cc:492] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.845791 1166 ts_tablet_manager.cc:1403] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
W20260503 07:52:47.845816 988 leader_election.cc:343] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:47.846581 1166 raft_consensus.cc:359] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.846745 1166 raft_consensus.cc:385] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.846830 1166 raft_consensus.cc:740] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.847206 1211 leader_election.cc:290] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:47.848722 1166 consensus_queue.cc:260] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.867645 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 44cde484c8a045aeac133bac6f1b90d2 (table default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]) successfully deleted
I20260503 07:52:47.871415 760 tablet_service.cc:1511] Processing CreateTablet for tablet dd76629713d747b490c83581cc03596c (DEFAULT_TABLE table=default.Table_c5018bd960184e978049b6a6fb07ea20 [id=e9446550434243a09cb7a71f278edef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.872368 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd76629713d747b490c83581cc03596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.879809 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.882717 1166 ts_tablet_manager.cc:1434] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.032s user 0.001s sys 0.002s
I20260503 07:52:47.883348 1173 tablet_replica.cc:333] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.883520 1173 raft_consensus.cc:2243] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.883930 1173 raft_consensus.cc:2272] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:47.884555 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:47.885063 1171 ts_tablet_manager.cc:1434] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.135s user 0.029s sys 0.067s
I20260503 07:52:47.885484 1171 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.885622 1166 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.888016 1171 tablet_bootstrap.cc:654] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.888311 1173 ts_tablet_manager.cc:1916] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:47.893720 757 tablet_service.cc:1511] Processing CreateTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 (DEFAULT_TABLE table=default.Table_c60afbb5b3b24b6aa5af112059e3ef55 [id=3014867ee71a408f88061699f827b504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.894131 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4328cceebfa466fb6f56d0ffbc09bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.898644 761 tablet_service.cc:1511] Processing CreateTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (DEFAULT_TABLE table=default.Table_1bcc06588d644890939cad19e7fc29e1 [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:47.899308 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbf3231ab114ce59de775f3dcc1e8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:47.899462 1171 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.899734 1171 ts_tablet_manager.cc:1403] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.005s
I20260503 07:52:47.901209 1171 raft_consensus.cc:359] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.901473 1171 raft_consensus.cc:385] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.901583 1171 raft_consensus.cc:740] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.901921 1171 consensus_queue.cc:260] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.902427 1171 ts_tablet_manager.cc:1434] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:47.902812 1171 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.904944 1171 tablet_bootstrap.cc:654] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.912936 1169 raft_consensus.cc:493] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:47.925974 1166 tablet_bootstrap.cc:654] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.913157 1169 raft_consensus.cc:515] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.929188 1171 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.929352 1171 ts_tablet_manager.cc:1403] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.005s
I20260503 07:52:47.929456 1169 leader_election.cc:290] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:47.930022 1171 raft_consensus.cc:359] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.930213 1171 raft_consensus.cc:385] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.930292 1171 raft_consensus.cc:740] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.930526 1171 consensus_queue.cc:260] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.931862 1171 ts_tablet_manager.cc:1434] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:47.932137 1171 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.933795 1171 tablet_bootstrap.cc:654] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.937147 1166 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:47.937296 1166 ts_tablet_manager.cc:1403] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
I20260503 07:52:47.938030 1166 raft_consensus.cc:359] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.938207 1166 raft_consensus.cc:385] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.938304 1166 raft_consensus.cc:740] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.938659 1166 consensus_queue.cc:260] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.939172 1166 ts_tablet_manager.cc:1434] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:47.939496 1166 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:47.941481 1166 tablet_bootstrap.cc:654] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.949502 1173 ts_tablet_manager.cc:1929] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:47.949713 1173 log.cc:1199] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:47.950169 1173 ts_tablet_manager.cc:1950] T c17bc19639ba40dfb98298264ccfb217 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:47.952668 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c17bc19639ba40dfb98298264ccfb217 (table default.Table_713a5e9e9f634aa18604c62214fcaa37 [id=72b9cfbbecca47e88afe249a1cf8d17c]) successfully deleted
I20260503 07:52:47.958235 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:47.958465 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
W20260503 07:52:47.964432 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 943498e981f341d0aa279f8a37c5d5b0 consensus state has no leader
I20260503 07:52:47.964787 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c36955b6400a4df98f08dcbaeb082c5c" } modify_external_catalogs: true
I20260503 07:52:47.964986 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c36955b6400a4df98f08dcbaeb082c5c" } modify_external_catalogs: true
W20260503 07:52:47.966678 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6eca7f88573745c5ae68fdb32cda2feb consensus state has no leader
I20260503 07:52:47.966933 595 master_service.cc:954] ReplaceTablet: received request to replace tablet bb3557e3ab9241eb8f76488b6a5390a5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.967262 1171 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:47.967449 1171 ts_tablet_manager.cc:1403] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.018s
W20260503 07:52:47.967739 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3a35d4033e24b95962a2acf9d19c13f consensus state has no leader
I20260503 07:52:47.967948 594 master_service.cc:954] ReplaceTablet: received request to replace tablet bb3557e3ab9241eb8f76488b6a5390a5 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:47.968374 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcbf3231ab114ce59de775f3dcc1e8f2 consensus state has no leader
I20260503 07:52:47.968336 1171 raft_consensus.cc:359] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.968581 1171 raft_consensus.cc:385] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:47.968653 1171 raft_consensus.cc:740] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:47.968678 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9aac441308aa450a8796690b388843e7" } modify_external_catalogs: true
I20260503 07:52:47.968825 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9aac441308aa450a8796690b388843e7" } modify_external_catalogs: true
I20260503 07:52:47.968920 1171 consensus_queue.cc:260] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:47.969399 1171 ts_tablet_manager.cc:1434] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:47.969717 1171 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:47.970026 593 master_service.cc:954] ReplaceTablet: received request to replace tablet 34b18184e1a3492888e173481fca5411 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:47.970532 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1d92428398c64dc1b5b05f848747febc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:47.971091 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d92428398c64dc1b5b05f848747febc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:47.971454 1171 tablet_bootstrap.cc:654] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:47.973775 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cbed35e0626b45f3a6fc814f1d50250c" } modify_external_catalogs: true
I20260503 07:52:47.973948 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cbed35e0626b45f3a6fc814f1d50250c" } modify_external_catalogs: true
I20260503 07:52:47.981043 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c010814b6704a249dfb8b081131f240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.981802 894 tablet_service.cc:1558] Processing DeleteTablet for tablet c17bc19639ba40dfb98298264ccfb217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:47.982928 1173 tablet_replica.cc:333] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:47.983420 1173 raft_consensus.cc:2243] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:47.984740 1173 raft_consensus.cc:2272] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:47.983944 851 leader_election.cc:343] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.986600 1173 ts_tablet_manager.cc:1916] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:47.988073 986 leader_election.cc:343] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:47.988252 986 leader_election.cc:304] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:47.988161 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 34b18184e1a3492888e173481fca5411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b18184e1a3492888e173481fca5411 already in progress: creating tablet
I20260503 07:52:47.988574 1212 raft_consensus.cc:2749] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:47.991348 854 leader_election.cc:343] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 3c010814b6704a249dfb8b081131f240
I20260503 07:52:47.991511 854 leader_election.cc:304] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:47.991899 854 raft_consensus.cc:2686] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:48.008356 1171 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.008543 1171 ts_tablet_manager.cc:1403] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.005s
I20260503 07:52:48.009606 1171 raft_consensus.cc:359] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:48.010434 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7807da20d4c4b90a9e387cb72813557 consensus state has no leader
I20260503 07:52:48.022697 1171 raft_consensus.cc:385] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.022884 1171 raft_consensus.cc:740] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.023207 1171 consensus_queue.cc:260] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.025416 1171 ts_tablet_manager.cc:1434] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.017s user 0.000s sys 0.003s
I20260503 07:52:48.025748 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a9d0125d2adf4e269e7cec0b2a34f14b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.026868 1171 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.029259 1171 tablet_bootstrap.cc:654] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.034897 1171 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.035048 1171 ts_tablet_manager.cc:1403] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260503 07:52:48.035744 1171 raft_consensus.cc:359] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.035939 1171 raft_consensus.cc:385] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.036008 1171 raft_consensus.cc:740] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.036242 1171 consensus_queue.cc:260] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.036705 1171 ts_tablet_manager.cc:1434] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:48.037024 1171 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.037954 1166 tablet_bootstrap.cc:492] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.038113 1166 ts_tablet_manager.cc:1403] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.019s
I20260503 07:52:48.038754 1171 tablet_bootstrap.cc:654] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.038951 1166 raft_consensus.cc:359] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.039146 1166 raft_consensus.cc:385] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.039243 1166 raft_consensus.cc:740] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.039444 1166 consensus_queue.cc:260] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.039933 1166 ts_tablet_manager.cc:1434] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.040222 1166 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.041833 1166 tablet_bootstrap.cc:654] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.043833 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bb3557e3ab9241eb8f76488b6a5390a5
I20260503 07:52:48.044915 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 934a0b41c303482daba10a7acd91fb9d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.045511 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 44cde484c8a045aeac133bac6f1b90d2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.046084 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_576079e212ed4fb3a5c4a0ddd4aee2be" } modify_external_catalogs: true
I20260503 07:52:48.046284 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_576079e212ed4fb3a5c4a0ddd4aee2be" } modify_external_catalogs: true
I20260503 07:52:48.047477 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.047787 1175 tablet_replica.cc:333] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:48.048360 1170 raft_consensus.cc:493] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.048629 1170 raft_consensus.cc:515] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.049424 1170 leader_election.cc:290] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.051055 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f9fbe38c9459b8e07b6124443f546" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.051344 1053 raft_consensus.cc:2468] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:48.052206 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f9fbe38c9459b8e07b6124443f546" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.052896 716 leader_election.cc:304] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:52:48.053488 586 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_0f1b5e9a0c4846f880cb398a6ada413c [id=acb7469dcfea490bbb8e7a596577fd39], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7807da20d4c4b90a9e387cb72813557 consensus state has no leader
W20260503 07:52:48.054054 715 leader_election.cc:343] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.055688 1170 raft_consensus.cc:2804] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.055812 1170 raft_consensus.cc:493] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.055939 1170 raft_consensus.cc:3060] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.060298 1170 raft_consensus.cc:515] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.061650 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f9fbe38c9459b8e07b6124443f546" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:48.062495 715 leader_election.cc:343] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.063457 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f9fbe38c9459b8e07b6124443f546" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.063735 1053 raft_consensus.cc:3060] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.067853 1053 raft_consensus.cc:2468] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:48.068509 716 leader_election.cc:304] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:48.071655 1170 leader_election.cc:290] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.072109 1170 raft_consensus.cc:2804] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.072860 1170 raft_consensus.cc:697] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:48.073477 1170 consensus_queue.cc:237] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.079391 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.079748 1174 tablet_replica.cc:333] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:48.079995 1174 raft_consensus.cc:2243] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.080197 1174 raft_consensus.cc:2272] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.080986 1174 ts_tablet_manager.cc:1916] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.091197 898 tablet_service.cc:1558] Processing DeleteTablet for tablet bb3557e3ab9241eb8f76488b6a5390a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.097743 1169 raft_consensus.cc:493] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.097965 1169 raft_consensus.cc:515] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.098752 1169 leader_election.cc:290] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.099933 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0842dda8fb47ee828189e25a0a2ead" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.100282 1053 raft_consensus.cc:2468] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 0.
I20260503 07:52:48.100926 854 leader_election.cc:304] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:48.101531 1169 raft_consensus.cc:2804] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.101667 1169 raft_consensus.cc:493] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.101787 1169 raft_consensus.cc:3060] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.105947 1169 raft_consensus.cc:515] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.107542 1169 leader_election.cc:290] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.108013 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0842dda8fb47ee828189e25a0a2ead" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.108342 1053 raft_consensus.cc:3060] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.112919 1053 raft_consensus.cc:2468] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 1.
I20260503 07:52:48.113732 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0842dda8fb47ee828189e25a0a2ead" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.114881 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0842dda8fb47ee828189e25a0a2ead" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
W20260503 07:52:48.115533 851 leader_election.cc:343] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:48.116046 851 leader_election.cc:343] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.125305 1174 ts_tablet_manager.cc:1929] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.131755 1174 log.cc:1199] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bb3557e3ab9241eb8f76488b6a5390a5
I20260503 07:52:48.133965 1174 ts_tablet_manager.cc:1950] T bb3557e3ab9241eb8f76488b6a5390a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:48.124743 1175 raft_consensus.cc:2243] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:48.136070 854 leader_election.cc:304] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.136755 1169 raft_consensus.cc:2804] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.163520 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_eb80b26e4e04423f8945101fe5f5f3c4 [id=2403919936864afb980b1c2528f2877d]) successfully deleted
I20260503 07:52:48.172715 1169 raft_consensus.cc:697] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Running, Role: LEADER
I20260503 07:52:48.177690 1169 consensus_queue.cc:237] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.192700 1175 pending_rounds.cc:70] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:48.193013 1175 pending_rounds.cc:77] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847369112121344 op_type: NO_OP noop_request { }
I20260503 07:52:48.193233 1175 raft_consensus.cc:2889] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:48.193408 1175 raft_consensus.cc:2272] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.195875 1175 ts_tablet_manager.cc:1916] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.204910 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f68056b470874a4f85a0acc623447fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.205741 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f68056b470874a4f85a0acc623447fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.216670 597 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 2abb225926f1475784d7d171dabc4799
I20260503 07:52:48.222179 1173 ts_tablet_manager.cc:1929] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.224238 1175 ts_tablet_manager.cc:1929] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:48.225253 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6f2f843012924df9806f9ee50e38a5ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.225936 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f2f843012924df9806f9ee50e38a5ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.228300 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--webserver_interface=127.0.105.61
--webserver_port=38399
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260503 07:52:48.232141 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 163670us
I20260503 07:52:48.250305 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:48.251227 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_33adfc18860c4e18a16e663d515ab28e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.251788 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33adfc18860c4e18a16e663d515ab28e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.253306 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_107377a24ea941e89c173ed4b30a4e00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.253829 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_107377a24ea941e89c173ed4b30a4e00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.230465 1171 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.263525 1171 ts_tablet_manager.cc:1403] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.227s user 0.038s sys 0.099s
I20260503 07:52:48.263494 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 9030916bd2e04c08b07f568123eead02 (DEFAULT_TABLE table=default.Table_d10da72f53fd44a8a70ef6aad3bffc09 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.263962 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9030916bd2e04c08b07f568123eead02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.264483 1171 raft_consensus.cc:359] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.264855 1171 raft_consensus.cc:385] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.264966 1171 raft_consensus.cc:740] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.265228 1171 consensus_queue.cc:260] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.265882 1171 ts_tablet_manager.cc:1434] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:48.266279 1171 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.256865 1178 raft_consensus.cc:493] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.268136 1178 raft_consensus.cc:515] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.268704 1173 log.cc:1199] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/3c010814b6704a249dfb8b081131f240
I20260503 07:52:48.269093 1178 leader_election.cc:290] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.269192 1173 ts_tablet_manager.cc:1950] T 3c010814b6704a249dfb8b081131f240 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:48.259979 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 51494da361814bf1917182ed2952e28d (DEFAULT_TABLE table=default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.260252 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 91d799ca2780461b89ced316e9f3ac92 (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.260424 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9c01aea82d584140bbabba1f5be65539 (DEFAULT_TABLE table=default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.260788 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.269838 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51494da361814bf1917182ed2952e28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.270785 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.271286 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.272076 1173 tablet_replica.cc:333] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:48.272333 1173 raft_consensus.cc:2243] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.272552 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d799ca2780461b89ced316e9f3ac92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.272559 1173 raft_consensus.cc:2272] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.273329 1173 ts_tablet_manager.cc:1916] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.274274 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_533217f337a4423fa89dc05d0ddf405e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.274772 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_533217f337a4423fa89dc05d0ddf405e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.275882 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_414cb9527c374653ab8763194d3af29c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.276335 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_414cb9527c374653ab8763194d3af29c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.276381 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c01aea82d584140bbabba1f5be65539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.279175 1173 ts_tablet_manager.cc:1929] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.279295 1173 log.cc:1199] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/a9d0125d2adf4e269e7cec0b2a34f14b
I20260503 07:52:48.279713 1173 ts_tablet_manager.cc:1950] T a9d0125d2adf4e269e7cec0b2a34f14b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:48.280707 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609d01e6cdc440085a6ebdb652d54f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.280261 597 catalog_manager.cc:5671] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:48.281353 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:48.282040 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9030916bd2e04c08b07f568123eead02 (DEFAULT_TABLE table=default.Table_d10da72f53fd44a8a70ef6aad3bffc09 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.282449 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9030916bd2e04c08b07f568123eead02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.283737 1171 tablet_bootstrap.cc:654] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.284442 893 tablet_service.cc:1511] Processing CreateTablet for tablet 91d799ca2780461b89ced316e9f3ac92 (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.284806 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d799ca2780461b89ced316e9f3ac92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.280139 1173 tablet_replica.cc:333] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:48.286510 1173 raft_consensus.cc:2243] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.286723 1173 raft_consensus.cc:2272] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.287774 1173 ts_tablet_manager.cc:1916] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.288625 896 tablet_service.cc:1511] Processing CreateTablet for tablet 9c01aea82d584140bbabba1f5be65539 (DEFAULT_TABLE table=default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.288975 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c01aea82d584140bbabba1f5be65539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.293648 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 3c010814b6704a249dfb8b081131f240 (table default.Table_7c6f8d585e5545b2aca05812e1fffebe [id=cf7e85f403f044c88e5482ede91a1c50]) successfully deleted
W20260503 07:52:48.293888 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c17bc19639ba40dfb98298264ccfb217 because the tablet was not found. No further retry: Not found: Tablet not found: c17bc19639ba40dfb98298264ccfb217
I20260503 07:52:48.294130 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet a9d0125d2adf4e269e7cec0b2a34f14b (table default.Table_a6f61ab7e3764c1993b226a9cdba35f7 [id=7b3e7d74d8344aceb67cf37994a058f6]) successfully deleted
I20260503 07:52:48.294436 1173 ts_tablet_manager.cc:1929] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.294535 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2919cf168bac48e5abbd261590487e8f
I20260503 07:52:48.294734 1173 log.cc:1199] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/bb3557e3ab9241eb8f76488b6a5390a5
I20260503 07:52:48.295126 1173 ts_tablet_manager.cc:1950] T bb3557e3ab9241eb8f76488b6a5390a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:48.295614 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.296773 1166 tablet_bootstrap.cc:492] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.296943 1166 ts_tablet_manager.cc:1403] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.257s user 0.095s sys 0.135s
I20260503 07:52:48.296958 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_eb80b26e4e04423f8945101fe5f5f3c4 [id=2403919936864afb980b1c2528f2877d]) successfully deleted
I20260503 07:52:48.297772 1166 raft_consensus.cc:359] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.297976 1166 raft_consensus.cc:385] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.298071 1166 raft_consensus.cc:740] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.298326 1166 consensus_queue.cc:260] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.298872 1166 ts_tablet_manager.cc:1434] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:48.299193 1166 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.303208 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 51494da361814bf1917182ed2952e28d
I20260503 07:52:48.304286 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abbb083010f476b8a0803fabc3279bb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.304382 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.304715 1166 tablet_bootstrap.cc:654] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.305822 756 tablet_service.cc:1511] Processing CreateTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:48.305886 986 leader_election.cc:343] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.306242 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609d01e6cdc440085a6ebdb652d54f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.306564 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9c01aea82d584140bbabba1f5be65539 (DEFAULT_TABLE table=default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.306983 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c01aea82d584140bbabba1f5be65539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.312335 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.313468 898 tablet_service.cc:1511] Processing CreateTablet for tablet 51494da361814bf1917182ed2952e28d (DEFAULT_TABLE table=default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.314150 1171 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.314320 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51494da361814bf1917182ed2952e28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.314311 1171 ts_tablet_manager.cc:1403] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.001s
I20260503 07:52:48.315128 1171 raft_consensus.cc:359] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.315356 1171 raft_consensus.cc:385] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.315421 1171 raft_consensus.cc:740] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.315653 1171 consensus_queue.cc:260] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.315850 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.316325 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c60afbb5b3b24b6aa5af112059e3ef55" } new_table_name: "default.Table_0b29866176404837a575745301005a1b" modify_external_catalogs: true
W20260503 07:52:48.317005 1165 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.545s user 0.120s sys 0.182s
W20260503 07:52:48.317101 1165 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.546s user 0.120s sys 0.182s
I20260503 07:52:48.268266 1175 log.cc:1199] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bb3557e3ab9241eb8f76488b6a5390a5
I20260503 07:52:48.317646 1175 ts_tablet_manager.cc:1950] T bb3557e3ab9241eb8f76488b6a5390a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:48.318336 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ba6d0cc847134b939a7a5d1c6183a485" } new_table_name: "default.Table_2028f587f7194f0586dc9d0cf590d351" modify_external_catalogs: true
I20260503 07:52:48.319404 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bb3557e3ab9241eb8f76488b6a5390a5 (table default.Table_eb80b26e4e04423f8945101fe5f5f3c4 [id=2403919936864afb980b1c2528f2877d]) successfully deleted
W20260503 07:52:48.319741 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2919cf168bac48e5abbd261590487e8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2919cf168bac48e5abbd261590487e8f already in progress: creating tablet
W20260503 07:52:48.320065 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 51494da361814bf1917182ed2952e28d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51494da361814bf1917182ed2952e28d already in progress: creating tablet
I20260503 07:52:48.320253 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2f05a247b054a01ac35ef7fad79ccb7" } new_table_name: "default.Table_25b08e2755f24392a139c1de3502e83c" modify_external_catalogs: true
I20260503 07:52:48.320957 1171 ts_tablet_manager.cc:1434] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:52:48.322130 757 tablet_service.cc:1511] Processing CreateTablet for tablet 91d799ca2780461b89ced316e9f3ac92 (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.322443 1171 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.322585 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d799ca2780461b89ced316e9f3ac92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.324688 760 tablet_service.cc:1511] Processing CreateTablet for tablet 9030916bd2e04c08b07f568123eead02 (DEFAULT_TABLE table=default.Table_d10da72f53fd44a8a70ef6aad3bffc09 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.324843 1171 tablet_bootstrap.cc:654] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.325083 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9030916bd2e04c08b07f568123eead02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.328328 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.328877 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abbb083010f476b8a0803fabc3279bb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:48.329330 988 leader_election.cc:343] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.329510 988 leader_election.cc:304] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.329967 1178 raft_consensus.cc:2749] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:48.334199 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 51494da361814bf1917182ed2952e28d because the tablet was not found. No further retry: Not found: Tablet not found: 51494da361814bf1917182ed2952e28d
W20260503 07:52:48.334441 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2919cf168bac48e5abbd261590487e8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2919cf168bac48e5abbd261590487e8f already in progress: creating tablet
I20260503 07:52:48.334453 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.334968 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609d01e6cdc440085a6ebdb652d54f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:48.335971 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2919cf168bac48e5abbd261590487e8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2919cf168bac48e5abbd261590487e8f already in progress: creating tablet
I20260503 07:52:48.344286 761 tablet_service.cc:1511] Processing CreateTablet for tablet 51494da361814bf1917182ed2952e28d (DEFAULT_TABLE table=default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.348515 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51494da361814bf1917182ed2952e28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.351938 1165 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.352070 1165 ts_tablet_manager.cc:1403] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.583s user 0.120s sys 0.182s
I20260503 07:52:48.353812 1165 raft_consensus.cc:359] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.353991 1165 raft_consensus.cc:385] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.354063 1165 raft_consensus.cc:740] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.354274 1165 consensus_queue.cc:260] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.354746 1165 ts_tablet_manager.cc:1434] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:52:48.355027 1165 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.356772 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.360158 1166 tablet_bootstrap.cc:492] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.360340 1166 ts_tablet_manager.cc:1403] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.061s user 0.012s sys 0.030s
I20260503 07:52:48.360213 1165 tablet_bootstrap.cc:654] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.361152 1166 raft_consensus.cc:359] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.361351 1166 raft_consensus.cc:385] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.361454 1166 raft_consensus.cc:740] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.361680 1166 consensus_queue.cc:260] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:48.361886 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 51494da361814bf1917182ed2952e28d because the tablet was not found. No further retry: Not found: Tablet not found: 51494da361814bf1917182ed2952e28d
I20260503 07:52:48.362735 1166 ts_tablet_manager.cc:1434] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:48.363040 1166 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.367893 1166 tablet_bootstrap.cc:654] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.369642 1171 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.369782 1171 ts_tablet_manager.cc:1403] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.047s user 0.013s sys 0.006s
I20260503 07:52:48.370498 1171 raft_consensus.cc:359] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.370678 1171 raft_consensus.cc:385] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.370772 1171 raft_consensus.cc:740] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.371975 1171 consensus_queue.cc:260] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.373695 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d10da72f53fd44a8a70ef6aad3bffc09" } new_table_name: "default.Table_624fc879976c487b82c0e5488a4aa546" modify_external_catalogs: true
I20260503 07:52:48.375118 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_abccc7de1bca4e2b9e7e1efa23904912"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:48.375239 1171 ts_tablet_manager.cc:1434] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260503 07:52:48.375597 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abccc7de1bca4e2b9e7e1efa23904912 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.376909 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_ba6d0cc847134b939a7a5d1c6183a485 [id=a73654d3dcae49909e766eb795334a56]). Expected version 1 got 0
I20260503 07:52:48.378437 1171 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.378502 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ee0842dda8fb47ee828189e25a0a2ead
I20260503 07:52:48.379215 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1d92428398c64dc1b5b05f848747febc" } new_table_name: "default.Table_4f1b1dcb8b514c4899ca1a60d51b3940" modify_external_catalogs: true
I20260503 07:52:48.379894 1165 tablet_bootstrap.cc:492] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.380059 1165 ts_tablet_manager.cc:1403] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260503 07:52:48.380604 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0842dda8fb47ee828189e25a0a2ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.380882 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d603048462fb48e1a3b3e598a27578c9" } modify_external_catalogs: true
I20260503 07:52:48.380894 1165 raft_consensus.cc:359] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.381027 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d603048462fb48e1a3b3e598a27578c9" } modify_external_catalogs: true
I20260503 07:52:48.381076 1165 raft_consensus.cc:385] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.381140 1165 raft_consensus.cc:740] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.382234 1175 tablet_replica.cc:333] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:48.382429 1175 raft_consensus.cc:2243] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.382606 1175 raft_consensus.cc:2272] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.382897 1171 tablet_bootstrap.cc:654] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.383478 1175 ts_tablet_manager.cc:1916] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.381430 1165 consensus_queue.cc:260] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.384219 1165 ts_tablet_manager.cc:1434] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260503 07:52:48.385478 1165 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.387130 1165 tablet_bootstrap.cc:654] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.387606 597 master_service.cc:954] ReplaceTablet: received request to replace tablet d3a35d4033e24b95962a2acf9d19c13f from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.388868 1166 tablet_bootstrap.cc:492] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.389081 1166 ts_tablet_manager.cc:1403] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.003s
I20260503 07:52:48.389792 1175 ts_tablet_manager.cc:1929] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.389849 1166 raft_consensus.cc:359] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.390048 1166 raft_consensus.cc:385] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.389988 1175 log.cc:1199] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ee0842dda8fb47ee828189e25a0a2ead
I20260503 07:52:48.390125 1166 raft_consensus.cc:740] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.390401 1166 consensus_queue.cc:260] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.390648 1175 ts_tablet_manager.cc:1950] T ee0842dda8fb47ee828189e25a0a2ead P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:48.391677 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ee0842dda8fb47ee828189e25a0a2ead (table default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]) successfully deleted
I20260503 07:52:48.393931 1166 ts_tablet_manager.cc:1434] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260503 07:52:48.394785 1166 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.396385 1166 tablet_bootstrap.cc:654] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.398303 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4328cceebfa466fb6f56d0ffbc09bd2 consensus state has no leader
I20260503 07:52:48.398490 1171 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.398742 1171 ts_tablet_manager.cc:1403] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.003s
I20260503 07:52:48.399744 1171 raft_consensus.cc:359] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.399966 1171 raft_consensus.cc:385] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.400045 1171 raft_consensus.cc:740] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.400323 1171 consensus_queue.cc:260] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.400552 592 master_service.cc:954] ReplaceTablet: received request to replace tablet d3a35d4033e24b95962a2acf9d19c13f from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.401332 898 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0842dda8fb47ee828189e25a0a2ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.401567 1173 tablet_replica.cc:333] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:48.401724 1173 raft_consensus.cc:2243] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:48.402145 1173 pending_rounds.cc:70] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Trying to abort 1 pending ops.
I20260503 07:52:48.402295 1173 pending_rounds.cc:77] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847370464907264 op_type: NO_OP noop_request { }
I20260503 07:52:48.402441 1173 raft_consensus.cc:2889] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:48.402534 1173 raft_consensus.cc:2272] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.403200 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c010814b6704a249dfb8b081131f240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.403359 1171 ts_tablet_manager.cc:1434] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:48.404783 1173 ts_tablet_manager.cc:1916] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.405146 1171 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.407210 1171 tablet_bootstrap.cc:654] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.413475 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a60a9ee2cc5a42efa1201e12622d4df1 has no consensus state
I20260503 07:52:48.413754 598 master_service.cc:954] ReplaceTablet: received request to replace tablet d3a35d4033e24b95962a2acf9d19c13f from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.414080 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.414341 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0842dda8fb47ee828189e25a0a2ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.422518 1174 tablet_replica.cc:333] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:48.422742 1174 raft_consensus.cc:2243] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.423871 1174 raft_consensus.cc:2272] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.423970 1173 ts_tablet_manager.cc:1929] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:48.424114 1173 log.cc:1199] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ee0842dda8fb47ee828189e25a0a2ead
I20260503 07:52:48.424901 1173 ts_tablet_manager.cc:1950] T ee0842dda8fb47ee828189e25a0a2ead P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:48.425292 1171 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.425485 1171 ts_tablet_manager.cc:1403] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260503 07:52:48.426364 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ee0842dda8fb47ee828189e25a0a2ead (table default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]) successfully deleted
I20260503 07:52:48.426543 1171 raft_consensus.cc:359] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.426808 1171 raft_consensus.cc:385] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.426941 1171 raft_consensus.cc:740] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.427246 1171 consensus_queue.cc:260] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:48.427423 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3c010814b6704a249dfb8b081131f240 because the tablet was not found. No further retry: Not found: Tablet not found: 3c010814b6704a249dfb8b081131f240
I20260503 07:52:48.427909 1171 ts_tablet_manager.cc:1434] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260503 07:52:48.428573 1171 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.429178 1165 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.429320 1165 ts_tablet_manager.cc:1403] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.008s
I20260503 07:52:48.430101 1165 raft_consensus.cc:359] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.430272 1165 raft_consensus.cc:385] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.430286 1171 tablet_bootstrap.cc:654] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.430366 1165 raft_consensus.cc:740] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.430554 1165 consensus_queue.cc:260] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.431032 1165 ts_tablet_manager.cc:1434] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.431288 1165 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.433305 1165 tablet_bootstrap.cc:654] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.435456 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9030916bd2e04c08b07f568123eead02 consensus state has no leader
I20260503 07:52:48.436636 1174 ts_tablet_manager.cc:1916] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.437182 1165 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.437394 1165 ts_tablet_manager.cc:1403] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260503 07:52:48.438567 1165 raft_consensus.cc:359] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.438850 1165 raft_consensus.cc:385] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.438952 1165 raft_consensus.cc:740] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.439266 1165 consensus_queue.cc:260] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.439908 1165 ts_tablet_manager.cc:1434] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.440428 1165 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.442691 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.443271 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.443491 1165 tablet_bootstrap.cc:654] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.445569 1174 ts_tablet_manager.cc:1929] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.445703 1174 log.cc:1199] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:48.446195 1232 raft_consensus.cc:493] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.446367 1232 raft_consensus.cc:515] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.447075 1232 leader_election.cc:290] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.447674 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06670a873e994cbea50627dc7eb02e0e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.447896 918 raft_consensus.cc:2468] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:48.448058 1171 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.448252 1171 ts_tablet_manager.cc:1403] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.006s
I20260503 07:52:48.448345 715 leader_election.cc:304] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.448964 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06670a873e994cbea50627dc7eb02e0e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.449157 1053 raft_consensus.cc:2468] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:48.449262 1171 raft_consensus.cc:359] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.449494 1171 raft_consensus.cc:385] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.449577 1171 raft_consensus.cc:740] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.449893 1171 consensus_queue.cc:260] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.450064 1232 raft_consensus.cc:2804] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.450165 1232 raft_consensus.cc:493] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.450248 1232 raft_consensus.cc:3060] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.453298 1232 raft_consensus.cc:515] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.454455 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06670a873e994cbea50627dc7eb02e0e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.454556 1171 ts_tablet_manager.cc:1434] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:52:48.454701 918 raft_consensus.cc:3060] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.458251 1174 ts_tablet_manager.cc:1950] T 1abbb083010f476b8a0803fabc3279bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:48.458652 1171 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.460727 1171 tablet_bootstrap.cc:654] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.461702 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1abbb083010f476b8a0803fabc3279bb (table default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]) successfully deleted
I20260503 07:52:48.462313 918 raft_consensus.cc:2468] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:48.463465 1053 raft_consensus.cc:1275] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:48.464327 1170 consensus_queue.cc:1048] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:48.465857 715 leader_election.cc:304] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.466538 1232 leader_election.cc:290] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.466711 1232 raft_consensus.cc:2804] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.466821 1232 raft_consensus.cc:697] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:48.467083 1232 consensus_queue.cc:237] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.469105 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06670a873e994cbea50627dc7eb02e0e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.469380 1052 raft_consensus.cc:3060] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.472838 918 raft_consensus.cc:3060] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.472903 1052 raft_consensus.cc:2468] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:48.474817 1171 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.474972 1171 ts_tablet_manager.cc:1403] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260503 07:52:48.475876 1171 raft_consensus.cc:359] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.476086 1171 raft_consensus.cc:385] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.476198 1171 raft_consensus.cc:740] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.476472 1171 consensus_queue.cc:260] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.478114 1171 ts_tablet_manager.cc:1434] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:48.478240 918 raft_consensus.cc:1275] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:48.479293 1171 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.482611 1170 consensus_queue.cc:1048] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:48.484651 1171 tablet_bootstrap.cc:654] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.487550 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2b1956063b4f5e8bbef9f3d0eba359 has no consensus state
I20260503 07:52:48.487939 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_14d409cb4fa7480dbea66c0e11dc6b7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.488528 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14d409cb4fa7480dbea66c0e11dc6b7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.489972 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1
I20260503 07:52:48.490586 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_22aaab5413f84321b9598fd533c78dcd" } modify_external_catalogs: true
I20260503 07:52:48.490942 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_22aaab5413f84321b9598fd533c78dcd" } modify_external_catalogs: true
I20260503 07:52:48.492628 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.493280 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:48.493566 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 already in progress: creating tablet
I20260503 07:52:48.494776 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:48.495325 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 already in progress: creating tablet
I20260503 07:52:48.496908 1174 tablet_replica.cc:333] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:48.499243 1174 raft_consensus.cc:2243] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.499431 1174 raft_consensus.cc:2272] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.500020 1258 tablet.cc:1724] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:48.502126 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d3a35d4033e24b95962a2acf9d19c13f
I20260503 07:52:48.502653 597 catalog_manager.cc:6741] ReplaceTablet: tablet d3a35d4033e24b95962a2acf9d19c13f deleted and replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9
I20260503 07:52:48.503054 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7c25f714b33f49e5b83947889c0e3635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:48.503155 1174 ts_tablet_manager.cc:1916] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:48.503643 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c25f714b33f49e5b83947889c0e3635 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.504519 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 1609d01e6cdc440085a6ebdb652d54f1 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.505127 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1fa1310e53144f7a9abf9399919088b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.505664 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fa1310e53144f7a9abf9399919088b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.508500 1257 tablet.cc:1724] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:48.511516 1247 mvcc.cc:204] Tried to move back new op lower bound from 7281847371616034816 to 7281847370047926272. Current Snapshot: MvccSnapshot[applied={T|T < 7281847371616034816}]
I20260503 07:52:48.514460 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a35d4033e24b95962a2acf9d19c13f with delete_type TABLET_DATA_DELETED (replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.516192 1174 ts_tablet_manager.cc:1929] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.516358 1174 log.cc:1199] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ee0842dda8fb47ee828189e25a0a2ead
I20260503 07:52:48.516793 1174 ts_tablet_manager.cc:1950] T ee0842dda8fb47ee828189e25a0a2ead P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:48.516904 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a35d4033e24b95962a2acf9d19c13f with delete_type TABLET_DATA_DELETED (replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.517174 1175 tablet_replica.cc:333] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:48.517361 1175 raft_consensus.cc:2243] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.517597 1175 raft_consensus.cc:2272] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.518246 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 9c01aea82d584140bbabba1f5be65539 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:48.518357 1175 ts_tablet_manager.cc:1916] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.518914 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a35d4033e24b95962a2acf9d19c13f with delete_type TABLET_DATA_DELETED (replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.524609 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ee0842dda8fb47ee828189e25a0a2ead (table default.Table_576079e212ed4fb3a5c4a0ddd4aee2be [id=e74e3a4b8c484c2ba2201f4522e89920]) successfully deleted
W20260503 07:52:48.527069 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 already in progress: creating tablet
W20260503 07:52:48.527357 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d3a35d4033e24b95962a2acf9d19c13f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3a35d4033e24b95962a2acf9d19c13f already in progress: creating tablet
I20260503 07:52:48.527566 1175 ts_tablet_manager.cc:1929] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.527791 1175 log.cc:1199] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d3a35d4033e24b95962a2acf9d19c13f
W20260503 07:52:48.527940 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d3a35d4033e24b95962a2acf9d19c13f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3a35d4033e24b95962a2acf9d19c13f already in progress: creating tablet
I20260503 07:52:48.528357 1175 ts_tablet_manager.cc:1950] T d3a35d4033e24b95962a2acf9d19c13f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:48.529628 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d3a35d4033e24b95962a2acf9d19c13f (table default.Table_0dbfb8d8cca647a59092127133865999 [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
I20260503 07:52:48.531368 1165 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.531529 1165 ts_tablet_manager.cc:1403] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.091s user 0.011s sys 0.015s
I20260503 07:52:48.532557 1165 raft_consensus.cc:359] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.532791 1165 raft_consensus.cc:385] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.532930 1165 raft_consensus.cc:740] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.533241 1165 consensus_queue.cc:260] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.536310 1165 ts_tablet_manager.cc:1434] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:52:48.539125 1165 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.541467 1165 tablet_bootstrap.cc:654] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.543022 1166 tablet_bootstrap.cc:492] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.543186 1166 ts_tablet_manager.cc:1403] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.148s user 0.011s sys 0.047s
I20260503 07:52:48.543610 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9cc79885fac84a68b5c4c0472d6b7d64" } modify_external_catalogs: true
I20260503 07:52:48.543875 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9cc79885fac84a68b5c4c0472d6b7d64" } modify_external_catalogs: true
I20260503 07:52:48.544147 1166 raft_consensus.cc:359] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.544466 1166 raft_consensus.cc:385] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.544579 1166 raft_consensus.cc:740] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.544818 1166 consensus_queue.cc:260] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.545889 1166 ts_tablet_manager.cc:1434] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260503 07:52:48.546247 1166 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.549268 1166 tablet_bootstrap.cc:654] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.553143 1165 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.553334 1165 ts_tablet_manager.cc:1403] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260503 07:52:48.554210 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9316d28baa15464dab512f62ff026c9b" } modify_external_catalogs: true
I20260503 07:52:48.554251 1165 raft_consensus.cc:359] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.554400 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9316d28baa15464dab512f62ff026c9b" } modify_external_catalogs: true
I20260503 07:52:48.554490 1165 raft_consensus.cc:385] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.554579 1165 raft_consensus.cc:740] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.554870 1165 consensus_queue.cc:260] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.555378 1165 ts_tablet_manager.cc:1434] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.555755 1165 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.557106 1255 mvcc.cc:204] Tried to move back new op lower bound from 7281847371616034816 to 7281847370047926272. Current Snapshot: MvccSnapshot[applied={T|T < 7281847371616034816}]
I20260503 07:52:48.557153 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_19875ebf44a24b49991351b7681d86c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:48.557363 1165 tablet_bootstrap.cc:654] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.557778 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19875ebf44a24b49991351b7681d86c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.561609 1166 tablet_bootstrap.cc:492] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.561780 1166 ts_tablet_manager.cc:1403] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260503 07:52:48.562651 1166 raft_consensus.cc:359] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.562883 1166 raft_consensus.cc:385] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.562973 1166 raft_consensus.cc:740] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.562991 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]). Expected version 2 got 0
I20260503 07:52:48.563206 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_ba6d0cc847134b939a7a5d1c6183a485 [id=a73654d3dcae49909e766eb795334a56]). Expected version 1 got 0
I20260503 07:52:48.563290 1166 consensus_queue.cc:260] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.563992 1166 ts_tablet_manager.cc:1434] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:48.564332 1171 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.564393 1166 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.564512 1171 ts_tablet_manager.cc:1403] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.085s user 0.016s sys 0.011s
I20260503 07:52:48.564934 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6568bda8fa9642f48f897e9baf755493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.565435 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6568bda8fa9642f48f897e9baf755493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.565372 1171 raft_consensus.cc:359] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.565567 1171 raft_consensus.cc:385] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.565661 1171 raft_consensus.cc:740] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.565866 1171 consensus_queue.cc:260] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.567358 1171 ts_tablet_manager.cc:1434] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:48.567724 1171 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.569211 1165 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.569337 1165 ts_tablet_manager.cc:1403] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260503 07:52:48.569345 1171 tablet_bootstrap.cc:654] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.569355 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06670a873e994cbea50627dc7eb02e0e consensus state has no leader
I20260503 07:52:48.570030 1165 raft_consensus.cc:359] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.570060 1029 tablet_service.cc:1511] Processing CreateTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (DEFAULT_TABLE table=default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.570186 1165 raft_consensus.cc:385] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.570266 1165 raft_consensus.cc:740] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.570479 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.570434 1165 consensus_queue.cc:260] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.570830 1165 ts_tablet_manager.cc:1434] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:52:48.571106 1165 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.574038 898 tablet_service.cc:1511] Processing CreateTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (DEFAULT_TABLE table=default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.574476 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.574980 1165 tablet_bootstrap.cc:654] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.576256 1178 raft_consensus.cc:493] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.576439 1178 raft_consensus.cc:515] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.577087 1178 leader_election.cc:290] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.578466 1166 tablet_bootstrap.cc:654] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.580961 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.581228 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.581462 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.581674 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.581892 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.582095 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0842dda8fb47ee828189e25a0a2ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.584468 894 tablet_service.cc:1511] Processing CreateTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 (DEFAULT_TABLE table=default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.584929 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60a9ee2cc5a42efa1201e12622d4df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.588197 1165 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.588433 1165 ts_tablet_manager.cc:1403] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.002s
I20260503 07:52:48.588466 761 tablet_service.cc:1511] Processing CreateTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (DEFAULT_TABLE table=default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.588889 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.589490 1165 raft_consensus.cc:359] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.589764 1165 raft_consensus.cc:385] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.589874 1165 raft_consensus.cc:740] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.590161 1165 consensus_queue.cc:260] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.590739 1165 ts_tablet_manager.cc:1434] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.591089 1165 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.592374 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.592641 1174 tablet_replica.cc:333] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:48.592689 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.592803 1174 raft_consensus.cc:2243] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.592995 1174 raft_consensus.cc:2272] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.593068 1165 tablet_bootstrap.cc:654] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.593784 1174 ts_tablet_manager.cc:1916] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.599856 1174 ts_tablet_manager.cc:1929] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.599995 1174 log.cc:1199] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:48.600761 1174 ts_tablet_manager.cc:1950] T d37da070cc41438b84dc09ea74e38fe9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:48.602233 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 (DEFAULT_TABLE table=default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.602808 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60a9ee2cc5a42efa1201e12622d4df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.604648 1165 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.604825 1165 ts_tablet_manager.cc:1403] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260503 07:52:48.605031 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.605289 1178 raft_consensus.cc:493] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.605437 1178 raft_consensus.cc:515] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.605546 1165 raft_consensus.cc:359] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.605706 1165 raft_consensus.cc:385] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.605794 1165 raft_consensus.cc:740] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.605988 1165 consensus_queue.cc:260] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.606158 1178 leader_election.cc:290] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.606482 1165 ts_tablet_manager.cc:1434] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:52:48.606745 1165 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.608543 1165 tablet_bootstrap.cc:654] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.611074 760 tablet_service.cc:1511] Processing CreateTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 (DEFAULT_TABLE table=default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.611507 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60a9ee2cc5a42efa1201e12622d4df1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:48.616828 986 leader_election.cc:343] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.618213 1165 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.618443 1165 ts_tablet_manager.cc:1403] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s
I20260503 07:52:48.618738 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d37da070cc41438b84dc09ea74e38fe9 (table default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]) successfully deleted
I20260503 07:52:48.619305 1165 raft_consensus.cc:359] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.619508 1165 raft_consensus.cc:385] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.619618 1165 raft_consensus.cc:740] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.619848 1165 consensus_queue.cc:260] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.620317 1165 ts_tablet_manager.cc:1434] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:48.620538 1175 tablet_replica.cc:333] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:48.620633 1165 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.620754 1175 raft_consensus.cc:2243] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:48.620929 1175 raft_consensus.cc:2272] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.621529 1175 ts_tablet_manager.cc:1916] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.626880 1165 tablet_bootstrap.cc:654] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.628031 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37da070cc41438b84dc09ea74e38fe9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.628330 917 raft_consensus.cc:2468] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:52:48.628801 988 leader_election.cc:343] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.628983 988 leader_election.cc:304] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.629856 1178 raft_consensus.cc:2749] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:48.636904 1166 tablet_bootstrap.cc:492] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.636948 1165 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.637063 1166 ts_tablet_manager.cc:1403] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.073s user 0.015s sys 0.019s
I20260503 07:52:48.637063 1165 ts_tablet_manager.cc:1403] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260503 07:52:48.638293 1166 raft_consensus.cc:359] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.638497 1166 raft_consensus.cc:385] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.638586 1166 raft_consensus.cc:740] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.638861 1166 consensus_queue.cc:260] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.639389 1166 ts_tablet_manager.cc:1434] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:48.639760 1166 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.641268 1165 raft_consensus.cc:359] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.641461 1165 raft_consensus.cc:385] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.641554 1166 tablet_bootstrap.cc:654] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.641553 1165 raft_consensus.cc:740] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.641798 1165 consensus_queue.cc:260] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.642865 1165 ts_tablet_manager.cc:1434] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:48.643136 1165 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.645124 1165 tablet_bootstrap.cc:654] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:48.657042 986 leader_election.cc:343] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:48.658465 1178 raft_consensus.cc:493] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.658505 1170 raft_consensus.cc:493] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.658632 1178 raft_consensus.cc:515] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.658699 1170 raft_consensus.cc:515] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.659435 1178 leader_election.cc:290] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.659545 1170 leader_election.cc:290] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.660280 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.660517 1052 raft_consensus.cc:2468] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:48.661033 716 leader_election.cc:304] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.662043 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.662472 988 leader_election.cc:304] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.662555 1170 raft_consensus.cc:2804] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.662675 1170 raft_consensus.cc:493] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.662766 1170 raft_consensus.cc:3060] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.664063 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.665604 1170 raft_consensus.cc:515] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.666007 781 raft_consensus.cc:2393] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c11eb9ffa7845269a6a8000e8ff248f in current term 1: Already voted for candidate 4a924c2134c54fa0bb164825da53bdd0 in this term.
I20260503 07:52:48.666699 1178 raft_consensus.cc:2804] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.666847 1178 raft_consensus.cc:493] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.666939 1178 raft_consensus.cc:3060] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.667852 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.668108 1052 raft_consensus.cc:3060] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.671371 1052 raft_consensus.cc:2468] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:48.672274 716 leader_election.cc:304] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.672639 1232 raft_consensus.cc:2804] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.674630 1170 leader_election.cc:290] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.685282 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f3e004ece846459c89f920fb5567f2ad (DEFAULT_TABLE table=default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.685762 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e004ece846459c89f920fb5567f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.693552 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (DEFAULT_TABLE table=default.Table_4f1b1dcb8b514c4899ca1a60d51b3940 [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.693977 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2b1956063b4f5e8bbef9f3d0eba359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.703872 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (DEFAULT_TABLE table=default.Table_4f1b1dcb8b514c4899ca1a60d51b3940 [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.704339 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2b1956063b4f5e8bbef9f3d0eba359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.707367 1175 ts_tablet_manager.cc:1929] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:48.707515 1175 log.cc:1199] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:48.707871 1175 ts_tablet_manager.cc:1950] T 44cde484c8a045aeac133bac6f1b90d2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:48.713778 757 tablet_service.cc:1511] Processing CreateTablet for tablet b3168a0cf68f4838b82266d53ad00419 (DEFAULT_TABLE table=default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.714197 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3168a0cf68f4838b82266d53ad00419. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:48.717096 988 leader_election.cc:343] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.717332 988 leader_election.cc:304] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.717705 1212 raft_consensus.cc:2749] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:48.717926 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (DEFAULT_TABLE table=default.Table_4f1b1dcb8b514c4899ca1a60d51b3940 [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.718372 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2b1956063b4f5e8bbef9f3d0eba359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.721060 893 tablet_service.cc:1511] Processing CreateTablet for tablet f3e004ece846459c89f920fb5567f2ad (DEFAULT_TABLE table=default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.721472 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.721840 895 tablet_service.cc:1511] Processing CreateTablet for tablet b3168a0cf68f4838b82266d53ad00419 (DEFAULT_TABLE table=default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.722405 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b3168a0cf68f4838b82266d53ad00419 (DEFAULT_TABLE table=default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.723109 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3168a0cf68f4838b82266d53ad00419. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:48.723102 715 leader_election.cc:343] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.723686 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce867777c0e46d1af4785e667e7a18e (DEFAULT_TABLE table=default.Table_751c5cfb0064496c88d7ea0dcdbb9425 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.671586 1178 raft_consensus.cc:515] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.720791 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b18184e1a3492888e173481fca5411" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.726984 1178 leader_election.cc:290] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:48.727025 715 leader_election.cc:343] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.727427 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e004ece846459c89f920fb5567f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.728365 1170 raft_consensus.cc:493] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.728508 1170 raft_consensus.cc:515] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.729163 1170 leader_election.cc:290] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:48.727960 986 leader_election.cc:343] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:48.729779 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.730391 1052 raft_consensus.cc:2468] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:48.730912 716 leader_election.cc:304] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.731217 1170 raft_consensus.cc:2804] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.731325 1170 raft_consensus.cc:493] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.731415 1170 raft_consensus.cc:3060] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.734263 1212 raft_consensus.cc:493] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.734475 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3168a0cf68f4838b82266d53ad00419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.734391 1212 raft_consensus.cc:515] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.735198 1212 leader_election.cc:290] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.736259 1170 raft_consensus.cc:515] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.736591 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce867777c0e46d1af4785e667e7a18e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.737471 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.737674 1052 raft_consensus.cc:3060] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.740664 1170 leader_election.cc:290] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:48.741946 1052 raft_consensus.cc:2468] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:48.742408 716 leader_election.cc:304] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.742975 1170 raft_consensus.cc:2804] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.743139 1170 raft_consensus.cc:697] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:48.743474 1170 consensus_queue.cc:237] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.743659 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:48.744336 715 leader_election.cc:343] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.744884 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.745062 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:48.745357 715 leader_election.cc:343] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:48.745771 986 leader_election.cc:343] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.749341 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce867777c0e46d1af4785e667e7a18e (DEFAULT_TABLE table=default.Table_751c5cfb0064496c88d7ea0dcdbb9425 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.749801 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce867777c0e46d1af4785e667e7a18e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.752552 760 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce867777c0e46d1af4785e667e7a18e (DEFAULT_TABLE table=default.Table_751c5cfb0064496c88d7ea0dcdbb9425 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.753073 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce867777c0e46d1af4785e667e7a18e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:48.756515 1178 raft_consensus.cc:493] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.756748 1178 raft_consensus.cc:515] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.758294 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.758515 781 raft_consensus.cc:2468] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:48.759021 986 leader_election.cc:304] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.759321 1212 raft_consensus.cc:2804] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.759423 1212 raft_consensus.cc:493] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.759531 1212 raft_consensus.cc:3060] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.760917 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.761754 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.762295 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37da070cc41438b84dc09ea74e38fe9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.762480 917 raft_consensus.cc:3060] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.763509 1212 raft_consensus.cc:515] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.766024 917 raft_consensus.cc:2468] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:48.766185 1212 leader_election.cc:290] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:48.766563 988 leader_election.cc:343] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.766688 988 leader_election.cc:304] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.766755 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:48.766963 781 raft_consensus.cc:3060] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:48.767060 988 leader_election.cc:343] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.768569 988 leader_election.cc:304] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.770349 781 raft_consensus.cc:2468] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:48.770915 986 leader_election.cc:304] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:48.771154 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.771670 1212 raft_consensus.cc:2749] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:48.772078 1212 raft_consensus.cc:2804] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.772449 1212 raft_consensus.cc:697] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:48.773069 1212 consensus_queue.cc:237] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.774299 1169 raft_consensus.cc:493] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.774477 1169 raft_consensus.cc:515] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.773396 1277 raft_consensus.cc:2804] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.775098 1169 leader_election.cc:290] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:48.776734 851 leader_election.cc:343] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:48.779284 761 tablet_service.cc:1511] Processing CreateTablet for tablet f3e004ece846459c89f920fb5567f2ad (DEFAULT_TABLE table=default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:48.781982 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e004ece846459c89f920fb5567f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:48.782327 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.62:44841, user_credentials={real_user=slave}} blocked reactor thread for 231255us
I20260503 07:52:48.784355 1169 raft_consensus.cc:493] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.784539 1169 raft_consensus.cc:515] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.784628 1178 leader_election.cc:290] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.785270 1169 leader_election.cc:290] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:48.786459 851 leader_election.cc:343] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:48.789263 1277 raft_consensus.cc:697] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:48.789908 1277 consensus_queue.cc:237] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:48.794672 988 leader_election.cc:343] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:48.797930 1279 raft_consensus.cc:493] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.798126 1279 raft_consensus.cc:515] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.801678 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 44cde484c8a045aeac133bac6f1b90d2 (table default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]) successfully deleted
I20260503 07:52:48.809202 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934a0b41c303482daba10a7acd91fb9d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.809422 917 raft_consensus.cc:2468] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:48.810029 988 leader_election.cc:304] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:48.810400 1178 raft_consensus.cc:2804] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.810554 1279 leader_election.cc:290] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.810614 1178 raft_consensus.cc:493] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.811086 1178 raft_consensus.cc:3060] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.810139 1175 tablet_replica.cc:333] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:48.819934 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c25f714b33f49e5b83947889c0e3635" } modify_external_catalogs: true
I20260503 07:52:48.820312 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c25f714b33f49e5b83947889c0e3635" } modify_external_catalogs: true
W20260503 07:52:48.832675 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 61770.3us
I20260503 07:52:48.833351 1277 raft_consensus.cc:493] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:48.833604 1277 raft_consensus.cc:515] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.833990 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abbb083010f476b8a0803fabc3279bb" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:48.834227 1052 raft_consensus.cc:2468] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 0.
I20260503 07:52:48.834795 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5999c4e4e9408b9c8c6fe27b2dac21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:48.834887 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934a0b41c303482daba10a7acd91fb9d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.835026 917 raft_consensus.cc:2468] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:48.835247 781 raft_consensus.cc:2468] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:48.835503 988 leader_election.cc:304] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:48.835837 1279 raft_consensus.cc:2804] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:52:48.835835 854 leader_election.cc:343] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:48.835940 1279 raft_consensus.cc:493] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.835970 854 leader_election.cc:304] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.836026 1279 raft_consensus.cc:3060] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.836273 1169 raft_consensus.cc:2749] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:48.837267 854 leader_election.cc:304] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.837659 1169 raft_consensus.cc:2804] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:48.837759 1169 raft_consensus.cc:493] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:48.837831 1169 raft_consensus.cc:3060] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.839516 1279 raft_consensus.cc:515] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.840500 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5999c4e4e9408b9c8c6fe27b2dac21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.840659 917 raft_consensus.cc:3060] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.843057 917 raft_consensus.cc:2468] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:48.843537 1169 raft_consensus.cc:515] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.844229 1169 leader_election.cc:290] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:48.845029 851 leader_election.cc:343] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:48.846017 988 leader_election.cc:304] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:48.849411 1278 raft_consensus.cc:2804] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.852810 1232 raft_consensus.cc:697] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:48.843990 1265 tablet.cc:1724] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:48.853109 1232 consensus_queue.cc:237] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.862702 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ae34e18001ee40e8b15584b8091515f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.863284 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae34e18001ee40e8b15584b8091515f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.867635 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5999c4e4e9408b9c8c6fe27b2dac21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:48.867972 781 raft_consensus.cc:2468] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:48.870348 1166 tablet_bootstrap.cc:492] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.870515 1166 ts_tablet_manager.cc:1403] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.231s user 0.020s sys 0.055s
I20260503 07:52:48.871302 1166 raft_consensus.cc:359] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.871490 1166 raft_consensus.cc:385] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.871562 1166 raft_consensus.cc:740] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.874185 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:48.874689 592 catalog_manager.cc:6741] ReplaceTablet: tablet 1609d01e6cdc440085a6ebdb652d54f1 deleted and replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:48.875483 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f16f9f3d92d14e6c8240bc4928c42475" } new_table_name: "default.Table_1dd726d9860044f19095052ccdc18252" modify_external_catalogs: true
I20260503 07:52:48.875878 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:48.876439 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1609d01e6cdc440085a6ebdb652d54f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1609d01e6cdc440085a6ebdb652d54f1 already in progress: creating tablet
I20260503 07:52:48.877087 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.877717 1166 consensus_queue.cc:260] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.878229 1166 ts_tablet_manager.cc:1434] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260503 07:52:48.878490 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1609d01e6cdc440085a6ebdb652d54f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1609d01e6cdc440085a6ebdb652d54f1 already in progress: creating tablet
I20260503 07:52:48.878630 1166 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.880947 1166 tablet_bootstrap.cc:654] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.882608 1165 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.882800 1165 ts_tablet_manager.cc:1403] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.240s user 0.015s sys 0.026s
I20260503 07:52:48.883589 1165 raft_consensus.cc:359] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.883773 1165 raft_consensus.cc:385] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.883841 1165 raft_consensus.cc:740] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.884055 1165 consensus_queue.cc:260] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.885994 1165 ts_tablet_manager.cc:1434] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:48.886341 1165 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.888324 1165 tablet_bootstrap.cc:654] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.890348 1166 tablet_bootstrap.cc:492] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:48.890476 1166 ts_tablet_manager.cc:1403] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260503 07:52:48.895118 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9c01aea82d584140bbabba1f5be65539
I20260503 07:52:48.895583 594 catalog_manager.cc:6741] ReplaceTablet: tablet 9c01aea82d584140bbabba1f5be65539 deleted and replaced by tablet 430e7da7fa8f462781163322dbe3e2c0
I20260503 07:52:48.896128 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f3e004ece846459c89f920fb5567f2ad
I20260503 07:52:48.891191 1166 raft_consensus.cc:359] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.896317 1166 raft_consensus.cc:385] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.896436 1166 raft_consensus.cc:740] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.896780 1166 consensus_queue.cc:260] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.897831 595 catalog_manager.cc:5671] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:48.898404 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_2028f587f7194f0586dc9d0cf590d351 [id=a73654d3dcae49909e766eb795334a56]). Expected version 2 got 0
I20260503 07:52:48.898518 1166 ts_tablet_manager.cc:1434] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260503 07:52:48.899140 1166 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:48.900998 1166 tablet_bootstrap.cc:654] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.901466 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:48.901423 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:48.902629 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9c01aea82d584140bbabba1f5be65539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c01aea82d584140bbabba1f5be65539 already in progress: creating tablet
I20260503 07:52:48.903852 1165 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.904021 1165 ts_tablet_manager.cc:1403] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.003s
W20260503 07:52:48.904021 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f3e004ece846459c89f920fb5567f2ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3e004ece846459c89f920fb5567f2ad already in progress: creating tablet
I20260503 07:52:48.904912 1165 raft_consensus.cc:359] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.905092 1165 raft_consensus.cc:385] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.905174 1165 raft_consensus.cc:740] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.905612 1165 consensus_queue.cc:260] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.906248 1165 ts_tablet_manager.cc:1434] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:48.906529 1165 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.908697 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:48.909008 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:48.910401 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9c01aea82d584140bbabba1f5be65539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c01aea82d584140bbabba1f5be65539 already in progress: creating tablet
W20260503 07:52:48.910882 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f3e004ece846459c89f920fb5567f2ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3e004ece846459c89f920fb5567f2ad already in progress: creating tablet
I20260503 07:52:48.849632 1277 leader_election.cc:290] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.924322 1165 tablet_bootstrap.cc:654] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.924513 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5999c4e4e9408b9c8c6fe27b2dac21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:48.929703 1175 raft_consensus.cc:2243] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:48.932255 781 raft_consensus.cc:3060] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.929842 1278 raft_consensus.cc:697] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:48.934901 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.934855 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abbb083010f476b8a0803fabc3279bb" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:48.933779 1279 leader_election.cc:290] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.941768 781 raft_consensus.cc:2468] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:48.943935 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.944809 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_808dbcf79af44f209e756d91fe98e82c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.945479 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_808dbcf79af44f209e756d91fe98e82c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.946918 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b5459e78eccc4416aa5499c77c631adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.947379 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5459e78eccc4416aa5499c77c631adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.949299 597 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 8c7a4de8d4d9464db04a99aaccc8ffad
I20260503 07:52:48.949618 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2028f587f7194f0586dc9d0cf590d351" } new_table_name: "default.Table_8366e2f4cb894ada98071f8d46a90cec" modify_external_catalogs: true
I20260503 07:52:48.952782 1165 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:48.956845 1052 raft_consensus.cc:3060] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.957736 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:48.958004 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_107377a24ea941e89c173ed4b30a4e00" } new_table_name: "default.Table_f5f99ea98c214f3681e6ffa4ff664cea" modify_external_catalogs: true
I20260503 07:52:48.960039 1165 ts_tablet_manager.cc:1403] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.003s
I20260503 07:52:48.960952 1052 raft_consensus.cc:2468] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 1.
I20260503 07:52:48.960980 1165 raft_consensus.cc:359] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.961158 1165 raft_consensus.cc:385] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.961227 1165 raft_consensus.cc:740] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:48.961577 854 leader_election.cc:304] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:48.961972 1169 raft_consensus.cc:2804] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.962198 1278 consensus_queue.cc:237] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.962515 1175 pending_rounds.cc:70] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:48.963054 1175 pending_rounds.cc:77] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847372905070592 op_type: NO_OP noop_request { }
I20260503 07:52:48.963256 1175 raft_consensus.cc:2889] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:48.963431 1175 raft_consensus.cc:2272] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:48.965334 1175 ts_tablet_manager.cc:1916] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:48.965870 1165 consensus_queue.cc:260] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.966390 1165 ts_tablet_manager.cc:1434] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260503 07:52:48.970588 1165 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:48.972265 1165 tablet_bootstrap.cc:654] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:48.975997 1175 ts_tablet_manager.cc:1929] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:48.976970 1171 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:48.977034 1178 raft_consensus.cc:515] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.978915 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934a0b41c303482daba10a7acd91fb9d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:48.979118 918 raft_consensus.cc:3060] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:48.980918 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_564e5157ad4c4635936c429658c6c64b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.981951 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_564e5157ad4c4635936c429658c6c64b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.982501 918 raft_consensus.cc:2468] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:48.977272 1175 log.cc:1199] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:48.983134 988 leader_election.cc:304] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
I20260503 07:52:48.983477 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0dbfb8d8cca647a59092127133865999" } new_table_name: "default.Table_62799a3c344b48af95d87952f8040a19" modify_external_catalogs: true
I20260503 07:52:48.983937 1278 raft_consensus.cc:2804] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:48.984094 1278 raft_consensus.cc:697] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:48.984368 1278 consensus_queue.cc:237] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:48.985225 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_33adfc18860c4e18a16e663d515ab28e" } modify_external_catalogs: true
I20260503 07:52:48.985438 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_33adfc18860c4e18a16e663d515ab28e" } modify_external_catalogs: true
I20260503 07:52:48.977794 1171 ts_tablet_manager.cc:1403] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.410s user 0.027s sys 0.102s
I20260503 07:52:48.987071 1171 raft_consensus.cc:359] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.987232 1171 raft_consensus.cc:385] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:48.987274 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6eca7f88573745c5ae68fdb32cda2feb (table default.Table_15bde81ecc7240a6a53f23d1b6e71dd0 [id=3d5fb91471ec4d8684efb6faca6738da]). Expected version 1 got 0
I20260503 07:52:48.987319 1171 raft_consensus.cc:740] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:48.987690 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15714a97dd7749bb8e2ca20f795c760a consensus state has no leader
I20260503 07:52:48.988075 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bd21e95281b34dc5951b94a8e8d831bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.988580 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd21e95281b34dc5951b94a8e8d831bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.988878 1178 leader_election.cc:290] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:48.990095 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 689f9fbe38c9459b8e07b6124443f546
I20260503 07:52:48.990762 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cbc48b8cfe934150882defe3cf8fbbfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.991194 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbc48b8cfe934150882defe3cf8fbbfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:48.992719 1171 consensus_queue.cc:260] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.993223 1171 ts_tablet_manager.cc:1434] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:52:48.993498 1171 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:48.994066 1169 raft_consensus.cc:697] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Running, Role: LEADER
I20260503 07:52:48.994387 1169 consensus_queue.cc:237] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:48.996452 1175 ts_tablet_manager.cc:1950] T d37da070cc41438b84dc09ea74e38fe9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:48.997823 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c37459b741904a8696064201992d4591
I20260503 07:52:48.998415 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_72003fe7514a4b37a7d0aab39f859423"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:48.998975 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72003fe7514a4b37a7d0aab39f859423 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.000939 1171 tablet_bootstrap.cc:654] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.001708 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fba3e565b8074ca081727412062ab6ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.002149 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fba3e565b8074ca081727412062ab6ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.003232 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d37da070cc41438b84dc09ea74e38fe9 (table default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]) successfully deleted
I20260503 07:52:49.004439 1166 tablet_bootstrap.cc:492] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.004626 1166 ts_tablet_manager.cc:1403] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.106s user 0.006s sys 0.002s
I20260503 07:52:49.004977 1175 tablet_replica.cc:333] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.005806 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 689f9fbe38c9459b8e07b6124443f546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.005928 918 raft_consensus.cc:1275] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:49.006085 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.006263 893 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0842dda8fb47ee828189e25a0a2ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.006444 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cde484c8a045aeac133bac6f1b90d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.006651 1173 tablet_replica.cc:333] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:49.006826 1173 raft_consensus.cc:2243] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.007090 1173 raft_consensus.cc:2272] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.007877 1173 ts_tablet_manager.cc:1916] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.008124 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f1b1dcb8b514c4899ca1a60d51b3940" } new_table_name: "default.Table_506c091a2d2e43bd85e86b720a60cf1d" modify_external_catalogs: true
I20260503 07:52:49.008695 1232 consensus_queue.cc:1048] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:49.014278 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 689f9fbe38c9459b8e07b6124443f546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.014565 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.014755 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.014837 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.015101 1174 tablet_replica.cc:333] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.015329 1174 raft_consensus.cc:2243] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.015640 1173 ts_tablet_manager.cc:1929] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:49.015713 1174 raft_consensus.cc:2272] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.015751 1173 log.cc:1199] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/689f9fbe38c9459b8e07b6124443f546
I20260503 07:52:49.015997 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 689f9fbe38c9459b8e07b6124443f546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.016196 1173 ts_tablet_manager.cc:1950] T 689f9fbe38c9459b8e07b6124443f546 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:49.016506 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.017247 1174 ts_tablet_manager.cc:1916] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.017270 1173 tablet_replica.cc:333] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:49.017463 1173 raft_consensus.cc:2243] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.017616 1173 raft_consensus.cc:2272] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.017874 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]) successfully deleted
I20260503 07:52:49.018115 1173 ts_tablet_manager.cc:1916] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:49.018157 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c37459b741904a8696064201992d4591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c37459b741904a8696064201992d4591 already in progress: creating tablet
W20260503 07:52:49.018368 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ee0842dda8fb47ee828189e25a0a2ead because the tablet was not found. No further retry: Not found: Tablet not found: ee0842dda8fb47ee828189e25a0a2ead
I20260503 07:52:49.018894 1052 raft_consensus.cc:1275] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:49.020007 1232 consensus_queue.cc:1048] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:49.024335 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.025257 1174 ts_tablet_manager.cc:1929] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:49.025764 1174 log.cc:1199] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/689f9fbe38c9459b8e07b6124443f546
I20260503 07:52:49.026533 1174 ts_tablet_manager.cc:1950] T 689f9fbe38c9459b8e07b6124443f546 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.028497 1174 tablet_replica.cc:333] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.028884 1174 raft_consensus.cc:2243] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.029093 1174 raft_consensus.cc:2272] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.030750 1178 raft_consensus.cc:493] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.031035 1178 raft_consensus.cc:515] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.031476 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]) successfully deleted
W20260503 07:52:49.031759 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c37459b741904a8696064201992d4591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c37459b741904a8696064201992d4591 already in progress: creating tablet
I20260503 07:52:49.031998 1166 raft_consensus.cc:359] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.032223 1166 raft_consensus.cc:385] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.032301 1166 raft_consensus.cc:740] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.032347 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0fbc1ccf8344e583d34ffb2e25d4b1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.033125 988 leader_election.cc:343] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.033730 1178 leader_election.cc:290] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.034097 1175 raft_consensus.cc:2243] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.034339 1175 raft_consensus.cc:2272] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.034972 1175 ts_tablet_manager.cc:1916] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.039017 1265 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:49.040421 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.040700 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.040989 1178 raft_consensus.cc:493] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.042578 1178 raft_consensus.cc:515] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.043656 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.044274 1178 leader_election.cc:290] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.048120 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934a0b41c303482daba10a7acd91fb9d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:49.048393 781 raft_consensus.cc:3060] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.051695 781 raft_consensus.cc:2468] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:49.056414 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0fbc1ccf8344e583d34ffb2e25d4b1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:49.056643 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:49.056708 781 raft_consensus.cc:2468] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:49.056916 780 raft_consensus.cc:2468] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:49.056730 1299 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:49.057116 986 leader_election.cc:304] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.057523 986 leader_election.cc:304] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:49.057793 1279 raft_consensus.cc:2804] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.057904 1279 raft_consensus.cc:493] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.058013 1279 raft_consensus.cc:3060] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:49.060282 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 15714a97dd7749bb8e2ca20f795c760a consensus state has no leader
I20260503 07:52:49.061388 1279 raft_consensus.cc:515] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.062191 1279 leader_election.cc:290] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.062343 1279 raft_consensus.cc:2804] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.062444 1279 raft_consensus.cc:493] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.063040 1279 raft_consensus.cc:3060] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.064958 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0fbc1ccf8344e583d34ffb2e25d4b1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:49.065677 988 leader_election.cc:343] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.065891 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0fbc1ccf8344e583d34ffb2e25d4b1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:49.066103 780 raft_consensus.cc:3060] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.067509 1279 raft_consensus.cc:515] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.068729 1279 leader_election.cc:290] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.069007 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:49.069675 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:49.069872 781 raft_consensus.cc:3060] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:49.070194 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 295cfe6e7a7043b2905a6e90dd520002 has no consensus state
I20260503 07:52:49.070525 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 91d799ca2780461b89ced316e9f3ac92 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.072322 1165 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.072466 1165 ts_tablet_manager.cc:1403] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.001s
I20260503 07:52:49.072983 781 raft_consensus.cc:2468] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:49.073333 986 leader_election.cc:304] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.073683 1174 ts_tablet_manager.cc:1916] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.074784 1165 raft_consensus.cc:359] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.074976 1165 raft_consensus.cc:385] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.075073 1165 raft_consensus.cc:740] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.075189 1279 raft_consensus.cc:2804] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.075318 1165 consensus_queue.cc:260] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.077443 1165 ts_tablet_manager.cc:1434] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:49.078325 1165 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.078425 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 934a0b41c303482daba10a7acd91fb9d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.078902 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 934a0b41c303482daba10a7acd91fb9d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.079345 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_983dc3d67bb04a76b617811d8288d00f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.079524 1279 raft_consensus.cc:697] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
W20260503 07:52:49.080015 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_983dc3d67bb04a76b617811d8288d00f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.079977 1279 consensus_queue.cc:237] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.081125 1165 tablet_bootstrap.cc:654] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.086048 1165 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.086208 1165 ts_tablet_manager.cc:1403] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260503 07:52:49.086884 1165 raft_consensus.cc:359] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.087059 1165 raft_consensus.cc:385] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.087127 1165 raft_consensus.cc:740] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.088936 1165 consensus_queue.cc:260] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.090616 1171 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.090656 1165 ts_tablet_manager.cc:1434] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:49.090988 1171 ts_tablet_manager.cc:1403] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260503 07:52:49.091756 1165 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.091713 780 raft_consensus.cc:2468] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:49.093814 986 leader_election.cc:304] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.095444 1165 tablet_bootstrap.cc:654] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.099731 1278 raft_consensus.cc:2804] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.104557 1165 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.104682 1165 ts_tablet_manager.cc:1403] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260503 07:52:49.105048 1278 raft_consensus.cc:697] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:49.105396 1165 raft_consensus.cc:359] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.105572 1165 raft_consensus.cc:385] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.105664 1165 raft_consensus.cc:740] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.105441 1278 consensus_queue.cc:237] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.105907 1165 consensus_queue.cc:260] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.110239 1165 ts_tablet_manager.cc:1434] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:49.111294 1165 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.032531 1166 consensus_queue.cc:260] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.112973 917 raft_consensus.cc:2468] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:49.113164 1296 raft_consensus.cc:493] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.113314 1296 raft_consensus.cc:515] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.114151 1166 ts_tablet_manager.cc:1434] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.109s user 0.002s sys 0.000s
I20260503 07:52:49.115108 1294 mvcc.cc:204] Tried to move back new op lower bound from 7281847373785083904 to 7281847371643568128. Current Snapshot: MvccSnapshot[applied={T|T < 7281847373785083904}]
I20260503 07:52:49.115206 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.117493 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919cf168bac48e5abbd261590487e8f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:49.117751 780 raft_consensus.cc:2393] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:49.120414 1165 tablet_bootstrap.cc:654] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.120946 597 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 56ea5d9920d443fc9e463934a76bf8db
I20260503 07:52:49.114231 1296 leader_election.cc:290] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.124725 1166 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:49.091737 1171 raft_consensus.cc:359] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.125043 1171 raft_consensus.cc:385] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.126358 1171 raft_consensus.cc:740] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.127388 1171 consensus_queue.cc:260] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.132229 1171 ts_tablet_manager.cc:1434] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260503 07:52:49.133913 1166 tablet_bootstrap.cc:654] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.134883 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5fbac7e007964bb097d813068a2f5769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.135105 1308 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:49.135308 1171 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:49.135566 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fbac7e007964bb097d813068a2f5769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.137194 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 51494da361814bf1917182ed2952e28d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.137822 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c27827418e046c5b6adefb0a1da904f" } modify_external_catalogs: true
I20260503 07:52:49.138024 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c27827418e046c5b6adefb0a1da904f" } modify_external_catalogs: true
I20260503 07:52:49.139456 593 master_service.cc:954] ReplaceTablet: received request to replace tablet b3168a0cf68f4838b82266d53ad00419 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:49.140904 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2b1956063b4f5e8bbef9f3d0eba359 consensus state has no leader
I20260503 07:52:49.141971 1171 tablet_bootstrap.cc:654] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.143638 1174 ts_tablet_manager.cc:1929] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.143760 1174 log.cc:1199] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ad5999c4e4e9408b9c8c6fe27b2dac21
I20260503 07:52:49.144130 1174 ts_tablet_manager.cc:1950] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.118129 851 leader_election.cc:304] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:49.144678 1296 raft_consensus.cc:3060] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.146236 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:49.146757 596 catalog_manager.cc:6741] ReplaceTablet: tablet 91d799ca2780461b89ced316e9f3ac92 deleted and replaced by tablet 96f7244292c3400dad2812e0adb162ef
I20260503 07:52:49.147455 1296 raft_consensus.cc:2749] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.148144 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.149463 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.116950 1173 ts_tablet_manager.cc:1929] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.149694 1173 log.cc:1199] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/44cde484c8a045aeac133bac6f1b90d2
I20260503 07:52:49.150105 1173 ts_tablet_manager.cc:1950] T 44cde484c8a045aeac133bac6f1b90d2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:49.151110 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 44cde484c8a045aeac133bac6f1b90d2 (table default.Table_4bc0f4c3caee40b4a96e0b7ae1b440bb [id=4858e02630324762a3bb0c53140959eb]) successfully deleted
I20260503 07:52:49.152478 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b08a70d722804edf8e4d44f5e8f00efd" } modify_external_catalogs: true
I20260503 07:52:49.152791 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b08a70d722804edf8e4d44f5e8f00efd" } modify_external_catalogs: true
I20260503 07:52:49.153921 1175 ts_tablet_manager.cc:1929] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.154031 1175 log.cc:1199] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/34b18184e1a3492888e173481fca5411
I20260503 07:52:49.154381 1175 ts_tablet_manager.cc:1950] T 34b18184e1a3492888e173481fca5411 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.155179 1175 tablet_replica.cc:333] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.155293 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 34b18184e1a3492888e173481fca5411 (table default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]) successfully deleted
I20260503 07:52:49.155380 1175 raft_consensus.cc:2243] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.155520 1175 raft_consensus.cc:2272] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:49.156592 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 91d799ca2780461b89ced316e9f3ac92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91d799ca2780461b89ced316e9f3ac92 already in progress: creating tablet
I20260503 07:52:49.148305 1165 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.148555 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.157110 1165 ts_tablet_manager.cc:1403] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.004s
I20260503 07:52:49.157456 1232 raft_consensus.cc:493] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.157629 1232 raft_consensus.cc:515] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.158097 1174 tablet_replica.cc:333] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.158264 1232 leader_election.cc:290] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.158499 1174 raft_consensus.cc:2243] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.158720 1174 raft_consensus.cc:2272] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.158794 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:49.159279 1174 ts_tablet_manager.cc:1916] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.159307 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.159986 715 leader_election.cc:343] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.160574 1165 raft_consensus.cc:359] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.160794 1165 raft_consensus.cc:385] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.160882 1165 raft_consensus.cc:740] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.160967 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b3168a0cf68f4838b82266d53ad00419
I20260503 07:52:49.161139 1165 consensus_queue.cc:260] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.161557 593 catalog_manager.cc:6741] ReplaceTablet: tablet b3168a0cf68f4838b82266d53ad00419 deleted and replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e
I20260503 07:52:49.161741 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.161934 1165 ts_tablet_manager.cc:1434] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:49.161975 760 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.162719 1165 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:49.163491 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b3168a0cf68f4838b82266d53ad00419 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3168a0cf68f4838b82266d53ad00419 already in progress: creating tablet
I20260503 07:52:49.164620 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_54505a16234f4eedbc3dd1457f6aa6f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.165306 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54505a16234f4eedbc3dd1457f6aa6f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.166461 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.166671 1053 raft_consensus.cc:2468] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.167135 1165 tablet_bootstrap.cc:654] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.167119 716 leader_election.cc:304] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.167366 1232 raft_consensus.cc:2804] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.167465 1232 raft_consensus.cc:493] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.167585 1232 raft_consensus.cc:3060] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.167882 1175 ts_tablet_manager.cc:1916] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.167819 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.168416 598 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 430e7da7fa8f462781163322dbe3e2c0
I20260503 07:52:49.170799 1232 raft_consensus.cc:515] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.171657 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:49.172096 715 leader_election.cc:343] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.172401 1232 leader_election.cc:290] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.173290 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37459b741904a8696064201992d4591" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:49.173494 1053 raft_consensus.cc:3060] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.176952 1053 raft_consensus.cc:2468] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.177513 716 leader_election.cc:304] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.178530 1232 raft_consensus.cc:2804] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.178711 1232 raft_consensus.cc:697] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:49.178982 1232 consensus_queue.cc:237] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.182641 1166 tablet_bootstrap.cc:492] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.182801 1166 ts_tablet_manager.cc:1403] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.001s
I20260503 07:52:49.183514 1166 raft_consensus.cc:359] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.184149 1166 raft_consensus.cc:385] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.184281 1166 raft_consensus.cc:740] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.184523 1166 consensus_queue.cc:260] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.185163 1166 ts_tablet_manager.cc:1434] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:49.186553 1166 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:49.188149 1166 tablet_bootstrap.cc:654] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.194406 1175 ts_tablet_manager.cc:1929] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.194761 1174 ts_tablet_manager.cc:1929] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.194952 1174 log.cc:1199] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/934a0b41c303482daba10a7acd91fb9d
I20260503 07:52:49.195256 1174 ts_tablet_manager.cc:1950] T 934a0b41c303482daba10a7acd91fb9d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.196422 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 934a0b41c303482daba10a7acd91fb9d (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
I20260503 07:52:49.197283 1174 tablet_replica.cc:333] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.197476 1174 raft_consensus.cc:2243] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.197631 1175 log.cc:1199] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:49.197407 592 catalog_manager.cc:5671] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:49.197997 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_8366e2f4cb894ada98071f8d46a90cec [id=a73654d3dcae49909e766eb795334a56]). Expected version 3 got 0
I20260503 07:52:49.198060 1175 ts_tablet_manager.cc:1950] T 1abbb083010f476b8a0803fabc3279bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.198901 1166 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.198972 1175 tablet_replica.cc:333] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.199091 1166 ts_tablet_manager.cc:1403] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260503 07:52:49.199180 1175 raft_consensus.cc:2243] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.199252 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1abbb083010f476b8a0803fabc3279bb (table default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]) successfully deleted
I20260503 07:52:49.199813 1166 raft_consensus.cc:359] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.199951 1175 pending_rounds.cc:70] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:49.200026 1166 raft_consensus.cc:385] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.200012 1175 pending_rounds.cc:77] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847373764665344 op_type: NO_OP noop_request { }
I20260503 07:52:49.200100 1166 raft_consensus.cc:740] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.200268 1175 raft_consensus.cc:2889] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.200377 1175 raft_consensus.cc:2272] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.201496 1174 pending_rounds.cc:70] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:49.201541 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7b44e526e9684fc2b2c753e0b8750303"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.202203 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_14d409cb4fa7480dbea66c0e11dc6b7e" } new_table_name: "default.Table_ac70726e72bf4ef090f638e4ebaa7558" modify_external_catalogs: true
I20260503 07:52:49.202296 1174 pending_rounds.cc:77] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847373224521728 op_type: NO_OP noop_request { }
I20260503 07:52:49.202409 1174 raft_consensus.cc:2889] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.202489 1174 raft_consensus.cc:2272] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:49.202538 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b44e526e9684fc2b2c753e0b8750303 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.203255 1165 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.203447 1165 ts_tablet_manager.cc:1403] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.001s
I20260503 07:52:49.203691 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_751c5cfb0064496c88d7ea0dcdbb9425" } new_table_name: "default.Table_32143754b04949878e26dc9ab3b562d2" modify_external_catalogs: true
I20260503 07:52:49.203956 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9ca0504ccfb247419d00883fe78b7fac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.204156 1165 raft_consensus.cc:359] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.204330 1165 raft_consensus.cc:385] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.204401 1165 raft_consensus.cc:740] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.204617 1165 consensus_queue.cc:260] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
W20260503 07:52:49.204710 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ca0504ccfb247419d00883fe78b7fac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.205981 1174 ts_tablet_manager.cc:1916] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.207793 1232 raft_consensus.cc:493] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.207953 1232 raft_consensus.cc:515] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.208534 1232 leader_election.cc:290] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.208995 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943498e981f341d0aa279f8a37c5d5b0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.209079 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943498e981f341d0aa279f8a37c5d5b0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.209591 716 leader_election.cc:343] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.210206 1165 ts_tablet_manager.cc:1434] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260503 07:52:49.210450 896 tablet_service.cc:1511] Processing CreateTablet for tablet dfb47ec875ab44fbaa270a84224f5432 (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.210839 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb47ec875ab44fbaa270a84224f5432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.210932 1028 tablet_service.cc:1511] Processing CreateTablet for tablet dfb47ec875ab44fbaa270a84224f5432 (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.211289 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb47ec875ab44fbaa270a84224f5432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.212867 1174 ts_tablet_manager.cc:1929] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:49.212989 1174 log.cc:1199] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/34b18184e1a3492888e173481fca5411
I20260503 07:52:49.213390 1174 ts_tablet_manager.cc:1950] T 34b18184e1a3492888e173481fca5411 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.213639 1165 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.215878 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 34b18184e1a3492888e173481fca5411 (table default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]) successfully deleted
I20260503 07:52:49.215902 1166 consensus_queue.cc:260] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.216185 917 raft_consensus.cc:2468] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.216730 715 leader_election.cc:304] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f
I20260503 07:52:49.216933 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bd21e95281b34dc5951b94a8e8d831bb" } modify_external_catalogs: true
I20260503 07:52:49.217136 1232 raft_consensus.cc:2804] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.217168 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bd21e95281b34dc5951b94a8e8d831bb" } modify_external_catalogs: true
I20260503 07:52:49.217231 1232 raft_consensus.cc:493] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.217327 1232 raft_consensus.cc:3060] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.218421 1175 ts_tablet_manager.cc:1916] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.219916 1232 raft_consensus.cc:515] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:49.220149 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 91d799ca2780461b89ced316e9f3ac92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91d799ca2780461b89ced316e9f3ac92 already in progress: creating tablet
I20260503 07:52:49.220580 1232 leader_election.cc:290] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:49.220693 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b3168a0cf68f4838b82266d53ad00419 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3168a0cf68f4838b82266d53ad00419 already in progress: creating tablet
I20260503 07:52:49.221087 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943498e981f341d0aa279f8a37c5d5b0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:49.221143 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943498e981f341d0aa279f8a37c5d5b0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:49.221304 917 raft_consensus.cc:3060] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:49.221642 716 leader_election.cc:343] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.223840 917 raft_consensus.cc:2468] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.224273 715 leader_election.cc:304] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f
I20260503 07:52:49.224709 1232 raft_consensus.cc:2804] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.224990 760 tablet_service.cc:1511] Processing CreateTablet for tablet dfb47ec875ab44fbaa270a84224f5432 (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.225342 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb47ec875ab44fbaa270a84224f5432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.225315 1232 raft_consensus.cc:697] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:49.226027 1232 consensus_queue.cc:237] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.228044 1165 tablet_bootstrap.cc:654] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.228724 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a19065f28ee44933a0522bfa28696058 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.229219 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19065f28ee44933a0522bfa28696058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.228845 1166 ts_tablet_manager.cc:1434] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260503 07:52:49.229305 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (DEFAULT_TABLE table=default.Table_14d409cb4fa7480dbea66c0e11dc6b7e [id=13495e62b3a2443480b02bdc1d474cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.229650 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a1079ce0e4e6da9779ccd401e98f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.229591 1166 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:49.232906 893 tablet_service.cc:1511] Processing CreateTablet for tablet a19065f28ee44933a0522bfa28696058 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.233520 1166 tablet_bootstrap.cc:654] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.234045 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19065f28ee44933a0522bfa28696058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.240321 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (DEFAULT_TABLE table=default.Table_14d409cb4fa7480dbea66c0e11dc6b7e [id=13495e62b3a2443480b02bdc1d474cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.240777 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a1079ce0e4e6da9779ccd401e98f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.240976 1170 raft_consensus.cc:493] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.241147 1170 raft_consensus.cc:515] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.241824 1170 leader_election.cc:290] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.242290 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.242538 1053 raft_consensus.cc:2468] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.243027 716 leader_election.cc:304] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:49.243937 1170 raft_consensus.cc:2804] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.244052 1170 raft_consensus.cc:493] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.244199 1170 raft_consensus.cc:3060] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.247520 1170 raft_consensus.cc:515] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.249054 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:49.249233 1053 raft_consensus.cc:3060] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.167850 1171 tablet_bootstrap.cc:492] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.250476 1171 ts_tablet_manager.cc:1403] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.000s
I20260503 07:52:49.251597 1171 raft_consensus.cc:359] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.251820 1171 raft_consensus.cc:385] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.251935 1171 raft_consensus.cc:740] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.252198 1171 consensus_queue.cc:260] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.253041 1171 ts_tablet_manager.cc:1434] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:49.253396 1171 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:49.255595 1171 tablet_bootstrap.cc:654] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.252432 1170 leader_election.cc:290] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.263614 1165 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.263779 1165 ts_tablet_manager.cc:1403] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.007s
I20260503 07:52:49.264801 760 tablet_service.cc:1511] Processing CreateTablet for tablet a19065f28ee44933a0522bfa28696058 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.265041 1165 raft_consensus.cc:359] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.265182 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19065f28ee44933a0522bfa28696058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.265226 1165 raft_consensus.cc:385] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.265290 1165 raft_consensus.cc:740] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.265501 1165 consensus_queue.cc:260] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.266703 1165 ts_tablet_manager.cc:1434] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260503 07:52:49.267228 1165 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.268554 757 tablet_service.cc:1511] Processing CreateTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.268929 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295cfe6e7a7043b2905a6e90dd520002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.274297 1165 tablet_bootstrap.cc:654] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.277376 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.277822 917 raft_consensus.cc:2468] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.278633 897 tablet_service.cc:1511] Processing CreateTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.278998 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295cfe6e7a7043b2905a6e90dd520002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.279948 1232 raft_consensus.cc:493] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.280074 1232 raft_consensus.cc:515] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.281198 1232 leader_election.cc:290] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.281687 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 (DEFAULT_TABLE table=default.Table_abccc7de1bca4e2b9e7e1efa23904912 [id=27c0ca8e039e4316b8878cbe7df0ddb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.282058 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4d8dfc410a40ec825d8e45e07388f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.283226 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eca7f88573745c5ae68fdb32cda2feb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:49.283946 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (DEFAULT_TABLE table=default.Table_14d409cb4fa7480dbea66c0e11dc6b7e [id=13495e62b3a2443480b02bdc1d474cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.284375 918 raft_consensus.cc:3060] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.285133 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 (DEFAULT_TABLE table=default.Table_abccc7de1bca4e2b9e7e1efa23904912 [id=27c0ca8e039e4316b8878cbe7df0ddb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.285440 894 tablet_service.cc:1511] Processing CreateTablet for tablet c9457d5693eb4f3da5501a0e581fe75c (DEFAULT_TABLE table=default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6 [id=5d74e1e18e8b45e88fd4e85b6214c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.285524 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.286618 760 tablet_service.cc:1511] Processing CreateTablet for tablet c9457d5693eb4f3da5501a0e581fe75c (DEFAULT_TABLE table=default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6 [id=5d74e1e18e8b45e88fd4e85b6214c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.286940 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9457d5693eb4f3da5501a0e581fe75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.287153 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.287475 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a45012e871b4c14a3fafb4443e1e92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.289132 759 tablet_service.cc:1511] Processing CreateTablet for tablet 741a28af9fe946db8c9305aa1dabe999 (DEFAULT_TABLE table=default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.289528 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a28af9fe946db8c9305aa1dabe999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.292797 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a1079ce0e4e6da9779ccd401e98f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.294773 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4d8dfc410a40ec825d8e45e07388f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.295132 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9457d5693eb4f3da5501a0e581fe75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.295708 1232 raft_consensus.cc:493] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.295863 1232 raft_consensus.cc:515] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.296108 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a45012e871b4c14a3fafb4443e1e92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.296464 1232 leader_election.cc:290] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.297788 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a35d4033e24b95962a2acf9d19c13f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.300207 891 tablet_service.cc:1511] Processing CreateTablet for tablet 741a28af9fe946db8c9305aa1dabe999 (DEFAULT_TABLE table=default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:49.300796 715 leader_election.cc:343] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.301133 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a28af9fe946db8c9305aa1dabe999. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:49.303359 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a2a1079ce0e4e6da9779ccd401e98f9 consensus state has no leader
W20260503 07:52:49.306965 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ce867777c0e46d1af4785e667e7a18e consensus state has no leader
I20260503 07:52:49.307930 601 catalog_manager.cc:5671] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:49.308212 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4328cceebfa466fb6f56d0ffbc09bd2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.308331 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163]). Expected version 1 got 0
I20260503 07:52:49.308549 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_0f1b5e9a0c4846f880cb398a6ada413c [id=acb7469dcfea490bbb8e7a596577fd39]). Expected version 1 got 0
I20260503 07:52:49.308733 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6eca7f88573745c5ae68fdb32cda2feb (table default.Table_15bde81ecc7240a6a53f23d1b6e71dd0 [id=3d5fb91471ec4d8684efb6faca6738da]). Expected version 1 got 0
W20260503 07:52:49.308763 1235 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:49.309098 715 leader_election.cc:343] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:49.309481 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b4116cc31d640ac826520b41d7d3cf9 consensus state has no leader
I20260503 07:52:49.309679 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 943498e981f341d0aa279f8a37c5d5b0
W20260503 07:52:49.311115 1235 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:49.311472 1235 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260503 07:52:49.311930 595 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 5ebec855a21648748cafba309357090f
I20260503 07:52:49.313588 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.313864 1174 tablet_replica.cc:333] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.314097 1174 raft_consensus.cc:2243] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.314383 1174 pending_rounds.cc:70] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:49.314450 1174 pending_rounds.cc:77] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847374752047104 op_type: NO_OP noop_request { }
I20260503 07:52:49.314507 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8366e2f4cb894ada98071f8d46a90cec" } new_table_name: "default.Table_6706232b137041bd87a007ba2091f7c6" modify_external_catalogs: true
I20260503 07:52:49.314603 1174 raft_consensus.cc:2889] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.315199 1174 raft_consensus.cc:2272] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.314103 1165 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:49.315593 1165 ts_tablet_manager.cc:1403] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.008s
I20260503 07:52:49.316047 1174 ts_tablet_manager.cc:1916] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.316236 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.316216 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_67f0dd5bb9e941f2a3cca7a8c5183450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.316478 1165 raft_consensus.cc:359] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.316659 1165 raft_consensus.cc:385] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:52:49.316709 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67f0dd5bb9e941f2a3cca7a8c5183450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.316767 1165 raft_consensus.cc:740] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.317030 1165 consensus_queue.cc:260] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.317577 1165 ts_tablet_manager.cc:1434] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:52:49.317927 1165 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:49.317963 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6f2f843012924df9806f9ee50e38a5ac" } modify_external_catalogs: true
I20260503 07:52:49.318095 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6f2f843012924df9806f9ee50e38a5ac" } modify_external_catalogs: true
I20260503 07:52:49.318959 918 raft_consensus.cc:2468] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.319664 1165 tablet_bootstrap.cc:654] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.322286 715 leader_election.cc:304] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:49.322698 1173 tablet_replica.cc:333] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:49.322875 1173 raft_consensus.cc:2243] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.323060 1173 raft_consensus.cc:2272] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.324872 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b44e526e9684fc2b2c753e0b8750303" } modify_external_catalogs: true
I20260503 07:52:49.325045 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b44e526e9684fc2b2c753e0b8750303" } modify_external_catalogs: true
I20260503 07:52:49.325620 1174 ts_tablet_manager.cc:1929] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:49.325727 1174 log.cc:1199] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/943498e981f341d0aa279f8a37c5d5b0
I20260503 07:52:49.326071 1174 ts_tablet_manager.cc:1950] T 943498e981f341d0aa279f8a37c5d5b0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.326309 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 9030916bd2e04c08b07f568123eead02 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.326974 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 943498e981f341d0aa279f8a37c5d5b0 (table default.Table_b08a70d722804edf8e4d44f5e8f00efd [id=93956c0b5ffb404e8b44ef9a0a324c7c]) successfully deleted
I20260503 07:52:49.327809 1173 ts_tablet_manager.cc:1916] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.329053 1232 raft_consensus.cc:2804] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.329170 1232 raft_consensus.cc:697] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:49.329403 1232 consensus_queue.cc:237] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.340833 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 6eca7f88573745c5ae68fdb32cda2feb from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:49.341948 716 leader_election.cc:343] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d3a35d4033e24b95962a2acf9d19c13f
I20260503 07:52:49.342075 716 leader_election.cc:304] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.342381 1170 raft_consensus.cc:2749] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.339471 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 (DEFAULT_TABLE table=default.Table_62799a3c344b48af95d87952f8040a19 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.345585 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 (DEFAULT_TABLE table=default.Table_abccc7de1bca4e2b9e7e1efa23904912 [id=27c0ca8e039e4316b8878cbe7df0ddb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.345969 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4d8dfc410a40ec825d8e45e07388f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.347065 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4116cc31d640ac826520b41d7d3cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.347611 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c3a5f74835a5418b947a72d7eafd9b70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.347741 1053 raft_consensus.cc:2468] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.348100 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:49.348192 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3a5f74835a5418b947a72d7eafd9b70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.349373 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_abccc7de1bca4e2b9e7e1efa23904912" } new_table_name: "default.Table_7436651c1ee44f6dbe12eecbc8b59d66" modify_external_catalogs: true
I20260503 07:52:49.350476 1170 raft_consensus.cc:493] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.350605 1170 raft_consensus.cc:515] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.350894 1275 raft_consensus.cc:493] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.351030 1275 raft_consensus.cc:515] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.350643 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4328cceebfa466fb6f56d0ffbc09bd2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.351229 1170 leader_election.cc:290] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:52:49.351595 1235 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260503 07:52:49.351606 1275 leader_election.cc:290] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:52:49.352324 716 leader_election.cc:343] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.352361 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c9457d5693eb4f3da5501a0e581fe75c (DEFAULT_TABLE table=default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6 [id=5d74e1e18e8b45e88fd4e85b6214c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.352490 716 leader_election.cc:304] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.353050 1275 raft_consensus.cc:2749] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.353219 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295cfe6e7a7043b2905a6e90dd520002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.354341 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:49.355384 716 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.355907 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9030916bd2e04c08b07f568123eead02" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.356984 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.357219 1175 ts_tablet_manager.cc:1929] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260503 07:52:49.357473 716 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.357831 1278 raft_consensus.cc:493] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.357983 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.359330 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 (DEFAULT_TABLE table=default.Table_62799a3c344b48af95d87952f8040a19 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.359709 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4116cc31d640ac826520b41d7d3cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.361315 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9030916bd2e04c08b07f568123eead02" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.361692 1235 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:49.361795 1235 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:52:49.361847 1235 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260503 07:52:49.362200 715 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.362321 715 leader_election.cc:304] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.362725 1275 raft_consensus.cc:2749] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.366371 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9457d5693eb4f3da5501a0e581fe75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.366572 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a45012e871b4c14a3fafb4443e1e92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.366864 1175 log.cc:1199] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/934a0b41c303482daba10a7acd91fb9d
I20260503 07:52:49.367296 1175 ts_tablet_manager.cc:1950] T 934a0b41c303482daba10a7acd91fb9d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.369518 1278 raft_consensus.cc:515] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.370100 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 934a0b41c303482daba10a7acd91fb9d (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
W20260503 07:52:49.370314 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ee0842dda8fb47ee828189e25a0a2ead because the tablet was not found. No further retry: Not found: Tablet not found: ee0842dda8fb47ee828189e25a0a2ead
W20260503 07:52:49.370585 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1609d01e6cdc440085a6ebdb652d54f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1609d01e6cdc440085a6ebdb652d54f1 already in progress: creating tablet
I20260503 07:52:49.374137 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 (DEFAULT_TABLE table=default.Table_62799a3c344b48af95d87952f8040a19 [id=c26dfdfa353040f69adc8d6123962647]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:49.374802 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f3e004ece846459c89f920fb5567f2ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3e004ece846459c89f920fb5567f2ad already in progress: creating tablet
I20260503 07:52:49.375626 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 741a28af9fe946db8c9305aa1dabe999 (DEFAULT_TABLE table=default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.375990 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a28af9fe946db8c9305aa1dabe999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.383929 1235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.61
--webserver_port=38399
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:49.386508 1235 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:49.389696 1235 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260503 07:52:49.399828 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943498e981f341d0aa279f8a37c5d5b0" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.389314 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.403107 715 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.403290 715 leader_election.cc:304] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.403738 1275 raft_consensus.cc:2749] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.404879 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:49.405057 986 leader_election.cc:343] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 943498e981f341d0aa279f8a37c5d5b0
I20260503 07:52:49.405205 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4116cc31d640ac826520b41d7d3cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.406286 1175 tablet_replica.cc:333] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.405544 1278 leader_election.cc:290] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:49.408409 988 leader_election.cc:343] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:52:49.408898 1296 raft_consensus.cc:493] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.409047 1171 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.409337 988 leader_election.cc:304] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:49.410149 1278 raft_consensus.cc:2749] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.413421 1175 raft_consensus.cc:2243] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.413877 1171 ts_tablet_manager.cc:1403] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.156s user 0.001s sys 0.010s
I20260503 07:52:49.414932 1175 raft_consensus.cc:2272] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:49.416249 1324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:49.418253 1296 raft_consensus.cc:515] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:49.419021 1325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:49.419059 1296 leader_election.cc:290] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.419786 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.420586 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15714a97dd7749bb8e2ca20f795c760a" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:49.421929 1173 ts_tablet_manager.cc:1929] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.423432 1053 raft_consensus.cc:2393] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 4a924c2134c54fa0bb164825da53bdd0 in this term.
I20260503 07:52:49.423926 1173 log.cc:1199] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/943498e981f341d0aa279f8a37c5d5b0
I20260503 07:52:49.427973 854 leader_election.cc:304] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:49.428810 1296 raft_consensus.cc:3060] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.429399 1175 ts_tablet_manager.cc:1916] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.429711 1171 raft_consensus.cc:359] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:49.430722 1328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:49.431676 1235 server_base.cc:1061] running on GCE node
I20260503 07:52:49.432847 1235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:49.431727 1173 ts_tablet_manager.cc:1950] T 943498e981f341d0aa279f8a37c5d5b0 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:49.432842 1296 raft_consensus.cc:2749] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.434161 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 943498e981f341d0aa279f8a37c5d5b0 (table default.Table_b08a70d722804edf8e4d44f5e8f00efd [id=93956c0b5ffb404e8b44ef9a0a324c7c]) successfully deleted
I20260503 07:52:49.434831 1166 tablet_bootstrap.cc:492] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.435784 1171 raft_consensus.cc:385] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.435909 1171 raft_consensus.cc:740] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.436192 1171 consensus_queue.cc:260] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.436631 1166 ts_tablet_manager.cc:1403] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.207s user 0.004s sys 0.001s
I20260503 07:52:49.437472 1166 raft_consensus.cc:359] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.437674 1166 raft_consensus.cc:385] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.437767 1166 raft_consensus.cc:740] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.451505 1171 ts_tablet_manager.cc:1434] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.038s user 0.000s sys 0.002s
I20260503 07:52:49.454298 1171 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:49.455353 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9d94a78c3c464465aa79a1b009d68b53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.455907 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d94a78c3c464465aa79a1b009d68b53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.455992 1171 tablet_bootstrap.cc:654] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.457136 592 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 5ddf8a2089ef4a4bb0eb71958490ad8e
I20260503 07:52:49.457459 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a97bcefe82d749c2a7578520c988d3e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.457947 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a97bcefe82d749c2a7578520c988d3e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.458969 595 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet a409120de6004d0dadcc8929e5a0c2c4
I20260503 07:52:49.459224 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_174f327e0a86469a89537e4b094329ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.459671 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_174f327e0a86469a89537e4b094329ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.460695 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9030916bd2e04c08b07f568123eead02
I20260503 07:52:49.461087 594 catalog_manager.cc:6741] ReplaceTablet: tablet 9030916bd2e04c08b07f568123eead02 deleted and replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:49.461839 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_65c6bc92985540169483b8658efddc00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.462272 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65c6bc92985540169483b8658efddc00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.464952 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.466096 1174 tablet_replica.cc:333] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.466300 1174 raft_consensus.cc:2243] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.466473 1174 raft_consensus.cc:2272] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.469126 1175 ts_tablet_manager.cc:1929] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:49.469237 1175 log.cc:1199] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/689f9fbe38c9459b8e07b6124443f546
I20260503 07:52:49.469635 1175 ts_tablet_manager.cc:1950] T 689f9fbe38c9459b8e07b6124443f546 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.470064 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.471720 1171 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.471850 1171 ts_tablet_manager.cc:1403] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:52:49.472971 1171 raft_consensus.cc:359] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.473162 1171 raft_consensus.cc:385] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.473354 1171 raft_consensus.cc:740] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.473598 1171 consensus_queue.cc:260] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.474298 1299 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:49.476922 1171 ts_tablet_manager.cc:1434] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:49.477188 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.477501 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.477566 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a35d4033e24b95962a2acf9d19c13f with delete_type TABLET_DATA_DELETED (replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.477805 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.478246 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.479271 1171 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:49.479806 1170 raft_consensus.cc:493] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.479975 1170 raft_consensus.cc:515] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.481050 1170 leader_election.cc:290] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.481752 1175 tablet_replica.cc:333] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.481691 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7807da20d4c4b90a9e387cb72813557" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.481948 1175 raft_consensus.cc:2243] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.482102 1175 raft_consensus.cc:2272] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.482508 1174 ts_tablet_manager.cc:1916] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.482542 1175 ts_tablet_manager.cc:1916] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:49.484637 715 leader_election.cc:343] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.487402 1171 tablet_bootstrap.cc:654] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.488680 1235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:49.489471 1265 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:49.496117 1235 hybrid_clock.cc:648] HybridClock initialized: now 1777794769496020 us; error 89 us; skew 500 ppm
I20260503 07:52:49.496613 1235 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:49.498382 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7807da20d4c4b90a9e387cb72813557" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.499923 1051 raft_consensus.cc:2468] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.500797 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.500794 716 leader_election.cc:304] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.501307 1275 raft_consensus.cc:2804] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.501394 1275 raft_consensus.cc:493] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.501482 1275 raft_consensus.cc:3060] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.502310 1171 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.502503 1171 ts_tablet_manager.cc:1403] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260503 07:52:49.503364 1171 raft_consensus.cc:359] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.503623 1171 raft_consensus.cc:385] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.503686 1171 raft_consensus.cc:740] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.504305 1171 consensus_queue.cc:260] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.508188 1171 ts_tablet_manager.cc:1434] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:52:49.509840 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 689f9fbe38c9459b8e07b6124443f546 (table default.Table_22aaab5413f84321b9598fd533c78dcd [id=55e54e5631d94a849236a5cb69ada911]) successfully deleted
I20260503 07:52:49.510766 1171 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:49.513772 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9030916bd2e04c08b07f568123eead02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9030916bd2e04c08b07f568123eead02 already in progress: creating tablet
I20260503 07:52:49.515640 1175 ts_tablet_manager.cc:1929] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.516630 1175 log.cc:1199] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c37459b741904a8696064201992d4591
I20260503 07:52:49.517906 1175 ts_tablet_manager.cc:1950] T c37459b741904a8696064201992d4591 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.518611 1308 tablet.cc:1724] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:49.520537 1235 webserver.cc:492] Webserver started at http://127.0.105.61:38399/ using document root <none> and password file <none>
I20260503 07:52:49.521713 1235 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:49.521899 1235 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:49.516034 1171 tablet_bootstrap.cc:654] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.524024 1275 raft_consensus.cc:515] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.525242 1275 leader_election.cc:290] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.525489 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7807da20d4c4b90a9e387cb72813557" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:49.526021 715 leader_election.cc:343] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.526224 1175 tablet_replica.cc:333] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.526459 1175 raft_consensus.cc:2243] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.526777 1175 pending_rounds.cc:70] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:49.526909 1175 pending_rounds.cc:77] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847373679370240 op_type: NO_OP noop_request { }
I20260503 07:52:49.526712 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7807da20d4c4b90a9e387cb72813557" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:49.527086 1175 raft_consensus.cc:2889] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.527156 1053 raft_consensus.cc:3060] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.527197 1175 raft_consensus.cc:2272] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.528790 1175 ts_tablet_manager.cc:1916] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.529928 1053 raft_consensus.cc:2468] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.530573 716 leader_election.cc:304] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.531653 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9ca0504ccfb247419d00883fe78b7fac" } modify_external_catalogs: true
I20260503 07:52:49.531845 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9ca0504ccfb247419d00883fe78b7fac" } modify_external_catalogs: true
I20260503 07:52:49.532294 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d937bc608e824591965885933c947fb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.533298 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d937bc608e824591965885933c947fb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.535084 1175 ts_tablet_manager.cc:1929] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260503 07:52:49.537642 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4d8dfc410a40ec825d8e45e07388f6 consensus state has no leader
I20260503 07:52:49.538763 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 7ce867777c0e46d1af4785e667e7a18e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.540099 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c37459b741904a8696064201992d4591 (table default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]) successfully deleted
I20260503 07:52:49.540771 1235 fs_manager.cc:714] Time spent opening directory manager: real 0.016s user 0.004s sys 0.002s
I20260503 07:52:49.548276 1175 log.cc:1199] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ad5999c4e4e9408b9c8c6fe27b2dac21
I20260503 07:52:49.548987 1175 ts_tablet_manager.cc:1950] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.550268 1170 raft_consensus.cc:2804] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.552569 1337 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:49.555487 1235 fs_manager.cc:730] Time spent opening block manager: real 0.013s user 0.005s sys 0.001s
I20260503 07:52:49.555711 1235 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:52:49.556783 1235 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:52:49.557159 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:49.558308 1175 tablet_replica.cc:333] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.558555 1175 raft_consensus.cc:2243] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.558864 1175 pending_rounds.cc:70] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:49.558936 1175 pending_rounds.cc:77] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847374155194368 op_type: NO_OP noop_request { }
I20260503 07:52:49.559064 1175 raft_consensus.cc:2889] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.559157 1175 raft_consensus.cc:2272] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.561134 1175 ts_tablet_manager.cc:1916] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.562605 918 raft_consensus.cc:1275] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:49.563580 1275 raft_consensus.cc:493] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.563874 1275 raft_consensus.cc:515] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.565023 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd76629713d747b490c83581cc03596c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:49.565577 715 leader_election.cc:343] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.566186 1275 leader_election.cc:290] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.566546 1275 consensus_queue.cc:1048] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:49.570744 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd76629713d747b490c83581cc03596c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.570995 1051 raft_consensus.cc:2468] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:49.571516 716 leader_election.cc:304] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.572268 1053 raft_consensus.cc:1275] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:49.579383 1175 ts_tablet_manager.cc:1929] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:49.584628 1174 ts_tablet_manager.cc:1929] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.584874 1174 log.cc:1199] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9030916bd2e04c08b07f568123eead02
I20260503 07:52:49.585397 1174 ts_tablet_manager.cc:1950] T 9030916bd2e04c08b07f568123eead02 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.586202 1174 tablet_replica.cc:333] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.586570 1174 raft_consensus.cc:2243] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.586788 1174 raft_consensus.cc:2272] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.587225 1175 log.cc:1199] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/2919cf168bac48e5abbd261590487e8f
I20260503 07:52:49.587846 1175 ts_tablet_manager.cc:1950] T 2919cf168bac48e5abbd261590487e8f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.588524 1174 ts_tablet_manager.cc:1916] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.589486 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 2919cf168bac48e5abbd261590487e8f (table default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]) successfully deleted
I20260503 07:52:49.589599 1296 raft_consensus.cc:493] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.589748 1296 raft_consensus.cc:515] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:49.590374 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 91d799ca2780461b89ced316e9f3ac92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91d799ca2780461b89ced316e9f3ac92 already in progress: creating tablet
I20260503 07:52:49.590442 1296 leader_election.cc:290] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:49.591511 1175 tablet_replica.cc:333] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:49.591989 854 leader_election.cc:343] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 34b18184e1a3492888e173481fca5411
W20260503 07:52:49.592397 851 leader_election.cc:343] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 34b18184e1a3492888e173481fca5411
I20260503 07:52:49.592427 1175 raft_consensus.cc:2243] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:49.592522 851 leader_election.cc:304] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:49.592679 1175 pending_rounds.cc:70] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:49.592734 1175 pending_rounds.cc:77] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847374261919744 op_type: NO_OP noop_request { }
I20260503 07:52:49.592844 1175 raft_consensus.cc:2889] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:49.593014 1296 raft_consensus.cc:2749] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.593803 1175 raft_consensus.cc:2272] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.594784 1175 ts_tablet_manager.cc:1916] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.606894 1175 ts_tablet_manager.cc:1929] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:49.609824 1175 log.cc:1199] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9e0fbc1ccf8344e583d34ffb2e25d4b1
I20260503 07:52:49.611368 1175 ts_tablet_manager.cc:1950] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.612752 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (table default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]) successfully deleted
I20260503 07:52:49.614180 1175 tablet_replica.cc:333] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.614697 1175 raft_consensus.cc:2243] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.615206 1175 raft_consensus.cc:2272] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.616374 1175 ts_tablet_manager.cc:1916] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.630119 1175 ts_tablet_manager.cc:1929] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.598245 1275 raft_consensus.cc:2804] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:49.631734 1166 consensus_queue.cc:260] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.632246 1175 log.cc:1199] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/943498e981f341d0aa279f8a37c5d5b0
I20260503 07:52:49.633467 1166 ts_tablet_manager.cc:1434] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.197s user 0.000s sys 0.002s
I20260503 07:52:49.634009 1166 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:49.634337 1175 ts_tablet_manager.cc:1950] T 943498e981f341d0aa279f8a37c5d5b0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:49.635476 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 943498e981f341d0aa279f8a37c5d5b0 (table default.Table_b08a70d722804edf8e4d44f5e8f00efd [id=93956c0b5ffb404e8b44ef9a0a324c7c]) successfully deleted
W20260503 07:52:49.636966 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9030916bd2e04c08b07f568123eead02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9030916bd2e04c08b07f568123eead02 already in progress: creating tablet
I20260503 07:52:49.662963 600 master_service.cc:954] ReplaceTablet: received request to replace tablet ad5999c4e4e9408b9c8c6fe27b2dac21 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.663746 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_820b52ee7a3945ae93798523632b0fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.664608 592 master_service.cc:954] ReplaceTablet: received request to replace tablet d7807da20d4c4b90a9e387cb72813557 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.665273 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b29866176404837a575745301005a1b" } modify_external_catalogs: true
I20260503 07:52:49.665445 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b29866176404837a575745301005a1b" } modify_external_catalogs: true
I20260503 07:52:49.666215 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cbc48b8cfe934150882defe3cf8fbbfb" } new_table_name: "default.Table_c609207b4a1c47cbb38b1193163cb037" modify_external_catalogs: true
W20260503 07:52:49.676115 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_820b52ee7a3945ae93798523632b0fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.678158 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1fa1310e53144f7a9abf9399919088b0" } modify_external_catalogs: true
I20260503 07:52:49.678377 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1fa1310e53144f7a9abf9399919088b0" } modify_external_catalogs: true
I20260503 07:52:49.686957 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163]). Expected version 1 got 0
I20260503 07:52:49.693935 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_0f1b5e9a0c4846f880cb398a6ada413c [id=acb7469dcfea490bbb8e7a596577fd39]). Expected version 1 got 0
I20260503 07:52:49.694244 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_6706232b137041bd87a007ba2091f7c6 [id=a73654d3dcae49909e766eb795334a56]). Expected version 4 got 3
I20260503 07:52:49.698544 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.698509 898 tablet_service.cc:1511] Processing CreateTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 (DEFAULT_TABLE table=default.Table_54505a16234f4eedbc3dd1457f6aa6f6 [id=61ea7b42555143188666f1400ff2bfbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.698805 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 943498e981f341d0aa279f8a37c5d5b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.698971 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086c1b3968fd4ae4be703b72eaf05973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.699004 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:49.700102 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 because the tablet was not found. No further retry: Not found: Tablet not found: 9e0fbc1ccf8344e583d34ffb2e25d4b1
W20260503 07:52:49.700382 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 943498e981f341d0aa279f8a37c5d5b0 because the tablet was not found. No further retry: Not found: Tablet not found: 943498e981f341d0aa279f8a37c5d5b0
W20260503 07:52:49.700569 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2919cf168bac48e5abbd261590487e8f because the tablet was not found. No further retry: Not found: Tablet not found: 2919cf168bac48e5abbd261590487e8f
I20260503 07:52:49.705857 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 (DEFAULT_TABLE table=default.Table_54505a16234f4eedbc3dd1457f6aa6f6 [id=61ea7b42555143188666f1400ff2bfbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.706372 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086c1b3968fd4ae4be703b72eaf05973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.708509 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_62799a3c344b48af95d87952f8040a19" } new_table_name: "default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24" modify_external_catalogs: true
I20260503 07:52:49.731575 891 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (DEFAULT_TABLE table=default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.732147 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.732426 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (DEFAULT_TABLE table=default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.732952 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.746635 1028 tablet_service.cc:1511] Processing CreateTablet for tablet aa9153d3245f4dcfacf26f174bced2ba (DEFAULT_TABLE table=default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.747159 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9153d3245f4dcfacf26f174bced2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.753895 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (DEFAULT_TABLE table=default.Table_983dc3d67bb04a76b617811d8288d00f [id=16442f1d73a0449094fa45afffb69152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.754431 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9ff03fba3d4a1794a8a5b94caa9731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.772430 898 tablet_service.cc:1511] Processing CreateTablet for tablet aa9153d3245f4dcfacf26f174bced2ba (DEFAULT_TABLE table=default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.773190 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9153d3245f4dcfacf26f174bced2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.792620 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (DEFAULT_TABLE table=default.Table_983dc3d67bb04a76b617811d8288d00f [id=16442f1d73a0449094fa45afffb69152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.793289 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9ff03fba3d4a1794a8a5b94caa9731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.796550 1032 tablet_service.cc:1511] Processing CreateTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f (DEFAULT_TABLE table=default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.797300 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be381bee559841bfb90a4d2ce8c4fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.812795 891 tablet_service.cc:1511] Processing CreateTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f (DEFAULT_TABLE table=default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.813544 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be381bee559841bfb90a4d2ce8c4fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.821934 1171 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.822105 1171 ts_tablet_manager.cc:1403] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.312s user 0.095s sys 0.116s
I20260503 07:52:49.822271 1166 tablet_bootstrap.cc:654] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.822966 1171 raft_consensus.cc:359] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.823156 1171 raft_consensus.cc:385] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.823261 1171 raft_consensus.cc:740] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.823580 1171 consensus_queue.cc:260] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.824476 1171 ts_tablet_manager.cc:1434] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:49.824760 1171 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:49.826378 1171 tablet_bootstrap.cc:654] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.842078 1275 raft_consensus.cc:493] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:49.842854 1275 raft_consensus.cc:3060] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:49.847388 1232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.009s sys 0.004s
I20260503 07:52:49.848364 1339 consensus_queue.cc:1048] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:52:49.848541 1275 raft_consensus.cc:515] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:49.852845 1296 raft_consensus.cc:493] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.852988 1296 raft_consensus.cc:515] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.853570 1296 leader_election.cc:290] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:49.854633 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:49.859337 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5690198617de4f568132e24708d77418" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:49.859558 780 raft_consensus.cc:2393] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:49.860102 851 leader_election.cc:304] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:49.860718 1296 raft_consensus.cc:3060] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.863307 1296 raft_consensus.cc:2749] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:49.865208 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd76629713d747b490c83581cc03596c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:49.865968 715 leader_election.cc:343] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.867314 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd76629713d747b490c83581cc03596c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:49.867538 1051 raft_consensus.cc:3060] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:49.871434 1051 raft_consensus.cc:2468] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:49.880940 716 leader_election.cc:304] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:49.881264 1339 raft_consensus.cc:2804] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:49.881721 1275 leader_election.cc:290] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:49.882026 1232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s user 0.009s sys 0.004s
I20260503 07:52:49.885313 1166 tablet_bootstrap.cc:492] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.885488 1166 ts_tablet_manager.cc:1403] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.252s user 0.000s sys 0.003s
I20260503 07:52:49.886390 1166 raft_consensus.cc:359] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.886610 1166 raft_consensus.cc:385] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.886690 1166 raft_consensus.cc:740] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.886950 1166 consensus_queue.cc:260] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.888573 1166 ts_tablet_manager.cc:1434] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:49.889001 1166 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:49.891244 1165 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.561s user 0.101s sys 0.312s
W20260503 07:52:49.893581 1165 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.570s user 0.101s sys 0.312s
I20260503 07:52:49.894861 1165 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
W20260503 07:52:49.896032 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ce0e09526eb4c9ba4b47c36e741702d consensus state has no leader
I20260503 07:52:49.896859 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_25c8bea5fd104c3290fb7ab34e3e7286"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.898109 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25c8bea5fd104c3290fb7ab34e3e7286 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.898139 1308 tablet.cc:1724] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:49.898746 1166 tablet_bootstrap.cc:654] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.899555 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d4328cceebfa466fb6f56d0ffbc09bd2
I20260503 07:52:49.895524 1165 ts_tablet_manager.cc:1403] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.577s user 0.103s sys 0.313s
W20260503 07:52:49.900463 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b4116cc31d640ac826520b41d7d3cf9 consensus state has no leader
I20260503 07:52:49.900806 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_38707bcc12834fb29510bca7a6c43e0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.900872 1265 tablet.cc:1724] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:49.901458 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6eca7f88573745c5ae68fdb32cda2feb
I20260503 07:52:49.902351 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:49.902793 1166 tablet_bootstrap.cc:492] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:49.902944 1166 ts_tablet_manager.cc:1403] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260503 07:52:49.895510 1170 raft_consensus.cc:697] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
W20260503 07:52:49.903244 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38707bcc12834fb29510bca7a6c43e0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.903865 1166 raft_consensus.cc:359] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.904021 1166 raft_consensus.cc:385] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.904114 1166 raft_consensus.cc:740] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.904343 1166 consensus_queue.cc:260] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.905141 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.905368 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb with delete_type TABLET_DATA_DELETED (replaced by tablet c46873d43e1b4495a92996e07f93f918) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.899379 1299 tablet.cc:1724] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:49.906002 1173 tablet_replica.cc:333] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:49.906178 1173 raft_consensus.cc:2243] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.906312 1173 raft_consensus.cc:2272] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.906529 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:49.906773 1173 ts_tablet_manager.cc:1916] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.912956 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb with delete_type TABLET_DATA_DELETED (replaced by tablet c46873d43e1b4495a92996e07f93f918) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.913204 1175 tablet_replica.cc:333] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:49.913399 1175 raft_consensus.cc:2243] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.913586 1175 raft_consensus.cc:2272] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.913856 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:49.913959 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:49.914116 1175 ts_tablet_manager.cc:1916] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.914919 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.915601 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.915841 596 catalog_manager.cc:6741] ReplaceTablet: tablet 7ce867777c0e46d1af4785e667e7a18e deleted and replaced by tablet 8b84d41bdf374871a096d1dc30dd3543
I20260503 07:52:49.915897 1171 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.916033 1171 ts_tablet_manager.cc:1403] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.091s user 0.017s sys 0.014s
I20260503 07:52:49.916424 1278 consensus_queue.cc:1048] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:49.916803 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_54505a16234f4eedbc3dd1457f6aa6f6" } new_table_name: "default.Table_3dd5aa971d3b4a8fb492904c36f285ce" modify_external_catalogs: true
I20260503 07:52:49.917294 1171 raft_consensus.cc:359] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.917521 1171 raft_consensus.cc:385] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.917629 1171 raft_consensus.cc:740] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.917955 1171 consensus_queue.cc:260] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.918814 1171 ts_tablet_manager.cc:1434] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260503 07:52:49.918853 892 tablet_service.cc:1511] Processing CreateTablet for tablet 54dbfadef15548ec95e4db3725560ca9 (DEFAULT_TABLE table=default.Table_fba3e565b8074ca081727412062ab6ed [id=0a3183eb2a7d4d9ebe87627bc031f95c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.919212 1171 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:49.919262 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dbfadef15548ec95e4db3725560ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.919925 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9030916bd2e04c08b07f568123eead02 (table default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]) successfully deleted
W20260503 07:52:49.920150 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 943498e981f341d0aa279f8a37c5d5b0 because the tablet was not found. No further retry: Not found: Tablet not found: 943498e981f341d0aa279f8a37c5d5b0
I20260503 07:52:49.921016 592 catalog_manager.cc:6741] ReplaceTablet: tablet d7807da20d4c4b90a9e387cb72813557 deleted and replaced by tablet be15f49b155746d1924868d9f91e9206
I20260503 07:52:49.922996 599 catalog_manager.cc:6741] ReplaceTablet: tablet 6eca7f88573745c5ae68fdb32cda2feb deleted and replaced by tablet c46873d43e1b4495a92996e07f93f918
I20260503 07:52:49.923264 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f68056b470874a4f85a0acc623447fd0" } modify_external_catalogs: true
I20260503 07:52:49.923878 1171 tablet_bootstrap.cc:654] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.924345 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.924332 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f68056b470874a4f85a0acc623447fd0" } modify_external_catalogs: true
I20260503 07:52:49.924578 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b18184e1a3492888e173481fca5411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.925482 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.926630 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_19875ebf44a24b49991351b7681d86c4" } modify_external_catalogs: true
I20260503 07:52:49.926774 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_19875ebf44a24b49991351b7681d86c4" } modify_external_catalogs: true
I20260503 07:52:49.927816 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d7807da20d4c4b90a9e387cb72813557 with delete_type TABLET_DATA_DELETED (replaced by tablet be15f49b155746d1924868d9f91e9206) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.929307 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 934a0b41c303482daba10a7acd91fb9d with delete_type TABLET_DATA_DELETED (replaced by tablet d4328cceebfa466fb6f56d0ffbc09bd2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.929368 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 689f9fbe38c9459b8e07b6124443f546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.929509 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d7807da20d4c4b90a9e387cb72813557 with delete_type TABLET_DATA_DELETED (replaced by tablet be15f49b155746d1924868d9f91e9206) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.929567 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d37da070cc41438b84dc09ea74e38fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.929603 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abbb083010f476b8a0803fabc3279bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.929893 1170 consensus_queue.cc:237] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:49.931277 1174 ts_tablet_manager.cc:1929] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:49.932668 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 741a28af9fe946db8c9305aa1dabe999 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 741a28af9fe946db8c9305aa1dabe999 already in progress: creating tablet
I20260503 07:52:49.926330 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9b674b3ac5a442eca15573187fd35bc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.933739 898 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.935520 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 2 got 0
I20260503 07:52:49.935760 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.936154 567 master_runner.cc:186] Error getting master registration for 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111),
I20260503 07:52:49.936342 567 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260503 07:52:49.929567 597 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.2:51725 (request call id 17) took 800 ms (client timeout 1000 ms). Trace:
I20260503 07:52:49.939133 1165 raft_consensus.cc:359] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.939502 1175 ts_tablet_manager.cc:1929] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.939656 1175 log.cc:1199] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/6eca7f88573745c5ae68fdb32cda2feb
I20260503 07:52:49.940011 1175 ts_tablet_manager.cc:1950] T 6eca7f88573745c5ae68fdb32cda2feb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:49.941680 597 rpcz_store.cc:269] 0503 07:52:49.118706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.121101 (+ 2395us) service_pool.cc:224] Handling call
0503 07:52:49.919448 (+798347us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260503 07:52:49.942024 597 master_service.cc:954] ReplaceTablet: received request to replace tablet b3168a0cf68f4838b82266d53ad00419 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:49.943394 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 54dbfadef15548ec95e4db3725560ca9 (DEFAULT_TABLE table=default.Table_fba3e565b8074ca081727412062ab6ed [id=0a3183eb2a7d4d9ebe87627bc031f95c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.943835 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dbfadef15548ec95e4db3725560ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.946131 1165 raft_consensus.cc:385] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.946252 1165 raft_consensus.cc:740] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.946117 1275 raft_consensus.cc:493] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:49.946702 1165 consensus_queue.cc:260] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.946731 1275 raft_consensus.cc:515] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.947605 1174 log.cc:1199] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9e0fbc1ccf8344e583d34ffb2e25d4b1
I20260503 07:52:49.948310 761 tablet_service.cc:1511] Processing CreateTablet for tablet aa9153d3245f4dcfacf26f174bced2ba (DEFAULT_TABLE table=default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.948423 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (DEFAULT_TABLE table=default.Table_983dc3d67bb04a76b617811d8288d00f [id=16442f1d73a0449094fa45afffb69152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.948738 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9153d3245f4dcfacf26f174bced2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.949011 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9ff03fba3d4a1794a8a5b94caa9731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.949502 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.949620 758 tablet_service.cc:1511] Processing CreateTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f (DEFAULT_TABLE table=default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.949862 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb with delete_type TABLET_DATA_DELETED (replaced by tablet c46873d43e1b4495a92996e07f93f918) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.949981 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be381bee559841bfb90a4d2ce8c4fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.950203 753 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.950505 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.950865 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:49.951148 750 tablet_service.cc:1558] Processing DeleteTablet for tablet d7807da20d4c4b90a9e387cb72813557 with delete_type TABLET_DATA_DELETED (replaced by tablet be15f49b155746d1924868d9f91e9206) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:49.953120 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b674b3ac5a442eca15573187fd35bc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.953660 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:49.954149 1174 ts_tablet_manager.cc:1950] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:49.946703 757 tablet_service.cc:1511] Processing CreateTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 (DEFAULT_TABLE table=default.Table_54505a16234f4eedbc3dd1457f6aa6f6 [id=61ea7b42555143188666f1400ff2bfbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.956918 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fba3e565b8074ca081727412062ab6ed" } new_table_name: "default.Table_944e0955d9b24f8b87c7645170a69ed4" modify_external_catalogs: true
I20260503 07:52:49.957525 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609d01e6cdc440085a6ebdb652d54f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:49.958200 1174 tablet_replica.cc:333] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:49.958436 1174 raft_consensus.cc:2243] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.958639 1174 raft_consensus.cc:2272] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.958765 1165 ts_tablet_manager.cc:1434] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260503 07:52:49.958779 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 2 got 0
I20260503 07:52:49.959508 1174 ts_tablet_manager.cc:1916] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.958997 760 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (DEFAULT_TABLE table=default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:49.959661 715 leader_election.cc:343] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:49.959540 1165 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:49.960251 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 086c1b3968fd4ae4be703b72eaf05973 consensus state has no leader
I20260503 07:52:49.951962 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32143754b04949878e26dc9ab3b562d2" } new_table_name: "default.Table_39e289dea2d0425e8f661ed42d89b6e5" modify_external_catalogs: true
I20260503 07:52:49.961377 1275 leader_election.cc:290] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:49.961710 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086c1b3968fd4ae4be703b72eaf05973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.962971 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.965209 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:49.965898 898 tablet_service.cc:1511] Processing CreateTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.965926 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ad1a19fbb60d43148c0320ae171a2bd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.966316 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dce60ad6aea4465a4ce04ea62bceb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:49.967068 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.967814 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:49.968362 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad1a19fbb60d43148c0320ae171a2bd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.970134 896 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:49.970214 1165 tablet_bootstrap.cc:654] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:49.969795 1339 raft_consensus.cc:697] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:49.972318 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_845a0fae63eb4ef386d3e5cb6f325657"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.972797 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_845a0fae63eb4ef386d3e5cb6f325657 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.973681 1173 ts_tablet_manager.cc:1929] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:49.973814 1173 log.cc:1199] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/6eca7f88573745c5ae68fdb32cda2feb
I20260503 07:52:49.974068 1171 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:49.974179 1173 ts_tablet_manager.cc:1950] T 6eca7f88573745c5ae68fdb32cda2feb P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:49.974231 1171 ts_tablet_manager.cc:1403] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.010s
I20260503 07:52:49.964257 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.975930 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (table default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]) successfully deleted
I20260503 07:52:49.976080 1171 raft_consensus.cc:359] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.977351 1171 raft_consensus.cc:385] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:49.977515 1171 raft_consensus.cc:740] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:49.978406 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:49.978761 1171 consensus_queue.cc:260] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:49.983157 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ab17883c0da04bce9b118eed3644a137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.983363 1166 ts_tablet_manager.cc:1434] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.080s user 0.002s sys 0.000s
W20260503 07:52:49.984371 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab17883c0da04bce9b118eed3644a137 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.984889 1166 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:49.985354 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54dbfadef15548ec95e4db3725560ca9 consensus state has no leader
I20260503 07:52:49.986456 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0e917af377654c46b51e3fea73b0f06b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:49.986878 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e917af377654c46b51e3fea73b0f06b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.988423 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b21f69cb6b1340b99c5f77b579063c15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:49.988477 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 6eca7f88573745c5ae68fdb32cda2feb (table default.Table_15bde81ecc7240a6a53f23d1b6e71dd0 [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
W20260503 07:52:49.989305 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7ce867777c0e46d1af4785e667e7a18e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ce867777c0e46d1af4785e667e7a18e already in progress: creating tablet
W20260503 07:52:49.989604 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 741a28af9fe946db8c9305aa1dabe999 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 741a28af9fe946db8c9305aa1dabe999 already in progress: creating tablet
W20260503 07:52:49.992172 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b21f69cb6b1340b99c5f77b579063c15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:49.994391 1173 tablet_replica.cc:333] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:49.994582 1173 raft_consensus.cc:2243] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:49.994765 1173 raft_consensus.cc:2272] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:49.995288 1173 ts_tablet_manager.cc:1916] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:49.995525 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 6eca7f88573745c5ae68fdb32cda2feb (table default.Table_15bde81ecc7240a6a53f23d1b6e71dd0 [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
W20260503 07:52:49.995759 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d4328cceebfa466fb6f56d0ffbc09bd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4328cceebfa466fb6f56d0ffbc09bd2 already in progress: creating tablet
W20260503 07:52:49.995967 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 7ce867777c0e46d1af4785e667e7a18e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ce867777c0e46d1af4785e667e7a18e already in progress: creating tablet
I20260503 07:52:49.999495 1166 tablet_bootstrap.cc:654] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.001518 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ad5999c4e4e9408b9c8c6fe27b2dac21 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbf3231ab114ce59de775f3dcc1e8f2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.002254 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5dbe201190004e319f249657c21fad17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.002738 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dbe201190004e319f249657c21fad17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.002883 428 master_runner.cc:186] Error getting master registration for 127.0.105.61:41759: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111),
I20260503 07:52:50.003031 428 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260503 07:52:50.011883 1339 consensus_queue.cc:237] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:50.013528 1173 ts_tablet_manager.cc:1929] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.013892 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d (DEFAULT_TABLE table=default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.014271 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0e09526eb4c9ba4b47c36e741702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.015825 896 tablet_service.cc:1511] Processing CreateTablet for tablet b77c5c6954554eac970d1e3fb1387c2b (DEFAULT_TABLE table=default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.016307 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c5c6954554eac970d1e3fb1387c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.016366 750 tablet_service.cc:1511] Processing CreateTablet for tablet 54dbfadef15548ec95e4db3725560ca9 (DEFAULT_TABLE table=default.Table_fba3e565b8074ca081727412062ab6ed [id=0a3183eb2a7d4d9ebe87627bc031f95c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.016996 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dbfadef15548ec95e4db3725560ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.017984 895 tablet_service.cc:1511] Processing CreateTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde (DEFAULT_TABLE table=default.Table_72003fe7514a4b37a7d0aab39f859423 [id=d60f7489816c4a0ba96ec72d3fdfe261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.018318 893 tablet_service.cc:1511] Processing CreateTablet for tablet 96f7244292c3400dad2812e0adb162ef (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.018323 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fbd09bd319440cadcc84f1d55e7bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.019176 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.019860 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f7244292c3400dad2812e0adb162ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.025781 752 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.027593 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.027966 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e634f8f2aaf4456a64ced5049bdfe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.028281 756 tablet_service.cc:1511] Processing CreateTablet for tablet b77c5c6954554eac970d1e3fb1387c2b (DEFAULT_TABLE table=default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.028432 898 tablet_service.cc:1511] Processing CreateTablet for tablet b15b6a7760684f1b8785370065e82e77 (DEFAULT_TABLE table=default.Table_6568bda8fa9642f48f897e9baf755493 [id=5d95591c963f409394dba581d655aadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.028760 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15b6a7760684f1b8785370065e82e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.024840 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.025667 753 tablet_service.cc:1511] Processing CreateTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.033726 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d (DEFAULT_TABLE table=default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.035212 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c5c6954554eac970d1e3fb1387c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.032426 754 tablet_service.cc:1511] Processing CreateTablet for tablet b15b6a7760684f1b8785370065e82e77 (DEFAULT_TABLE table=default.Table_6568bda8fa9642f48f897e9baf755493 [id=5d95591c963f409394dba581d655aadf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:50.035885 854 consensus_peers.cc:597] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:50.041994 892 tablet_service.cc:1511] Processing CreateTablet for tablet 9336e5b80c644ebcb75455770eb45d70 (DEFAULT_TABLE table=default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.042339 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336e5b80c644ebcb75455770eb45d70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:50.045287 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b84d41bdf374871a096d1dc30dd3543 has no consensus state
I20260503 07:52:50.045605 597 master_service.cc:954] ReplaceTablet: received request to replace tablet b3168a0cf68f4838b82266d53ad00419 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.046847 896 tablet_service.cc:1511] Processing CreateTablet for tablet 89572734813f4d28846ffe38868a15c3 (DEFAULT_TABLE table=default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.046831 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9336e5b80c644ebcb75455770eb45d70 (DEFAULT_TABLE table=default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.047359 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89572734813f4d28846ffe38868a15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.056609 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0e09526eb4c9ba4b47c36e741702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.057932 748 tablet_service.cc:1511] Processing CreateTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde (DEFAULT_TABLE table=default.Table_72003fe7514a4b37a7d0aab39f859423 [id=d60f7489816c4a0ba96ec72d3fdfe261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.059301 1173 log.cc:1199] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/34b18184e1a3492888e173481fca5411
I20260503 07:52:50.059881 1165 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:50.060526 1173 ts_tablet_manager.cc:1950] T 34b18184e1a3492888e173481fca5411 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.062206 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e634f8f2aaf4456a64ced5049bdfe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.059778 752 tablet_service.cc:1511] Processing CreateTablet for tablet 89572734813f4d28846ffe38868a15c3 (DEFAULT_TABLE table=default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.058593 747 tablet_service.cc:1511] Processing CreateTablet for tablet 96f7244292c3400dad2812e0adb162ef (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.064852 1165 ts_tablet_manager.cc:1403] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.101s user 0.005s sys 0.012s
I20260503 07:52:50.065021 1166 tablet_bootstrap.cc:492] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.065160 1166 ts_tablet_manager.cc:1403] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.000s
I20260503 07:52:50.065429 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fbd09bd319440cadcc84f1d55e7bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.066040 1166 raft_consensus.cc:359] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.066229 1166 raft_consensus.cc:385] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.066294 1166 raft_consensus.cc:740] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.066517 1166 consensus_queue.cc:260] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.067121 1166 ts_tablet_manager.cc:1434] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:50.067979 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dce60ad6aea4465a4ce04ea62bceb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.069685 1173 tablet_replica.cc:333] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:50.069913 1173 raft_consensus.cc:2243] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.070158 1173 raft_consensus.cc:2272] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.070173 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 34b18184e1a3492888e173481fca5411 (table default.Table_8a0149ba551e45f8a897ba90adbf4b87 [id=de863c8c60784ebe8e9f6f89b3b95d07]) successfully deleted
I20260503 07:52:50.070734 1173 ts_tablet_manager.cc:1916] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.073222 601 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_6706232b137041bd87a007ba2091f7c6 [id=a73654d3dcae49909e766eb795334a56] alter complete (version 4)
I20260503 07:52:50.073202 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15b6a7760684f1b8785370065e82e77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:50.072537 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 136534us
I20260503 07:52:50.076592 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_553f5ec1e276434b9442fb5e2e852eaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.077860 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336e5b80c644ebcb75455770eb45d70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:50.078018 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_553f5ec1e276434b9442fb5e2e852eaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.078660 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:50.080051 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 8b84d41bdf374871a096d1dc30dd3543 (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8b84d41bdf374871a096d1dc30dd3543 has no consensus state
I20260503 07:52:50.082792 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.084759 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.074220 918 raft_consensus.cc:3060] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.086503 598 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163] alter complete (version 1)
I20260503 07:52:50.088590 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eca7f88573745c5ae68fdb32cda2feb with delete_type TABLET_DATA_DELETED (replaced by tablet c46873d43e1b4495a92996e07f93f918) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.088907 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.089126 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2919cf168bac48e5abbd261590487e8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.090718 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89572734813f4d28846ffe38868a15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.092546 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.092525 1165 raft_consensus.cc:359] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.092731 1165 raft_consensus.cc:385] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.092830 1165 raft_consensus.cc:740] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.093065 1165 consensus_queue.cc:260] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.093595 1165 ts_tablet_manager.cc:1434] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260503 07:52:50.095312 894 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.096050 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f7244292c3400dad2812e0adb162ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.098657 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a35d4033e24b95962a2acf9d19c13f with delete_type TABLET_DATA_DELETED (replaced by tablet 7b4116cc31d640ac826520b41d7d3cf9) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.098744 1174 ts_tablet_manager.cc:1929] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.101054 1296 raft_consensus.cc:493] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.101220 1296 raft_consensus.cc:515] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.101912 1296 leader_election.cc:290] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:50.102862 854 leader_election.cc:343] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d3a35d4033e24b95962a2acf9d19c13f
I20260503 07:52:50.103070 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a35d4033e24b95962a2acf9d19c13f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.103658 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 89572734813f4d28846ffe38868a15c3 (DEFAULT_TABLE table=default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:49.987356 1175 tablet_replica.cc:333] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.103878 1165 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:50.103969 1171 ts_tablet_manager.cc:1434] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.130s user 0.001s sys 0.001s
I20260503 07:52:50.104031 1175 raft_consensus.cc:2243] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.104218 1175 raft_consensus.cc:2272] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.104688 1175 ts_tablet_manager.cc:1916] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.108101 1166 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:50.007517 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.076280 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609d01e6cdc440085a6ebdb652d54f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:50.108980 1053 raft_consensus.cc:2468] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:50.109853 1166 tablet_bootstrap.cc:654] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:50.109866 851 leader_election.cc:343] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:52:50.110764 851 leader_election.cc:304] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:50.111609 1296 raft_consensus.cc:2749] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:50.099725 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (DEFAULT_TABLE table=default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.099797 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b15b6a7760684f1b8785370065e82e77 (DEFAULT_TABLE table=default.Table_6568bda8fa9642f48f897e9baf755493 [id=5d95591c963f409394dba581d655aadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.100401 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d (DEFAULT_TABLE table=default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.114693 1174 log.cc:1199] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d3a35d4033e24b95962a2acf9d19c13f
I20260503 07:52:50.116533 1171 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.100559 1361 raft_consensus.cc:493] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.100919 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b77c5c6954554eac970d1e3fb1387c2b (DEFAULT_TABLE table=default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.101413 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde (DEFAULT_TABLE table=default.Table_72003fe7514a4b37a7d0aab39f859423 [id=d60f7489816c4a0ba96ec72d3fdfe261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.101933 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 96f7244292c3400dad2812e0adb162ef (DEFAULT_TABLE table=default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.102783 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9336e5b80c644ebcb75455770eb45d70 (DEFAULT_TABLE table=default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.118162 1361 raft_consensus.cc:515] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.119064 1171 tablet_bootstrap.cc:654] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.120646 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_983dc3d67bb04a76b617811d8288d00f" } new_table_name: "default.Table_f543675c817f492697f5b4760ead2e98" modify_external_catalogs: true
I20260503 07:52:50.120922 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89572734813f4d28846ffe38868a15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.121461 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f7244292c3400dad2812e0adb162ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.121869 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c5c6954554eac970d1e3fb1387c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.122277 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fbd09bd319440cadcc84f1d55e7bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.122684 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15b6a7760684f1b8785370065e82e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.123075 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dce60ad6aea4465a4ce04ea62bceb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.123099 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6706232b137041bd87a007ba2091f7c6" } modify_external_catalogs: true
I20260503 07:52:50.123313 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6706232b137041bd87a007ba2091f7c6" } modify_external_catalogs: true
I20260503 07:52:50.123427 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0e09526eb4c9ba4b47c36e741702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.123837 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336e5b80c644ebcb75455770eb45d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.124326 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e634f8f2aaf4456a64ced5049bdfe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.124778 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_624fc879976c487b82c0e5488a4aa546" } modify_external_catalogs: true
I20260503 07:52:50.124969 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_624fc879976c487b82c0e5488a4aa546" } modify_external_catalogs: true
I20260503 07:52:50.128844 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a97bcefe82d749c2a7578520c988d3e9" } modify_external_catalogs: true
I20260503 07:52:50.129045 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a97bcefe82d749c2a7578520c988d3e9" } modify_external_catalogs: true
I20260503 07:52:50.134203 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_15bde81ecc7240a6a53f23d1b6e71dd0" } new_table_name: "default.Table_224e647d07a342829b17423ce58ec7e4" modify_external_catalogs: true
I20260503 07:52:50.136509 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dce60ad6aea4465a4ce04ea62bceb13 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.140139 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 5690198617de4f568132e24708d77418 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.144608 593 master_service.cc:954] ReplaceTablet: received request to replace tablet dfb47ec875ab44fbaa270a84224f5432 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.155243 594 master_service.cc:954] ReplaceTablet: received request to replace tablet ad5999c4e4e9408b9c8c6fe27b2dac21 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.156796 1361 leader_election.cc:290] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.159399 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.160518 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:50.162434 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_67f0dd5bb9e941f2a3cca7a8c5183450" } new_table_name: "default.Table_89a64841c9a24c769960fd2771507347" modify_external_catalogs: true
I20260503 07:52:50.165854 1173 ts_tablet_manager.cc:1929] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.166008 1173 log.cc:1199] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/934a0b41c303482daba10a7acd91fb9d
I20260503 07:52:50.166374 1173 ts_tablet_manager.cc:1950] T 934a0b41c303482daba10a7acd91fb9d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.167598 1173 tablet_replica.cc:333] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:50.167801 1173 raft_consensus.cc:2243] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.167986 1173 raft_consensus.cc:2272] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.172051 1171 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.172294 1171 ts_tablet_manager.cc:1403] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.056s user 0.027s sys 0.023s
I20260503 07:52:50.173450 1171 raft_consensus.cc:359] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.173703 1171 raft_consensus.cc:385] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.173792 1171 raft_consensus.cc:740] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.174131 1171 consensus_queue.cc:260] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.174646 1171 ts_tablet_manager.cc:1434] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:50.175258 1171 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.177330 1171 tablet_bootstrap.cc:654] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.177773 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ae34e18001ee40e8b15584b8091515f4" } modify_external_catalogs: true
I20260503 07:52:50.177975 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ae34e18001ee40e8b15584b8091515f4" } modify_external_catalogs: true
I20260503 07:52:50.179867 1175 ts_tablet_manager.cc:1929] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.180006 1175 log.cc:1199] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:50.181951 1170 consensus_queue.cc:1048] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260503 07:52:50.191107 1232 raft_consensus.cc:493] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.194446 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:50.199227 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 62884.9us
W20260503 07:52:50.200520 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 07:52:50.200968 715 consensus_peers.cc:597] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eca7f88573745c5ae68fdb32cda2feb. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:50.196046 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 85863.9us
I20260503 07:52:50.202066 1339 raft_consensus.cc:493] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.202219 1339 raft_consensus.cc:515] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.203315 1232 raft_consensus.cc:515] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.203687 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:50.204187 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b9ff03fba3d4a1794a8a5b94caa9731 consensus state has no leader
W20260503 07:52:50.203678 851 consensus_peers.cc:597] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1abbb083010f476b8a0803fabc3279bb. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:50.205168 716 leader_election.cc:304] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.205892 1174 ts_tablet_manager.cc:1950] T d3a35d4033e24b95962a2acf9d19c13f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:50.205901 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 06670a873e994cbea50627dc7eb02e0e
I20260503 07:52:50.206878 1174 tablet_replica.cc:333] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:50.207096 1174 raft_consensus.cc:2243] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.207250 1174 raft_consensus.cc:2272] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.207821 1174 ts_tablet_manager.cc:1916] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.207964 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d3a35d4033e24b95962a2acf9d19c13f (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
I20260503 07:52:50.209537 781 raft_consensus.cc:2468] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:50.209611 1170 raft_consensus.cc:2804] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:50.209717 1170 raft_consensus.cc:493] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.209821 1170 raft_consensus.cc:3060] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:50.210081 715 leader_election.cc:343] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.210682 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:50.213534 715 leader_election.cc:343] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:50.213858 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c46873d43e1b4495a92996e07f93f918 has no consensus state
I20260503 07:52:50.214252 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3b227a9ce91a4483ac9b59c1efe6f11b" } modify_external_catalogs: true
I20260503 07:52:50.214435 1232 leader_election.cc:290] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:50.214476 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3b227a9ce91a4483ac9b59c1efe6f11b" } modify_external_catalogs: true
I20260503 07:52:50.215056 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5690198617de4f568132e24708d77418
W20260503 07:52:50.215371 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26da686862f44940b13c7790e00ea3b1 has no consensus state
I20260503 07:52:50.214071 1339 leader_election.cc:290] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.215690 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5dbe201190004e319f249657c21fad17" } new_table_name: "default.Table_445f60a0e17d4c9b86de094fc0bac210" modify_external_catalogs: true
W20260503 07:52:50.216264 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 56263.5us
I20260503 07:52:50.218451 1173 ts_tablet_manager.cc:1916] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.202934 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 934a0b41c303482daba10a7acd91fb9d (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
W20260503 07:52:50.220669 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 689f9fbe38c9459b8e07b6124443f546 because the tablet was not found. No further retry: Not found: Tablet not found: 689f9fbe38c9459b8e07b6124443f546
W20260503 07:52:50.220949 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d7807da20d4c4b90a9e387cb72813557 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7807da20d4c4b90a9e387cb72813557 already in progress: creating tablet
I20260503 07:52:50.221266 599 catalog_manager.cc:6741] ReplaceTablet: tablet 5690198617de4f568132e24708d77418 deleted and replaced by tablet f1aeea6b4ead45ef82934811494cf263
I20260503 07:52:50.221705 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9aa42221ad5148b68093bbbaa4b8d871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.222869 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aa42221ad5148b68093bbbaa4b8d871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.222998 1170 raft_consensus.cc:515] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.223088 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b470d3e5308242b8979e833e01444cf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.223538 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b470d3e5308242b8979e833e01444cf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.225003 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609d01e6cdc440085a6ebdb652d54f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:50.225425 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5690198617de4f568132e24708d77418 with delete_type TABLET_DATA_DELETED (replaced by tablet f1aeea6b4ead45ef82934811494cf263) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.226111 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 06670a873e994cbea50627dc7eb02e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:50.227313 715 leader_election.cc:343] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.229388 1166 tablet_bootstrap.cc:492] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.229632 1166 ts_tablet_manager.cc:1403] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.122s user 0.009s sys 0.003s
I20260503 07:52:50.230480 1170 leader_election.cc:290] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.230779 1166 raft_consensus.cc:359] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.231055 1166 raft_consensus.cc:385] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.231245 1166 raft_consensus.cc:740] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.231585 1166 consensus_queue.cc:260] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:50.231945 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f86609fc7b4007ab4c730002918613 has no consensus state
I20260503 07:52:50.232931 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5ebfc83a66b04f3e91b9dc64f418a18a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.233408 1166 ts_tablet_manager.cc:1434] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260503 07:52:50.233525 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ebfc83a66b04f3e91b9dc64f418a18a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.233795 1166 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:50.235425 1166 tablet_bootstrap.cc:654] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.242897 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5690198617de4f568132e24708d77418 with delete_type TABLET_DATA_DELETED (replaced by tablet f1aeea6b4ead45ef82934811494cf263) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.243108 1165 tablet_bootstrap.cc:654] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.244235 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 06670a873e994cbea50627dc7eb02e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.247745 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.248402 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.247002 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_72003fe7514a4b37a7d0aab39f859423" } new_table_name: "default.Table_2c8528bc9a27424185c3afea1df39fc9" modify_external_catalogs: true
W20260503 07:52:50.260926 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65fbd09bd319440cadcc84f1d55e7bde consensus state has no leader
I20260503 07:52:50.265400 1173 ts_tablet_manager.cc:1929] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.265524 1173 log.cc:1199] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d37da070cc41438b84dc09ea74e38fe9
I20260503 07:52:50.265895 1173 ts_tablet_manager.cc:1950] T d37da070cc41438b84dc09ea74e38fe9 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.266837 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d37da070cc41438b84dc09ea74e38fe9 (table default.Table_ba1703633e274a70a5d6fbf35822d164 [id=67f31bf276cb4f49b45f2120d08840bc]) successfully deleted
I20260503 07:52:50.267932 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.268141 1361 consensus_queue.cc:1048] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260503 07:52:50.270982 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2fc55691a0234d4ba696f36f2d875131"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.271590 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fc55691a0234d4ba696f36f2d875131 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.272037 1166 tablet_bootstrap.cc:492] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.272200 1166 ts_tablet_manager.cc:1403] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.002s
I20260503 07:52:50.272884 1166 raft_consensus.cc:359] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.273138 1166 raft_consensus.cc:385] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.273255 1166 raft_consensus.cc:740] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.273589 1166 consensus_queue.cc:260] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.275163 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9a0af138fe05419dabb84e78f58b3849"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.275645 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a0af138fe05419dabb84e78f58b3849 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.277057 1356 raft_consensus.cc:493] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.277117 1166 ts_tablet_manager.cc:1434] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260503 07:52:50.277190 1356 raft_consensus.cc:515] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.278434 1278 raft_consensus.cc:493] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.278569 1278 raft_consensus.cc:515] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.279551 1278 leader_election.cc:290] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.279868 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:50.280328 1361 raft_consensus.cc:493] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.280718 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.280970 1175 ts_tablet_manager.cc:1950] T d7807da20d4c4b90a9e387cb72813557 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.282101 1175 tablet_replica.cc:333] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.283478 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609d01e6cdc440085a6ebdb652d54f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:50.283661 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:50.284013 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5690198617de4f568132e24708d77418 with delete_type TABLET_DATA_DELETED (replaced by tablet f1aeea6b4ead45ef82934811494cf263) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.284161 1361 raft_consensus.cc:515] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
W20260503 07:52:50.285362 716 consensus_peers.cc:597] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c37459b741904a8696064201992d4591. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:50.285354 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b27d2d45e739451ba9c47687239cfbf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.285570 986 leader_election.cc:304] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:52:50.285786 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 74508.4us
W20260503 07:52:50.285817 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b27d2d45e739451ba9c47687239cfbf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.287634 1356 leader_election.cc:290] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.288069 1052 raft_consensus.cc:3060] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.288707 1175 raft_consensus.cc:2243] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.290547 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f3a50cbc4bd349d4aa11b4d846565f79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.290953 1052 raft_consensus.cc:2468] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:50.291218 1051 raft_consensus.cc:2468] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:52:50.291518 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3a50cbc4bd349d4aa11b4d846565f79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:50.291554 988 leader_election.cc:343] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.291839 1053 raft_consensus.cc:2468] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:50.292908 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_0f1b5e9a0c4846f880cb398a6ada413c [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
I20260503 07:52:50.293166 1278 raft_consensus.cc:2804] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:52:50.293283 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet be381bee559841bfb90a4d2ce8c4fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be381bee559841bfb90a4d2ce8c4fa5f already in progress: creating tablet
I20260503 07:52:50.293475 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4328cceebfa466fb6f56d0ffbc09bd2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:50.293533 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b77c5c6954554eac970d1e3fb1387c2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c5c6954554eac970d1e3fb1387c2b already in progress: creating tablet
I20260503 07:52:50.293653 1278 raft_consensus.cc:493] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.293704 918 raft_consensus.cc:2468] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:50.293748 1278 raft_consensus.cc:3060] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.294041 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9030916bd2e04c08b07f568123eead02" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:50.294389 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:50.296427 1361 leader_election.cc:290] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.296550 1175 raft_consensus.cc:2272] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.296718 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 06670a873e994cbea50627dc7eb02e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.296836 892 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 (DEFAULT_TABLE table=default.Table_b21f69cb6b1340b99c5f77b579063c15 [id=b7e5a7a0b554425daa66dd715b18adf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.296912 598 catalog_manager.cc:5671] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:50.297255 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac84e88ebe478fb6200bb5052a8f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.297269 1175 ts_tablet_manager.cc:1916] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.301689 988 leader_election.cc:304] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters:
W20260503 07:52:50.301873 988 raft_consensus.cc:2686] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260503 07:52:50.302083 988 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:50.302279 988 leader_election.cc:343] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.302863 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 (DEFAULT_TABLE table=default.Table_b21f69cb6b1340b99c5f77b579063c15 [id=b7e5a7a0b554425daa66dd715b18adf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.303362 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac84e88ebe478fb6200bb5052a8f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.310402 1166 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:50.310499 1175 ts_tablet_manager.cc:1929] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.310655 1175 log.cc:1199] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d4328cceebfa466fb6f56d0ffbc09bd2
I20260503 07:52:50.311017 1175 ts_tablet_manager.cc:1950] T d4328cceebfa466fb6f56d0ffbc09bd2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.312521 1278 raft_consensus.cc:515] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.312713 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d4328cceebfa466fb6f56d0ffbc09bd2 (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
I20260503 07:52:50.313365 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc
I20260503 07:52:50.313697 1278 leader_election.cc:290] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.314110 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cb0d3dedda9548889d35745848bf96df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.314255 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:50.314582 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb0d3dedda9548889d35745848bf96df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:50.314756 988 leader_election.cc:343] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.316954 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8c4ec79454524d468c76fd01dec8eb1e
I20260503 07:52:50.317482 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 295cfe6e7a7043b2905a6e90dd520002 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.317934 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4328cceebfa466fb6f56d0ffbc09bd2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.318114 780 raft_consensus.cc:2468] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:50.319772 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5dce60ad6aea4465a4ce04ea62bceb13
I20260503 07:52:50.320214 596 catalog_manager.cc:6741] ReplaceTablet: tablet 5dce60ad6aea4465a4ce04ea62bceb13 deleted and replaced by tablet c5765ff6b70046f6a46aab3f413d04f8
I20260503 07:52:50.320328 1173 tablet_replica.cc:333] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:50.320497 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1e8536bf4e404f39921bdfc455bf5128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.320947 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e8536bf4e404f39921bdfc455bf5128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.321026 1173 raft_consensus.cc:2243] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:50.321323 1173 pending_rounds.cc:70] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Trying to abort 1 pending ops.
I20260503 07:52:50.321398 1173 pending_rounds.cc:77] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847373804326912 op_type: NO_OP noop_request { }
I20260503 07:52:50.321487 1173 raft_consensus.cc:2889] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:50.321585 1173 raft_consensus.cc:2272] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.322114 1173 ts_tablet_manager.cc:1916] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:50.320358 716 consensus_peers.cc:597] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eca7f88573745c5ae68fdb32cda2feb. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:50.323619 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.323830 891 tablet_service.cc:1511] Processing CreateTablet for tablet b0f7b07d945c4726a77578987c22415d (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.323829 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:50.323952 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.324080 778 raft_consensus.cc:3060] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.324149 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.324259 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f7b07d945c4726a77578987c22415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.325006 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b0f7b07d945c4726a77578987c22415d (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.325387 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f7b07d945c4726a77578987c22415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.327028 778 raft_consensus.cc:2468] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:50.327308 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.327535 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.328085 716 leader_election.cc:304] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.328426 898 tablet_service.cc:1511] Processing CreateTablet for tablet ef0ad3ee6d1445b28ffc55ba93d57901 (DEFAULT_TABLE table=default.Table_25c8bea5fd104c3290fb7ab34e3e7286 [id=f3983bdc7d804aa9b0abe2ae267dc049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.328456 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ef0ad3ee6d1445b28ffc55ba93d57901 (DEFAULT_TABLE table=default.Table_25c8bea5fd104c3290fb7ab34e3e7286 [id=f3983bdc7d804aa9b0abe2ae267dc049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.328514 716 leader_election.cc:304] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.328765 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0ad3ee6d1445b28ffc55ba93d57901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.328847 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0ad3ee6d1445b28ffc55ba93d57901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.328900 716 leader_election.cc:304] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.329226 1275 raft_consensus.cc:2804] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:50.329376 1275 raft_consensus.cc:697] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:50.329630 1275 consensus_queue.cc:237] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.330857 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.331029 1355 raft_consensus.cc:2764] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260503 07:52:50.331189 1355 raft_consensus.cc:2804] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:50.331274 1355 raft_consensus.cc:493] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.331351 1355 raft_consensus.cc:3060] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.334059 1355 raft_consensus.cc:515] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.334642 1355 leader_election.cc:290] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.335196 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:50.336334 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:50.336530 1053 raft_consensus.cc:3060] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.339954 1053 raft_consensus.cc:2468] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
W20260503 07:52:50.341171 715 leader_election.cc:343] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.341413 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.346359 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.347285 1166 tablet_bootstrap.cc:654] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.348845 1171 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.348984 1171 ts_tablet_manager.cc:1403] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.174s user 0.012s sys 0.023s
I20260503 07:52:50.349733 1171 raft_consensus.cc:359] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.349902 1171 raft_consensus.cc:385] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.349990 1171 raft_consensus.cc:740] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:50.350404 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 already in progress: creating tablet
I20260503 07:52:50.350867 1175 tablet_replica.cc:333] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.351083 1175 raft_consensus.cc:2243] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.351287 1175 raft_consensus.cc:2272] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.351807 1175 ts_tablet_manager.cc:1916] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:50.356328 986 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9030916bd2e04c08b07f568123eead02
I20260503 07:52:50.356448 986 leader_election.cc:304] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:50.356683 986 raft_consensus.cc:2686] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:50.356915 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:50.357357 892 tablet_service.cc:1511] Processing CreateTablet for tablet f1f86609fc7b4007ab4c730002918613 (DEFAULT_TABLE table=default.Table_445f60a0e17d4c9b86de094fc0bac210 [id=c59922f427b140b09953451892a84c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.357785 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f86609fc7b4007ab4c730002918613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.357813 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f1f86609fc7b4007ab4c730002918613 (DEFAULT_TABLE table=default.Table_445f60a0e17d4c9b86de094fc0bac210 [id=c59922f427b140b09953451892a84c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.358141 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f86609fc7b4007ab4c730002918613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.364773 1171 consensus_queue.cc:260] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.366868 986 leader_election.cc:304] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.367334 1278 raft_consensus.cc:2804] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:50.367475 1278 raft_consensus.cc:697] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:50.367750 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:50.367764 1278 consensus_queue.cc:237] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.368247 593 catalog_manager.cc:6741] ReplaceTablet: tablet dfb47ec875ab44fbaa270a84224f5432 deleted and replaced by tablet 77fa106f0cc24a35bd23b457660a45dc
I20260503 07:52:50.370733 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1498486dd3db414c8062cba2d54037bb (DEFAULT_TABLE table=default.Table_845a0fae63eb4ef386d3e5cb6f325657 [id=45fb2a411f3f45c4867a240018396066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.371258 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1498486dd3db414c8062cba2d54037bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.374303 898 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.374689 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0481b55721854d70a670a79ff2f42dd6 (DEFAULT_TABLE table=default.Table_ad1a19fbb60d43148c0320ae171a2bd4 [id=0fbceb4c0fd74bb0a162136215a4a5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.375025 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0481b55721854d70a670a79ff2f42dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.376842 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 1609d01e6cdc440085a6ebdb652d54f1 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.378556 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 96f7244292c3400dad2812e0adb162ef
I20260503 07:52:50.380462 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0481b55721854d70a670a79ff2f42dd6 (DEFAULT_TABLE table=default.Table_ad1a19fbb60d43148c0320ae171a2bd4 [id=0fbceb4c0fd74bb0a162136215a4a5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.380882 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0481b55721854d70a670a79ff2f42dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.381402 1171 ts_tablet_manager.cc:1434] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260503 07:52:50.383852 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:50.384408 600 catalog_manager.cc:6741] ReplaceTablet: tablet 295cfe6e7a7043b2905a6e90dd520002 deleted and replaced by tablet 75dfcff75f90434caf7dc26408958a16
I20260503 07:52:50.385576 748 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 (DEFAULT_TABLE table=default.Table_b21f69cb6b1340b99c5f77b579063c15 [id=b7e5a7a0b554425daa66dd715b18adf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.385983 716 leader_election.cc:304] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.386292 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d7807da20d4c4b90a9e387cb72813557 with delete_type TABLET_DATA_DELETED (replaced by tablet be15f49b155746d1924868d9f91e9206) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.386512 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.386559 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.386711 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 with delete_type TABLET_DATA_DELETED (replaced by tablet 75dfcff75f90434caf7dc26408958a16) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.387679 894 tablet_service.cc:1558] Processing DeleteTablet for tablet d4328cceebfa466fb6f56d0ffbc09bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.387930 898 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb47ec875ab44fbaa270a84224f5432 with delete_type TABLET_DATA_DELETED (replaced by tablet 77fa106f0cc24a35bd23b457660a45dc) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.388374 1165 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:50.352001 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51494da361814bf1917182ed2952e28d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.389858 898 tablet_service.cc:1511] Processing CreateTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (DEFAULT_TABLE table=default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.390210 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1b61a2548e4f3fafb4ed0982dbd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.392004 1171 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.392966 892 tablet_service.cc:1511] Processing CreateTablet for tablet 1498486dd3db414c8062cba2d54037bb (DEFAULT_TABLE table=default.Table_845a0fae63eb4ef386d3e5cb6f325657 [id=45fb2a411f3f45c4867a240018396066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.394215 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1498486dd3db414c8062cba2d54037bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.394889 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb47ec875ab44fbaa270a84224f5432 with delete_type TABLET_DATA_DELETED (replaced by tablet 77fa106f0cc24a35bd23b457660a45dc) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.397634 755 tablet_service.cc:1511] Processing CreateTablet for tablet b0f7b07d945c4726a77578987c22415d (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.398653 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.399530 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.399809 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 with delete_type TABLET_DATA_DELETED (replaced by tablet 75dfcff75f90434caf7dc26408958a16) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.400115 1166 tablet_bootstrap.cc:492] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.400358 1166 ts_tablet_manager.cc:1403] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.002s
I20260503 07:52:50.401391 1166 raft_consensus.cc:359] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.401777 1166 raft_consensus.cc:385] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.401925 1166 raft_consensus.cc:740] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.402246 1166 consensus_queue.cc:260] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.402877 1166 ts_tablet_manager.cc:1434] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:50.408862 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_55b67f5ddfbe488193eb35cb1ffc8cb6" } new_table_name: "default.Table_86865dc38b714cffba0b12cff2f8f53b" modify_external_catalogs: true
I20260503 07:52:50.409212 1025 tablet_service.cc:1511] Processing CreateTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (DEFAULT_TABLE table=default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.409708 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1b61a2548e4f3fafb4ed0982dbd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.409016 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:50.416976 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9457d5693eb4f3da5501a0e581fe75c consensus state has no leader
I20260503 07:52:50.419227 1173 ts_tablet_manager.cc:1929] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:50.419371 1173 log.cc:1199] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/1abbb083010f476b8a0803fabc3279bb
I20260503 07:52:50.419911 1173 ts_tablet_manager.cc:1950] T 1abbb083010f476b8a0803fabc3279bb P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.420887 898 tablet_service.cc:1511] Processing CreateTablet for tablet c46873d43e1b4495a92996e07f93f918 (DEFAULT_TABLE table=default.Table_224e647d07a342829b17423ce58ec7e4 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.421252 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7436651c1ee44f6dbe12eecbc8b59d66" } new_table_name: "default.Table_0b06a748faa64b029ec876cdcfc0478f" modify_external_catalogs: true
I20260503 07:52:50.421620 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c46873d43e1b4495a92996e07f93f918 (DEFAULT_TABLE table=default.Table_224e647d07a342829b17423ce58ec7e4 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.422101 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46873d43e1b4495a92996e07f93f918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.422827 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f1b5e9a0c4846f880cb398a6ada413c" } new_table_name: "default.Table_bcef633acbb44764bf85c66781243af3" modify_external_catalogs: true
I20260503 07:52:50.425339 1166 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:50.427057 1166 tablet_bootstrap.cc:654] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.427600 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 2 got 0
I20260503 07:52:50.428568 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9aa42221ad5148b68093bbbaa4b8d871" } modify_external_catalogs: true
I20260503 07:52:50.428740 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9aa42221ad5148b68093bbbaa4b8d871" } modify_external_catalogs: true
I20260503 07:52:50.432214 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 2 got 0
I20260503 07:52:50.433425 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_38707bcc12834fb29510bca7a6c43e0c" } new_table_name: "default.Table_1aac057d4a974996afb3c2032a540e90" modify_external_catalogs: true
I20260503 07:52:50.434682 1171 tablet_bootstrap.cc:654] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.435681 595 master_service.cc:954] ReplaceTablet: received request to replace tablet d3a35d4033e24b95962a2acf9d19c13f from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.440936 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46873d43e1b4495a92996e07f93f918. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:50.441184 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4d8dfc410a40ec825d8e45e07388f6 consensus state has no leader
I20260503 07:52:50.444718 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 (DEFAULT_TABLE table=default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.445096 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd0b6afae47432e9da300ba07e970e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.445266 892 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 (DEFAULT_TABLE table=default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.446080 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd0b6afae47432e9da300ba07e970e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.447424 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 1abbb083010f476b8a0803fabc3279bb (table default.Table_335f08e1f80641eaab02a7b35c11abdd [id=93569fdb8e904b4287c7a152a99829ae]) successfully deleted
I20260503 07:52:50.447801 1173 tablet_replica.cc:333] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:52:50.447964 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet be381bee559841bfb90a4d2ce8c4fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be381bee559841bfb90a4d2ce8c4fa5f already in progress: creating tablet
W20260503 07:52:50.448263 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b77c5c6954554eac970d1e3fb1387c2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c5c6954554eac970d1e3fb1387c2b already in progress: creating tablet
W20260503 07:52:50.448534 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 already in progress: creating tablet
I20260503 07:52:50.449658 595 catalog_manager.cc:5671] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:50.450057 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 2 got 0
I20260503 07:52:50.450450 1173 raft_consensus.cc:2243] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.450609 1173 raft_consensus.cc:2272] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.451078 1173 ts_tablet_manager.cc:1916] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.451465 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1e38efcdb18e448da420a2bac887722e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.452016 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e38efcdb18e448da420a2bac887722e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.453212 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2e55a33b7465440fa8d8514ad988f3dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.453652 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e55a33b7465440fa8d8514ad988f3dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.455819 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_697c8786165a446eb850b52821a12e95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.456303 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_697c8786165a446eb850b52821a12e95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.460738 1235 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:50.462183 599 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 3dd8a3f9148245bca1e1afe51b1578ec
W20260503 07:52:50.464044 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be15f49b155746d1924868d9f91e9206 consensus state has no leader
I20260503 07:52:50.467514 1175 ts_tablet_manager.cc:1929] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.467644 1175 log.cc:1199] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9030916bd2e04c08b07f568123eead02
I20260503 07:52:50.468030 1175 ts_tablet_manager.cc:1950] T 9030916bd2e04c08b07f568123eead02 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.468912 1173 ts_tablet_manager.cc:1929] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.468961 1175 tablet_replica.cc:333] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.469156 1175 raft_consensus.cc:2243] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.469328 1175 raft_consensus.cc:2272] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.469543 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 (DEFAULT_TABLE table=default.Table_ab17883c0da04bce9b118eed3644a137 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.469991 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11c020bd0484adfa6d7dae67818f7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.470736 1175 ts_tablet_manager.cc:1916] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.474382 1173 log.cc:1199] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ad5999c4e4e9408b9c8c6fe27b2dac21
I20260503 07:52:50.474996 1173 ts_tablet_manager.cc:1950] T ad5999c4e4e9408b9c8c6fe27b2dac21 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.476784 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ad5999c4e4e9408b9c8c6fe27b2dac21 (table default.Table_f389f4d06f6d413c997b931a58167f84 [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:50.476842 1173 tablet_replica.cc:333] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:50.477029 1173 raft_consensus.cc:2243] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.477214 1173 raft_consensus.cc:2272] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:50.477288 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6eca7f88573745c5ae68fdb32cda2feb because the tablet was not found. No further retry: Not found: Tablet not found: 6eca7f88573745c5ae68fdb32cda2feb
I20260503 07:52:50.477697 1173 ts_tablet_manager.cc:1916] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.478787 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 26da686862f44940b13c7790e00ea3b1 (DEFAULT_TABLE table=default.Table_89a64841c9a24c769960fd2771507347 [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.479214 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26da686862f44940b13c7790e00ea3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.481429 1278 raft_consensus.cc:493] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.482076 1278 raft_consensus.cc:515] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.482635 1166 tablet_bootstrap.cc:492] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.482863 1278 leader_election.cc:290] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.483304 1166 ts_tablet_manager.cc:1403] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.002s
I20260503 07:52:50.483395 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:50.484112 988 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.485641 1166 raft_consensus.cc:359] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:50.486002 1166 raft_consensus.cc:385] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.486131 1166 raft_consensus.cc:740] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.486480 1166 consensus_queue.cc:260] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:50.486619 1165 ts_tablet_manager.cc:1403] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.291s user 0.001s sys 0.020s
I20260503 07:52:50.487166 1232 raft_consensus.cc:2804] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:50.487334 1232 raft_consensus.cc:697] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:50.487637 1232 consensus_queue.cc:237] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.488708 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac84e88ebe478fb6200bb5052a8f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.488955 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f7b07d945c4726a77578987c22415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.489848 751 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.490238 756 tablet_service.cc:1511] Processing CreateTablet for tablet ef0ad3ee6d1445b28ffc55ba93d57901 (DEFAULT_TABLE table=default.Table_25c8bea5fd104c3290fb7ab34e3e7286 [id=f3983bdc7d804aa9b0abe2ae267dc049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.490450 1166 ts_tablet_manager.cc:1434] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:52:50.491549 1170 raft_consensus.cc:493] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.492575 1173 ts_tablet_manager.cc:1929] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.494944 1166 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:50.496634 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 45911.3us
I20260503 07:52:50.498637 1170 raft_consensus.cc:515] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.498867 1166 tablet_bootstrap.cc:654] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.499292 1170 leader_election.cc:290] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.499845 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d799ca2780461b89ced316e9f3ac92" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:50.500038 1175 ts_tablet_manager.cc:1929] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.500198 1175 log.cc:1199] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/51494da361814bf1917182ed2952e28d
I20260503 07:52:50.501842 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0ad3ee6d1445b28ffc55ba93d57901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.501794 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d799ca2780461b89ced316e9f3ac92" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:50.502018 1053 raft_consensus.cc:2468] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:52:50.504863 715 leader_election.cc:343] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.505416 751 tablet_service.cc:1511] Processing CreateTablet for tablet f1f86609fc7b4007ab4c730002918613 (DEFAULT_TABLE table=default.Table_445f60a0e17d4c9b86de094fc0bac210 [id=c59922f427b140b09953451892a84c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.505399 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (DEFAULT_TABLE table=default.Table_820b52ee7a3945ae93798523632b0fdf [id=1e683140a3b240e5afeb636098fc51bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.505875 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e9b97fafa145e0a45e4d81fc9d5947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.506389 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1498486dd3db414c8062cba2d54037bb (DEFAULT_TABLE table=default.Table_845a0fae63eb4ef386d3e5cb6f325657 [id=45fb2a411f3f45c4867a240018396066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.507843 898 tablet_service.cc:1511] Processing CreateTablet for tablet 26da686862f44940b13c7790e00ea3b1 (DEFAULT_TABLE table=default.Table_89a64841c9a24c769960fd2771507347 [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.508242 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26da686862f44940b13c7790e00ea3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.508476 1165 raft_consensus.cc:359] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.510983 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0481b55721854d70a670a79ff2f42dd6 (DEFAULT_TABLE table=default.Table_ad1a19fbb60d43148c0320ae171a2bd4 [id=0fbceb4c0fd74bb0a162136215a4a5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.511236 1173 log.cc:1199] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9e0fbc1ccf8344e583d34ffb2e25d4b1
I20260503 07:52:50.511489 752 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb47ec875ab44fbaa270a84224f5432 with delete_type TABLET_DATA_DELETED (replaced by tablet 77fa106f0cc24a35bd23b457660a45dc) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.511965 1173 ts_tablet_manager.cc:1950] T 9e0fbc1ccf8344e583d34ffb2e25d4b1 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:50.511631 897 tablet_service.cc:1511] Processing CreateTablet for tablet be15f49b155746d1924868d9f91e9206 (DEFAULT_TABLE table=default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.511260 896 tablet_service.cc:1511] Processing CreateTablet for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (DEFAULT_TABLE table=default.Table_820b52ee7a3945ae93798523632b0fdf [id=1e683140a3b240e5afeb636098fc51bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.512957 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be15f49b155746d1924868d9f91e9206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.513393 1173 tablet_replica.cc:333] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:50.513886 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9e0fbc1ccf8344e583d34ffb2e25d4b1 (table default.Table_d603048462fb48e1a3b3e598a27578c9 [id=a2a1fba0bc324d26876b9076115819a6]) successfully deleted
I20260503 07:52:50.516023 1174 ts_tablet_manager.cc:1929] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.516204 1235 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:50.516671 1174 log.cc:1199] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/2919cf168bac48e5abbd261590487e8f
I20260503 07:52:50.516893 752 tablet_service.cc:1511] Processing CreateTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (DEFAULT_TABLE table=default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.516935 1235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:52:50.517160 1174 ts_tablet_manager.cc:1950] T 2919cf168bac48e5abbd261590487e8f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:50.510897 716 leader_election.cc:304] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:50.517609 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c00976f3444c43618af30259f0567d17 (DEFAULT_TABLE table=default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.517921 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f86609fc7b4007ab4c730002918613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.517995 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00976f3444c43618af30259f0567d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.517844 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 (DEFAULT_TABLE table=default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.518529 1170 raft_consensus.cc:2804] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:50.518644 1170 raft_consensus.cc:493] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.519945 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.520219 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.520248 1170 raft_consensus.cc:3060] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.520977 1173 raft_consensus.cc:2243] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.521189 1173 raft_consensus.cc:2272] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.522058 895 tablet_service.cc:1511] Processing CreateTablet for tablet f407467a0c9c406faaa657ce70a1028b (DEFAULT_TABLE table=default.Table_38707bcc12834fb29510bca7a6c43e0c [id=2d52f50c360c42b9a8e1d679998e3478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.522498 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e9b97fafa145e0a45e4d81fc9d5947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.523518 1170 raft_consensus.cc:515] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.525188 753 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 (DEFAULT_TABLE table=default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.527698 1165 raft_consensus.cc:385] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.527806 1165 raft_consensus.cc:740] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.529047 758 tablet_service.cc:1511] Processing CreateTablet for tablet c00976f3444c43618af30259f0567d17 (DEFAULT_TABLE table=default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.529477 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f407467a0c9c406faaa657ce70a1028b (DEFAULT_TABLE table=default.Table_38707bcc12834fb29510bca7a6c43e0c [id=2d52f50c360c42b9a8e1d679998e3478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.529760 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1b61a2548e4f3fafb4ed0982dbd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.530205 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 (DEFAULT_TABLE table=default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.531401 1171 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.533748 760 tablet_service.cc:1511] Processing CreateTablet for tablet 26da686862f44940b13c7790e00ea3b1 (DEFAULT_TABLE table=default.Table_89a64841c9a24c769960fd2771507347 [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.534458 744 tablet_service.cc:1511] Processing CreateTablet for tablet be15f49b155746d1924868d9f91e9206 (DEFAULT_TABLE table=default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.535948 761 tablet_service.cc:1511] Processing CreateTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 (DEFAULT_TABLE table=default.Table_ab17883c0da04bce9b118eed3644a137 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.536325 1165 consensus_queue.cc:260] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.536916 1165 ts_tablet_manager.cc:1434] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.050s user 0.000s sys 0.002s
I20260503 07:52:50.537061 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 with delete_type TABLET_DATA_DELETED (replaced by tablet 75dfcff75f90434caf7dc26408958a16) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.537339 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d799ca2780461b89ced316e9f3ac92" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:50.537361 754 tablet_service.cc:1511] Processing CreateTablet for tablet c46873d43e1b4495a92996e07f93f918 (DEFAULT_TABLE table=default.Table_224e647d07a342829b17423ce58ec7e4 [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.537534 1053 raft_consensus.cc:3060] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.537791 1025 tablet_service.cc:1511] Processing CreateTablet for tablet be15f49b155746d1924868d9f91e9206 (DEFAULT_TABLE table=default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.538297 1171 ts_tablet_manager.cc:1403] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.150s user 0.007s sys 0.005s
I20260503 07:52:50.540903 1053 raft_consensus.cc:2468] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:50.541186 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b84d41bdf374871a096d1dc30dd3543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.541471 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f407467a0c9c406faaa657ce70a1028b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.541766 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be15f49b155746d1924868d9f91e9206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.544835 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e (DEFAULT_TABLE table=default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.545184 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4ec79454524d468c76fd01dec8eb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.551614 1032 tablet_service.cc:1511] Processing CreateTablet for tablet dda159becff6466abdcd84193f40a65e (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.551947 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda159becff6466abdcd84193f40a65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.552706 1165 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:50.552742 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b84d41bdf374871a096d1dc30dd3543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.552966 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd0b6afae47432e9da300ba07e970e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.553028 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.553784 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00976f3444c43618af30259f0567d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.554951 1165 tablet_bootstrap.cc:654] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.553136 745 tablet_service.cc:1511] Processing CreateTablet for tablet f407467a0c9c406faaa657ce70a1028b (DEFAULT_TABLE table=default.Table_38707bcc12834fb29510bca7a6c43e0c [id=2d52f50c360c42b9a8e1d679998e3478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.555272 1170 leader_election.cc:290] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.557968 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b8ad59be3a314aa6add6938852b18b80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.558158 750 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 (DEFAULT_TABLE table=default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:50.558522 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8ad59be3a314aa6add6938852b18b80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.555009 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 95) took 1049 ms. Trace:
I20260503 07:52:50.559410 892 tablet_service.cc:1511] Processing CreateTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 (DEFAULT_TABLE table=default.Table_ab17883c0da04bce9b118eed3644a137 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.560074 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_91536c63cda14993a1239c5b47af0f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.560606 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91536c63cda14993a1239c5b47af0f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.560950 894 tablet_service.cc:1511] Processing CreateTablet for tablet c00976f3444c43618af30259f0567d17 (DEFAULT_TABLE table=default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.562203 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 (DEFAULT_TABLE table=default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.562340 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_224e647d07a342829b17423ce58ec7e4" } new_table_name: "default.Table_fa9fc162a5f0431a9e07ae11cb3308af" modify_external_catalogs: true
I20260503 07:52:50.562906 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f407467a0c9c406faaa657ce70a1028b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.563261 1173 ts_tablet_manager.cc:1916] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.563706 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_871580894503440db95b41b028601fae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.565253 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_871580894503440db95b41b028601fae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.566962 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2366a5c6383a445a94641d3de6d15462"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.567435 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2366a5c6383a445a94641d3de6d15462 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.568970 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b84d41bdf374871a096d1dc30dd3543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.570905 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 (DEFAULT_TABLE table=default.Table_c3a5f74835a5418b947a72d7eafd9b70 [id=7f8470e7e307465b8eb6fa6b1b5bf94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.571329 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0f650d2efd4a5d9308952b32fa7d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.571087 1171 raft_consensus.cc:359] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.574491 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d799ca2780461b89ced316e9f3ac92" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:50.574925 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00976f3444c43618af30259f0567d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.577656 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26da686862f44940b13c7790e00ea3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.577999 1175 ts_tablet_manager.cc:1950] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.578394 1171 raft_consensus.cc:385] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.578626 1171 raft_consensus.cc:740] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.580963 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 51494da361814bf1917182ed2952e28d (table default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]) successfully deleted
I20260503 07:52:50.581396 1171 consensus_queue.cc:260] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.583156 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 (DEFAULT_TABLE table=default.Table_9d94a78c3c464465aa79a1b009d68b53 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.583766 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 (DEFAULT_TABLE table=default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.578999 1174 rpcz_store.cc:276] 0503 07:52:49.477246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.477726 (+ 480us) service_pool.cc:224] Handling call
0503 07:52:50.206804 (+729078us) ts_tablet_manager.cc:1151] Deleting tablet 2919cf168bac48e5abbd261590487e8f
0503 07:52:50.206816 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:50.278391 (+ 71575us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:50.515939 (+237548us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:50.526658 (+ 10719us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":728899}
I20260503 07:52:50.586689 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46873d43e1b4495a92996e07f93f918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.586692 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 2919cf168bac48e5abbd261590487e8f (table default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]) successfully deleted
I20260503 07:52:50.586886 1175 tablet_replica.cc:333] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.587062 1175 raft_consensus.cc:2243] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.586412 1171 ts_tablet_manager.cc:1434] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.048s user 0.004s sys 0.000s
I20260503 07:52:50.587553 716 leader_election.cc:304] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:50.587710 1175 raft_consensus.cc:2272] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.590420 893 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 (DEFAULT_TABLE table=default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:50.590951 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f407467a0c9c406faaa657ce70a1028b consensus state has no leader
I20260503 07:52:50.592092 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e (DEFAULT_TABLE table=default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.592487 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11c020bd0484adfa6d7dae67818f7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.592576 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a0af138fe05419dabb84e78f58b3849" } modify_external_catalogs: true
I20260503 07:52:50.592775 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a0af138fe05419dabb84e78f58b3849" } modify_external_catalogs: true
I20260503 07:52:50.593154 746 tablet_service.cc:1511] Processing CreateTablet for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (DEFAULT_TABLE table=default.Table_820b52ee7a3945ae93798523632b0fdf [id=1e683140a3b240e5afeb636098fc51bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.599117 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c6d9dd87646ed9d1f86761f13f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.597205 889 tablet_service.cc:1511] Processing CreateTablet for tablet dda159becff6466abdcd84193f40a65e (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.603796 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4ec79454524d468c76fd01dec8eb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.603888 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 92) took 1109 ms. Trace:
I20260503 07:52:50.604003 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb2ad7619a4a9aabe8b8d062455390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.604703 781 raft_consensus.cc:2468] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:50.604004 1174 rpcz_store.cc:276] 0503 07:52:49.476894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.478172 (+ 1278us) service_pool.cc:224] Handling call
0503 07:52:50.586359 (+1108187us) ts_tablet_manager.cc:1151] Deleting tablet 34b18184e1a3492888e173481fca5411
0503 07:52:50.586372 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:50.586456 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108009}
I20260503 07:52:50.606509 986 leader_election.cc:304] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:50.606614 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 34b18184e1a3492888e173481fca5411 because the tablet was not found. No further retry: Not found: Tablet not found: 34b18184e1a3492888e173481fca5411
I20260503 07:52:50.606666 1232 raft_consensus.cc:2804] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:50.606964 986 leader_election.cc:304] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:50.607184 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0481b55721854d70a670a79ff2f42dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.607389 1175 ts_tablet_manager.cc:1916] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.607712 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb2ad7619a4a9aabe8b8d062455390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.609051 887 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 (DEFAULT_TABLE table=default.Table_9d94a78c3c464465aa79a1b009d68b53 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.609968 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb2ad7619a4a9aabe8b8d062455390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.611337 1278 raft_consensus.cc:2804] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:50.612046 1278 raft_consensus.cc:493] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.612100 1171 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.614708 1278 raft_consensus.cc:3060] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:50.615512 986 raft_consensus.cc:2686] T 51494da361814bf1917182ed2952e28d P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:50.615701 743 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e (DEFAULT_TABLE table=default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.616290 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be15f49b155746d1924868d9f91e9206. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:50.617623 715 leader_election.cc:343] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.619354 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1498486dd3db414c8062cba2d54037bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.624541 1232 raft_consensus.cc:697] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:50.626385 1174 tablet_replica.cc:333] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:50.626596 1174 raft_consensus.cc:2243] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.626788 1174 raft_consensus.cc:2272] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.627425 1174 ts_tablet_manager.cc:1916] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.627602 741 tablet_service.cc:1511] Processing CreateTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 (DEFAULT_TABLE table=default.Table_c3a5f74835a5418b947a72d7eafd9b70 [id=7f8470e7e307465b8eb6fa6b1b5bf94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.628834 1166 tablet_bootstrap.cc:492] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:50.629160 1166 ts_tablet_manager.cc:1403] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.135s user 0.020s sys 0.016s
W20260503 07:52:50.629204 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 46159.3us
I20260503 07:52:50.632275 1278 raft_consensus.cc:515] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.634265 1278 leader_election.cc:290] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:50.636619 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:50.642496 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0" } modify_external_catalogs: true
I20260503 07:52:50.642709 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0" } modify_external_catalogs: true
I20260503 07:52:50.644332 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8565e6d58b664553ac2eca8f6809fd77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.644889 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8565e6d58b664553ac2eca8f6809fd77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.647593 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_25b08e2755f24392a139c1de3502e83c" } modify_external_catalogs: true
I20260503 07:52:50.647801 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_25b08e2755f24392a139c1de3502e83c" } modify_external_catalogs: true
I20260503 07:52:50.632706 888 tablet_service.cc:1511] Processing CreateTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 (DEFAULT_TABLE table=default.Table_c3a5f74835a5418b947a72d7eafd9b70 [id=7f8470e7e307465b8eb6fa6b1b5bf94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.651684 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f7a7f9d12ac04700b8fd3dc35af1591b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.652228 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7a7f9d12ac04700b8fd3dc35af1591b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:50.653524 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c46873d43e1b4495a92996e07f93f918 consensus state has no leader
I20260503 07:52:50.654387 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ad1a19fbb60d43148c0320ae171a2bd4" } new_table_name: "default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5" modify_external_catalogs: true
I20260503 07:52:50.655891 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_445f60a0e17d4c9b86de094fc0bac210" } new_table_name: "default.Table_3efaa3d37a9d40288239aa540e6b44d6" modify_external_catalogs: true
I20260503 07:52:50.657320 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a33e9be9e212414fa02ff5ca89a05939"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.657915 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a33e9be9e212414fa02ff5ca89a05939 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.661437 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b06a748faa64b029ec876cdcfc0478f" } modify_external_catalogs: true
I20260503 07:52:50.661665 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b06a748faa64b029ec876cdcfc0478f" } modify_external_catalogs: true
I20260503 07:52:50.663487 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f407467a0c9c406faaa657ce70a1028b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.664753 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3a50cbc4bd349d4aa11b4d846565f79" } modify_external_catalogs: true
I20260503 07:52:50.664954 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3a50cbc4bd349d4aa11b4d846565f79" } modify_external_catalogs: true
I20260503 07:52:50.666956 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:50.668200 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0481b55721854d70a670a79ff2f42dd6 consensus state has no leader
I20260503 07:52:50.668219 1171 tablet_bootstrap.cc:654] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.668618 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f389f4d06f6d413c997b931a58167f84" } new_table_name: "default.Table_c2a784fc0e5442e2b8d0b7531248e09f" modify_external_catalogs: true
I20260503 07:52:50.667286 1232 consensus_queue.cc:237] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.676805 1175 ts_tablet_manager.cc:1929] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.676926 1175 log.cc:1199] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:50.677268 1175 ts_tablet_manager.cc:1950] T 1609d01e6cdc440085a6ebdb652d54f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.677819 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11c020bd0484adfa6d7dae67818f7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.677999 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:50.678967 1171 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.679112 1171 ts_tablet_manager.cc:1403] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.000s
I20260503 07:52:50.679890 779 raft_consensus.cc:3060] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.628953 742 tablet_service.cc:1511] Processing CreateTablet for tablet dda159becff6466abdcd84193f40a65e (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.680454 1171 raft_consensus.cc:359] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.680634 1171 raft_consensus.cc:385] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.680729 1171 raft_consensus.cc:740] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.681000 1171 consensus_queue.cc:260] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.684235 1364 raft_consensus.cc:493] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.686726 1165 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:50.686906 1165 ts_tablet_manager.cc:1403] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.149s user 0.004s sys 0.010s
W20260503 07:52:50.687441 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f86609fc7b4007ab4c730002918613 consensus state has no leader
I20260503 07:52:50.687669 1165 raft_consensus.cc:359] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.687877 1165 raft_consensus.cc:385] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.687976 1165 raft_consensus.cc:740] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.688236 1165 consensus_queue.cc:260] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.688357 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1609d01e6cdc440085a6ebdb652d54f1 (table default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:50.688736 1165 ts_tablet_manager.cc:1434] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:50.687932 1175 tablet_replica.cc:333] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.689586 1175 raft_consensus.cc:2243] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:50.690472 1175 raft_consensus.cc:2272] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.690932 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4ec79454524d468c76fd01dec8eb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.691679 1175 ts_tablet_manager.cc:1916] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.692546 1165 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:50.684417 1364 raft_consensus.cc:515] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.693897 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e9b97fafa145e0a45e4d81fc9d5947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.696254 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda159becff6466abdcd84193f40a65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.697044 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda159becff6466abdcd84193f40a65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.697867 1175 ts_tablet_manager.cc:1929] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:50.697999 1175 log.cc:1199] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5690198617de4f568132e24708d77418
I20260503 07:52:50.685511 1171 ts_tablet_manager.cc:1434] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:52:50.698906 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.699153 781 raft_consensus.cc:2393] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:50.699718 1171 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.701777 1171 tablet_bootstrap.cc:654] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.703186 1175 ts_tablet_manager.cc:1950] T 5690198617de4f568132e24708d77418 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.704541 1175 tablet_replica.cc:333] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.704774 1175 raft_consensus.cc:2243] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.705385 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5690198617de4f568132e24708d77418 (table default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:52:50.705487 1175 raft_consensus.cc:2272] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.706067 1175 ts_tablet_manager.cc:1916] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.706835 1166 raft_consensus.cc:359] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.707031 1166 raft_consensus.cc:385] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.707125 1166 raft_consensus.cc:740] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.707351 1166 consensus_queue.cc:260] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:50.710659 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0f650d2efd4a5d9308952b32fa7d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.710831 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c01aea82d584140bbabba1f5be65539" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:50.711582 988 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.710258 1364 leader_election.cc:290] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:50.716981 1278 raft_consensus.cc:493] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.717186 1278 raft_consensus.cc:515] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.717959 1278 leader_election.cc:290] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:50.721107 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5ffb24577d4ba4bb7dd0c46cf482c1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:50.721499 1175 ts_tablet_manager.cc:1929] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:52:50.721877 1175 log.cc:1199] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/06670a873e994cbea50627dc7eb02e0e
I20260503 07:52:50.722560 1175 ts_tablet_manager.cc:1950] T 06670a873e994cbea50627dc7eb02e0e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.722512 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbf3231ab114ce59de775f3dcc1e8f2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:50.723456 988 leader_election.cc:343] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.723768 854 leader_election.cc:304] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:50.724442 1364 raft_consensus.cc:3060] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.725813 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_6706232b137041bd87a007ba2091f7c6 [id=a73654d3dcae49909e766eb795334a56]) successfully deleted
I20260503 07:52:50.727006 1171 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.727238 1171 ts_tablet_manager.cc:1403] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.006s
I20260503 07:52:50.727823 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0f650d2efd4a5d9308952b32fa7d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.728235 1171 raft_consensus.cc:359] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.728473 1171 raft_consensus.cc:385] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.728586 1171 raft_consensus.cc:740] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.728905 1171 consensus_queue.cc:260] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.729638 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c6d9dd87646ed9d1f86761f13f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.730926 1171 ts_tablet_manager.cc:1434] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:50.731492 1171 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:50.733937 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8c4ec79454524d468c76fd01dec8eb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c4ec79454524d468c76fd01dec8eb1e already in progress: creating tablet
W20260503 07:52:50.734620 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5dce60ad6aea4465a4ce04ea62bceb13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dce60ad6aea4465a4ce04ea62bceb13 already in progress: creating tablet
I20260503 07:52:50.735524 1171 tablet_bootstrap.cc:654] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:50.736043 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc already in progress: creating tablet
W20260503 07:52:50.736670 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet dfb47ec875ab44fbaa270a84224f5432 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb47ec875ab44fbaa270a84224f5432 already in progress: creating tablet
W20260503 07:52:50.737221 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 96f7244292c3400dad2812e0adb162ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96f7244292c3400dad2812e0adb162ef already in progress: creating tablet
I20260503 07:52:50.737526 1175 tablet_replica.cc:333] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.738600 1175 raft_consensus.cc:2243] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.738884 1175 raft_consensus.cc:2272] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.739931 1175 ts_tablet_manager.cc:1916] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.741343 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5ffb24577d4ba4bb7dd0c46cf482c1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.751108 1171 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.751320 1171 ts_tablet_manager.cc:1403] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260503 07:52:50.752156 1171 raft_consensus.cc:359] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.752509 1171 raft_consensus.cc:385] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.752638 1171 raft_consensus.cc:740] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.752921 1171 consensus_queue.cc:260] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.754362 1171 ts_tablet_manager.cc:1434] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:50.754696 1171 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.757753 1175 ts_tablet_manager.cc:1929] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.758198 1175 log.cc:1199] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:50.758594 1175 ts_tablet_manager.cc:1950] T 91d799ca2780461b89ced316e9f3ac92 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.759758 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 91d799ca2780461b89ced316e9f3ac92 (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
I20260503 07:52:50.760368 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 (DEFAULT_TABLE table=default.Table_9d94a78c3c464465aa79a1b009d68b53 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.760833 781 raft_consensus.cc:2468] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:50.758764 1171 tablet_bootstrap.cc:654] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.762310 986 leader_election.cc:304] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:50.762868 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 295cfe6e7a7043b2905a6e90dd520002 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295cfe6e7a7043b2905a6e90dd520002 already in progress: creating tablet
I20260503 07:52:50.763228 1278 raft_consensus.cc:2804] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:50.763315 1278 raft_consensus.cc:493] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:50.763401 1278 raft_consensus.cc:3060] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.766218 1278 raft_consensus.cc:515] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.766505 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c6d9dd87646ed9d1f86761f13f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.767364 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5ffb24577d4ba4bb7dd0c46cf482c1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:50.768066 988 leader_election.cc:343] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:50.768615 1278 leader_election.cc:290] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:50.769224 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af1b61a2548e4f3fafb4ed0982dbd9b2 already in progress: creating tablet
I20260503 07:52:50.769852 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5ffb24577d4ba4bb7dd0c46cf482c1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:50.770371 781 raft_consensus.cc:3060] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:50.770442 1175 tablet_replica.cc:333] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.770722 1175 raft_consensus.cc:2243] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.770947 1175 raft_consensus.cc:2272] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.771831 1175 ts_tablet_manager.cc:1916] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.773313 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:50.775028 1165 tablet_bootstrap.cc:654] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.781984 1171 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.782208 1171 ts_tablet_manager.cc:1403] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.006s
I20260503 07:52:50.783031 1171 raft_consensus.cc:359] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.783260 1171 raft_consensus.cc:385] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.783336 1171 raft_consensus.cc:740] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.783556 1171 consensus_queue.cc:260] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.784396 1171 ts_tablet_manager.cc:1434] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:50.784976 1171 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.788688 1171 tablet_bootstrap.cc:654] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.789604 1175 ts_tablet_manager.cc:1929] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.789772 1175 log.cc:1199] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9c01aea82d584140bbabba1f5be65539
I20260503 07:52:50.790405 1175 ts_tablet_manager.cc:1950] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.790401 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 91d799ca2780461b89ced316e9f3ac92 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:50.791586 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9c01aea82d584140bbabba1f5be65539 (table default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]) successfully deleted
I20260503 07:52:50.791960 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9030916bd2e04c08b07f568123eead02 with delete_type TABLET_DATA_DELETED (replaced by tablet af1b61a2548e4f3fafb4ed0982dbd9b2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:50.793079 1175 tablet_replica.cc:333] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:50.793340 1175 raft_consensus.cc:2243] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:50.793568 1175 raft_consensus.cc:2272] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.794327 1175 ts_tablet_manager.cc:1916] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.796384 916 raft_consensus.cc:3060] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:50.797717 716 consensus_peers.cc:597] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7807da20d4c4b90a9e387cb72813557. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:50.800762 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f543675c817f492697f5b4760ead2e98" } new_table_name: "default.Table_6fb564bf16234e23874093b62f3961c0" modify_external_catalogs: true
I20260503 07:52:50.807633 1171 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.807799 1171 ts_tablet_manager.cc:1403] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260503 07:52:50.808741 1171 raft_consensus.cc:359] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.808931 1171 raft_consensus.cc:385] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.809113 1171 raft_consensus.cc:740] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.809330 1171 consensus_queue.cc:260] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.810081 1171 ts_tablet_manager.cc:1434] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:50.810340 1171 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.811270 1170 consensus_queue.cc:1048] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:50.813280 1171 tablet_bootstrap.cc:654] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.814291 1175 ts_tablet_manager.cc:1929] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.814469 1175 log.cc:1199] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:50.815025 1175 ts_tablet_manager.cc:1950] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:50.815737 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (table default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]) successfully deleted
I20260503 07:52:50.820967 1171 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:50.821576 1171 ts_tablet_manager.cc:1403] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260503 07:52:50.822474 1171 raft_consensus.cc:359] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:50.822738 1171 raft_consensus.cc:385] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:50.822878 1171 raft_consensus.cc:740] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:50.823190 1171 consensus_queue.cc:260] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:50.824057 1171 ts_tablet_manager.cc:1434] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:50.824397 1171 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:50.827366 1171 tablet_bootstrap.cc:654] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:50.836952 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_aedf5ef6a71e40c194d650861851082d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.837687 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aedf5ef6a71e40c194d650861851082d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.841704 779 raft_consensus.cc:2468] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:50.842435 986 leader_election.cc:304] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:50.843115 986 raft_consensus.cc:2686] T 9c01aea82d584140bbabba1f5be65539 P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:50.847275 1364 raft_consensus.cc:2749] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:50.848356 1364 raft_consensus.cc:493] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:50.849221 1364 raft_consensus.cc:515] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:50.851804 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7e6e0bb0ee34448f983ab11cb086eba1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:50.851954 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2c09bafa7c9e4f9784dfdb48a31685db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.852388 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c09bafa7c9e4f9784dfdb48a31685db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:50.852384 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e6e0bb0ee34448f983ab11cb086eba1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.875839 781 raft_consensus.cc:2468] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:50.876294 986 leader_election.cc:304] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:50.876510 986 raft_consensus.cc:2686] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:50.882793 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]). Expected version 2 got 0
I20260503 07:52:50.883585 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bdbdd2e346404637b28164b4a3a71312"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:50.884135 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdbdd2e346404637b28164b4a3a71312 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:50.884125 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3be42428a60142ca99f48e592a29070f (DEFAULT_TABLE table=default.Table_1e8536bf4e404f39921bdfc455bf5128 [id=55a8aef067f342e0a2b7eb4c50ee04c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.884564 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be42428a60142ca99f48e592a29070f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.887846 886 tablet_service.cc:1511] Processing CreateTablet for tablet 2d647277295e42cdb65f45a619e63960 (DEFAULT_TABLE table=default.Table_b27d2d45e739451ba9c47687239cfbf3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.888063 885 tablet_service.cc:1511] Processing CreateTablet for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (DEFAULT_TABLE table=default.Table_2fc55691a0234d4ba696f36f2d875131 [id=ed518a72e0fd490a89f83cb777747bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.888123 752 tablet_service.cc:1511] Processing CreateTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 (DEFAULT_TABLE table=default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.888381 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d647277295e42cdb65f45a619e63960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.888628 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8055ed2748e4a0e9ba1194c40afb5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.891489 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3be42428a60142ca99f48e592a29070f (DEFAULT_TABLE table=default.Table_1e8536bf4e404f39921bdfc455bf5128 [id=55a8aef067f342e0a2b7eb4c50ee04c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.891638 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7807da20d4c4b90a9e387cb72813557" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:50.891845 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be42428a60142ca99f48e592a29070f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.892045 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed95a89bf4bc4b6fa72b224f49082423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.893746 746 tablet_service.cc:1511] Processing CreateTablet for tablet 3be42428a60142ca99f48e592a29070f (DEFAULT_TABLE table=default.Table_1e8536bf4e404f39921bdfc455bf5128 [id=55a8aef067f342e0a2b7eb4c50ee04c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.894006 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 2d647277295e42cdb65f45a619e63960 (DEFAULT_TABLE table=default.Table_b27d2d45e739451ba9c47687239cfbf3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.894085 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be42428a60142ca99f48e592a29070f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.894330 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d647277295e42cdb65f45a619e63960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.894655 896 tablet_service.cc:1511] Processing CreateTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 (DEFAULT_TABLE table=default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.894975 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96ba84739c45b7847f0c43ab4a08e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.895262 1028 tablet_service.cc:1511] Processing CreateTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 (DEFAULT_TABLE table=default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.895440 884 tablet_service.cc:1511] Processing CreateTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 (DEFAULT_TABLE table=default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.895546 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96ba84739c45b7847f0c43ab4a08e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.896008 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed95a89bf4bc4b6fa72b224f49082423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.896983 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 (DEFAULT_TABLE table=default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.897298 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed95a89bf4bc4b6fa72b224f49082423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.899006 741 tablet_service.cc:1511] Processing CreateTablet for tablet 2d647277295e42cdb65f45a619e63960 (DEFAULT_TABLE table=default.Table_b27d2d45e739451ba9c47687239cfbf3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.899319 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d647277295e42cdb65f45a619e63960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.900277 744 tablet_service.cc:1511] Processing CreateTablet for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (DEFAULT_TABLE table=default.Table_2fc55691a0234d4ba696f36f2d875131 [id=ed518a72e0fd490a89f83cb777747bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.900592 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8055ed2748e4a0e9ba1194c40afb5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.901412 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (DEFAULT_TABLE table=default.Table_2fc55691a0234d4ba696f36f2d875131 [id=ed518a72e0fd490a89f83cb777747bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.901482 742 tablet_service.cc:1511] Processing CreateTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 (DEFAULT_TABLE table=default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.901823 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96ba84739c45b7847f0c43ab4a08e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.902093 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8055ed2748e4a0e9ba1194c40afb5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.902671 1174 ts_tablet_manager.cc:1929] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.904582 1174 log.cc:1199] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d4328cceebfa466fb6f56d0ffbc09bd2
I20260503 07:52:50.905033 1174 ts_tablet_manager.cc:1950] T d4328cceebfa466fb6f56d0ffbc09bd2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:50.906059 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d4328cceebfa466fb6f56d0ffbc09bd2 (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
I20260503 07:52:50.912555 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 (DEFAULT_TABLE table=default.Table_5ebfc83a66b04f3e91b9dc64f418a18a [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.912925 743 tablet_service.cc:1511] Processing CreateTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 (DEFAULT_TABLE table=default.Table_5ebfc83a66b04f3e91b9dc64f418a18a [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.913266 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655ef28c1d4326b2f462ab6fd8d604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.913350 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655ef28c1d4326b2f462ab6fd8d604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.914868 759 tablet_service.cc:1511] Processing CreateTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.915318 751 tablet_service.cc:1511] Processing CreateTablet for tablet 766799446d1a480ca04246b0aec14852 (DEFAULT_TABLE table=default.Table_553f5ec1e276434b9442fb5e2e852eaa [id=c9513d6e491a4250894ed7225db630fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.915795 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3da9549389254875b94268abc5c3bb3e (DEFAULT_TABLE table=default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.916358 745 tablet_service.cc:1511] Processing CreateTablet for tablet fe2b065666ec4f1299b47d45cd1f600b (DEFAULT_TABLE table=default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.917332 884 tablet_service.cc:1511] Processing CreateTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 (DEFAULT_TABLE table=default.Table_5ebfc83a66b04f3e91b9dc64f418a18a [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.917503 1030 tablet_service.cc:1511] Processing CreateTablet for tablet fe2b065666ec4f1299b47d45cd1f600b (DEFAULT_TABLE table=default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.917623 758 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0489d86704462ab237e5226df1251f (DEFAULT_TABLE table=default.Table_b470d3e5308242b8979e833e01444cf3 [id=99ec5c91c64c44f4880574f176e882a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.917848 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2b065666ec4f1299b47d45cd1f600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.918134 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655ef28c1d4326b2f462ab6fd8d604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.918385 748 tablet_service.cc:1511] Processing CreateTablet for tablet 77fa106f0cc24a35bd23b457660a45dc (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.918459 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f1aeea6b4ead45ef82934811494cf263 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.918839 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aeea6b4ead45ef82934811494cf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.918924 754 tablet_service.cc:1511] Processing CreateTablet for tablet 75dfcff75f90434caf7dc26408958a16 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.919474 761 tablet_service.cc:1511] Processing CreateTablet for tablet f1aeea6b4ead45ef82934811494cf263 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.917796 886 tablet_service.cc:1511] Processing CreateTablet for tablet 3da9549389254875b94268abc5c3bb3e (DEFAULT_TABLE table=default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.920302 883 tablet_service.cc:1511] Processing CreateTablet for tablet f1aeea6b4ead45ef82934811494cf263 (DEFAULT_TABLE table=default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.920480 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da9549389254875b94268abc5c3bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.920698 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aeea6b4ead45ef82934811494cf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.920735 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77fa106f0cc24a35bd23b457660a45dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.920706 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 766799446d1a480ca04246b0aec14852 (DEFAULT_TABLE table=default.Table_553f5ec1e276434b9442fb5e2e852eaa [id=c9513d6e491a4250894ed7225db630fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.921011 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766799446d1a480ca04246b0aec14852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.921674 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 3da9549389254875b94268abc5c3bb3e (DEFAULT_TABLE table=default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.922070 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da9549389254875b94268abc5c3bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.922312 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0489d86704462ab237e5226df1251f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.923074 1023 tablet_service.cc:1511] Processing CreateTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.923208 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766799446d1a480ca04246b0aec14852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.923416 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765ff6b70046f6a46aab3f413d04f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.924032 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765ff6b70046f6a46aab3f413d04f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.924418 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 75dfcff75f90434caf7dc26408958a16 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.924851 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dfcff75f90434caf7dc26408958a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.924966 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dfcff75f90434caf7dc26408958a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.925159 881 tablet_service.cc:1511] Processing CreateTablet for tablet 75dfcff75f90434caf7dc26408958a16 (DEFAULT_TABLE table=default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.925864 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dfcff75f90434caf7dc26408958a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.926247 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da9549389254875b94268abc5c3bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.926540 882 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0489d86704462ab237e5226df1251f (DEFAULT_TABLE table=default.Table_b470d3e5308242b8979e833e01444cf3 [id=99ec5c91c64c44f4880574f176e882a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.927066 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1aeea6b4ead45ef82934811494cf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.927119 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0489d86704462ab237e5226df1251f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.927588 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2b065666ec4f1299b47d45cd1f600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.928617 1174 tablet_replica.cc:333] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:50.928843 1174 raft_consensus.cc:2243] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:50.929138 1174 pending_rounds.cc:70] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:50.929221 1174 pending_rounds.cc:77] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847375175176192 op_type: NO_OP noop_request { }
I20260503 07:52:50.929308 1174 raft_consensus.cc:2889] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:50.929416 1174 raft_consensus.cc:2272] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:50.929905 1174 ts_tablet_manager.cc:1916] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:50.931897 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0489d86704462ab237e5226df1251f (DEFAULT_TABLE table=default.Table_b470d3e5308242b8979e833e01444cf3 [id=99ec5c91c64c44f4880574f176e882a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.932305 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0489d86704462ab237e5226df1251f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.936961 1364 leader_election.cc:290] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:50.947942 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b9ff03fba3d4a1794a8a5b94caa9731 consensus state has no leader
I20260503 07:52:50.949705 885 tablet_service.cc:1511] Processing CreateTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 (DEFAULT_TABLE table=default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.950067 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765ff6b70046f6a46aab3f413d04f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.960482 892 tablet_service.cc:1511] Processing CreateTablet for tablet 766799446d1a480ca04246b0aec14852 (DEFAULT_TABLE table=default.Table_553f5ec1e276434b9442fb5e2e852eaa [id=c9513d6e491a4250894ed7225db630fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.960908 1173 ts_tablet_manager.cc:1929] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:50.961105 1173 log.cc:1199] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/2919cf168bac48e5abbd261590487e8f
I20260503 07:52:50.972963 1232 consensus_queue.cc:1048] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:50.963424 884 tablet_service.cc:1511] Processing CreateTablet for tablet 77fa106f0cc24a35bd23b457660a45dc (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.960927 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766799446d1a480ca04246b0aec14852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.990000 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 77fa106f0cc24a35bd23b457660a45dc (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:50.991022 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77fa106f0cc24a35bd23b457660a45dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:50.999707 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c5018bd960184e978049b6a6fb07ea20" } new_table_name: "default.Table_7777e79b5e0b47edac66885f4b7b9655" modify_external_catalogs: true
I20260503 07:52:51.001469 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_305020fe316f4e3b97eb80ada2fdef86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.002189 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_305020fe316f4e3b97eb80ada2fdef86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.006644 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_db12521206a44e77a439d7dc716a6cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.007278 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db12521206a44e77a439d7dc716a6cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.011308 1278 raft_consensus.cc:493] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.011475 1278 raft_consensus.cc:515] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.012297 1278 leader_election.cc:290] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.014345 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:51.015079 986 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.016525 1278 raft_consensus.cc:493] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.016716 1278 raft_consensus.cc:515] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.017463 1278 leader_election.cc:290] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.019109 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:51.019565 986 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.032315 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77fa106f0cc24a35bd23b457660a45dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.034137 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.034899 988 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.035100 988 leader_election.cc:304] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.035797 1278 raft_consensus.cc:2749] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.036428 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.037333 988 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.037475 988 leader_election.cc:304] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.038012 1278 raft_consensus.cc:2749] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.036267 895 tablet_service.cc:1511] Processing CreateTablet for tablet fe2b065666ec4f1299b47d45cd1f600b (DEFAULT_TABLE table=default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.044601 1173 ts_tablet_manager.cc:1950] T 2919cf168bac48e5abbd261590487e8f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:51.047766 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 2919cf168bac48e5abbd261590487e8f (table default.Table_c36955b6400a4df98f08dcbaeb082c5c [id=c4005ffd8e4f4330904e2a8f431470f6]) successfully deleted
I20260503 07:52:51.049587 1174 ts_tablet_manager.cc:1929] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.049731 1174 log.cc:1199] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/6eca7f88573745c5ae68fdb32cda2feb
I20260503 07:52:51.050554 1174 ts_tablet_manager.cc:1950] T 6eca7f88573745c5ae68fdb32cda2feb P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.051492 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 105) took 1102 ms. Trace:
I20260503 07:52:51.051676 1174 rpcz_store.cc:276] 0503 07:52:49.948635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.949689 (+ 1054us) service_pool.cc:224] Handling call
0503 07:52:50.928542 (+978853us) ts_tablet_manager.cc:1151] Deleting tablet 6eca7f88573745c5ae68fdb32cda2feb
0503 07:52:50.928554 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.031197 (+102643us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.042061 (+ 10864us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.051450 (+ 9389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":978529}
I20260503 07:52:51.052150 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 6eca7f88573745c5ae68fdb32cda2feb (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
I20260503 07:52:51.056255 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2b065666ec4f1299b47d45cd1f600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.059136 1173 tablet_replica.cc:333] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:51.059473 1173 raft_consensus.cc:2243] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.059782 1173 raft_consensus.cc:2272] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.061254 1173 ts_tablet_manager.cc:1916] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.061822 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 106) took 1113 ms. Trace:
I20260503 07:52:51.061960 1174 rpcz_store.cc:276] 0503 07:52:49.948756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.950055 (+ 1299us) service_pool.cc:224] Handling call
0503 07:52:51.061634 (+1111579us) ts_tablet_manager.cc:1151] Deleting tablet be381bee559841bfb90a4d2ce8c4fa5f
0503 07:52:51.061646 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.061770 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1111295}
W20260503 07:52:51.062496 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet be381bee559841bfb90a4d2ce8c4fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be381bee559841bfb90a4d2ce8c4fa5f already in progress: creating tablet
I20260503 07:52:51.063755 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 107) took 1114 ms. Trace:
I20260503 07:52:51.064462 1174 rpcz_store.cc:276] 0503 07:52:49.948844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.950376 (+ 1532us) service_pool.cc:224] Handling call
0503 07:52:51.063578 (+1113202us) ts_tablet_manager.cc:1151] Deleting tablet 7ce867777c0e46d1af4785e667e7a18e
0503 07:52:51.063593 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.063716 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112902}
W20260503 07:52:51.065182 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7ce867777c0e46d1af4785e667e7a18e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ce867777c0e46d1af4785e667e7a18e already in progress: creating tablet
I20260503 07:52:51.065644 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 108) took 1116 ms. Trace:
I20260503 07:52:51.066113 1174 rpcz_store.cc:276] 0503 07:52:49.948957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.950703 (+ 1746us) service_pool.cc:224] Handling call
0503 07:52:51.065500 (+1114797us) ts_tablet_manager.cc:1151] Deleting tablet 741a28af9fe946db8c9305aa1dabe999
0503 07:52:51.065513 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.065603 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114499}
W20260503 07:52:51.066694 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 741a28af9fe946db8c9305aa1dabe999 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 741a28af9fe946db8c9305aa1dabe999 already in progress: creating tablet
I20260503 07:52:51.067118 1174 tablet_replica.cc:333] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.067498 1174 raft_consensus.cc:2243] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.068020 1174 pending_rounds.cc:70] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:51.068393 1174 pending_rounds.cc:77] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847377636040704 op_type: NO_OP noop_request { }
I20260503 07:52:51.068706 1174 raft_consensus.cc:2889] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:51.068951 1174 raft_consensus.cc:2272] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.069967 1174 ts_tablet_manager.cc:1916] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:51.084333 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet be15f49b155746d1924868d9f91e9206 (table default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet be15f49b155746d1924868d9f91e9206 consensus state has no leader
I20260503 07:52:51.084684 1174 ts_tablet_manager.cc:1929] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.084800 1174 log.cc:1199] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:51.085158 1174 ts_tablet_manager.cc:1950] T d7807da20d4c4b90a9e387cb72813557 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.085878 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 109) took 1136 ms. Trace:
I20260503 07:52:51.086002 1174 rpcz_store.cc:276] 0503 07:52:49.949089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:49.951025 (+ 1936us) service_pool.cc:224] Handling call
0503 07:52:51.067062 (+1116037us) ts_tablet_manager.cc:1151] Deleting tablet d7807da20d4c4b90a9e387cb72813557
0503 07:52:51.067071 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.073861 (+ 6790us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.084562 (+ 10701us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.085843 (+ 1281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1115802}
I20260503 07:52:51.086547 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
I20260503 07:52:51.087069 1278 raft_consensus.cc:493] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.087316 1278 raft_consensus.cc:515] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.088153 1278 leader_election.cc:290] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.088838 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:51.089305 986 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.092890 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.093482 988 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.093631 988 leader_election.cc:304] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.094228 1278 raft_consensus.cc:2749] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.096097 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 111) took 1077 ms. Trace:
I20260503 07:52:51.096673 1174 rpcz_store.cc:276] 0503 07:52:50.018860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.018974 (+ 114us) service_pool.cc:224] Handling call
0503 07:52:51.095926 (+1076952us) ts_tablet_manager.cc:1151] Deleting tablet b77c5c6954554eac970d1e3fb1387c2b
0503 07:52:51.095936 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.096066 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076626}
W20260503 07:52:51.097518 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b77c5c6954554eac970d1e3fb1387c2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c5c6954554eac970d1e3fb1387c2b already in progress: creating tablet
I20260503 07:52:51.098011 1174 tablet_replica.cc:333] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.098549 1174 raft_consensus.cc:2243] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.099114 1174 raft_consensus.cc:2272] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.100076 1174 ts_tablet_manager.cc:1916] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.115214 1174 ts_tablet_manager.cc:1929] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.121508 1165 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.122356 1165 ts_tablet_manager.cc:1403] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.433s user 0.019s sys 0.016s
I20260503 07:52:51.123478 1165 raft_consensus.cc:359] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.123783 1165 raft_consensus.cc:385] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.123916 1165 raft_consensus.cc:740] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.124284 1165 consensus_queue.cc:260] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.125502 1165 ts_tablet_manager.cc:1434] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:51.126694 1165 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.129220 1165 tablet_bootstrap.cc:654] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.130307 1174 log.cc:1199] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:51.130856 1174 ts_tablet_manager.cc:1950] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.131747 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 113) took 1107 ms. Trace:
I20260503 07:52:51.136224 1174 rpcz_store.cc:276] 0503 07:52:50.024277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.024454 (+ 177us) service_pool.cc:224] Handling call
0503 07:52:51.097932 (+1073478us) ts_tablet_manager.cc:1151] Deleting tablet eb5ffb24577d4ba4bb7dd0c46cf482c1
0503 07:52:51.097945 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.111781 (+ 13836us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.115126 (+ 3345us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.131678 (+ 16552us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072026}
I20260503 07:52:51.136886 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (table default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]) successfully deleted
I20260503 07:52:51.137449 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 122) took 1060 ms. Trace:
I20260503 07:52:51.137625 1174 rpcz_store.cc:276] 0503 07:52:50.076879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.076954 (+ 75us) service_pool.cc:224] Handling call
0503 07:52:51.137274 (+1060320us) ts_tablet_manager.cc:1151] Deleting tablet 9030916bd2e04c08b07f568123eead02
0503 07:52:51.137287 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.137389 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1058482}
I20260503 07:52:51.138485 1174 tablet_replica.cc:333] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.138801 1174 raft_consensus.cc:2243] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.139204 1174 raft_consensus.cc:2272] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.140013 1174 ts_tablet_manager.cc:1916] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.145860 1165 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.146114 1165 ts_tablet_manager.cc:1403] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
I20260503 07:52:51.147290 1165 raft_consensus.cc:359] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.147598 1165 raft_consensus.cc:385] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.147778 1165 raft_consensus.cc:740] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.148137 1165 consensus_queue.cc:260] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.149677 1165 ts_tablet_manager.cc:1434] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:51.151980 1165 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.154050 1165 tablet_bootstrap.cc:654] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.159704 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:51.162729 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:52:51.162937 1174 ts_tablet_manager.cc:1929] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.163030 1174 log.cc:1199] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9c01aea82d584140bbabba1f5be65539
I20260503 07:52:51.163790 1174 ts_tablet_manager.cc:1950] T 9c01aea82d584140bbabba1f5be65539 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.164494 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3da9549389254875b94268abc5c3bb3e
I20260503 07:52:51.165120 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.165693 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.165899 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.166146 741 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.166327 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.166926 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.167187 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.168900 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9d94a78c3c464465aa79a1b009d68b53" } new_table_name: "default.Table_49aeb9af1f3e46548302416f0651e300" modify_external_catalogs: true
W20260503 07:52:51.170090 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ed95a89bf4bc4b6fa72b224f49082423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed95a89bf4bc4b6fa72b224f49082423 already in progress: creating tablet
W20260503 07:52:51.170383 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3da9549389254875b94268abc5c3bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3da9549389254875b94268abc5c3bb3e already in progress: creating tablet
I20260503 07:52:51.170390 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 123) took 1092 ms. Trace:
I20260503 07:52:51.170531 1174 rpcz_store.cc:276] 0503 07:52:50.077450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.077618 (+ 168us) service_pool.cc:224] Handling call
0503 07:52:51.138377 (+1060759us) ts_tablet_manager.cc:1151] Deleting tablet 9c01aea82d584140bbabba1f5be65539
0503 07:52:51.138389 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.160659 (+ 22270us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.162868 (+ 2209us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.170346 (+ 7478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055449}
I20260503 07:52:51.170733 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]). Expected version 2 got 0
I20260503 07:52:51.172535 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9c01aea82d584140bbabba1f5be65539 (table default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]) successfully deleted
I20260503 07:52:51.172556 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:51.173519 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_312a588ec1c840c187461ae93b58a342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.174013 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_312a588ec1c840c187461ae93b58a342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.173938 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_11378258563d415586230d101efb0247"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.174388 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11378258563d415586230d101efb0247 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.174682 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.174978 888 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.175177 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.176501 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb47ec875ab44fbaa270a84224f5432 with delete_type TABLET_DATA_DELETED (replaced by tablet 77fa106f0cc24a35bd23b457660a45dc) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:51.176728 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 4d4d8dfc410a40ec825d8e45e07388f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d4d8dfc410a40ec825d8e45e07388f6 already in progress: creating tablet
I20260503 07:52:51.176771 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.177006 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.176535 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.177404 1175 tablet_replica.cc:333] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:51.177405 743 tablet_service.cc:1558] Processing DeleteTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.177623 1175 raft_consensus.cc:2243] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.172215 1165 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.179410 1165 ts_tablet_manager.cc:1403] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.001s
I20260503 07:52:51.179672 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:52:51.180303 1165 raft_consensus.cc:359] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.180423 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1aac057d4a974996afb3c2032a540e90" } new_table_name: "default.Table_98bf34009bfe4112bc02fc3b4688a1f6" modify_external_catalogs: true
I20260503 07:52:51.180495 1165 raft_consensus.cc:385] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.180562 1165 raft_consensus.cc:740] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.181433 1165 consensus_queue.cc:260] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.182000 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.182441 743 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.183007 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.183440 1165 ts_tablet_manager.cc:1434] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:51.184362 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.184759 1165 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.186563 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.187168 1174 tablet_replica.cc:333] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.187480 1174 raft_consensus.cc:2243] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.189600 1174 raft_consensus.cc:2272] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.189985 1175 raft_consensus.cc:2272] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.190871 1175 ts_tablet_manager.cc:1916] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.194538 1174 ts_tablet_manager.cc:1916] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.196853 1278 raft_consensus.cc:493] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.197041 1278 raft_consensus.cc:515] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.197738 1278 leader_election.cc:290] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.199043 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60a9ee2cc5a42efa1201e12622d4df1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.199209 779 raft_consensus.cc:1275] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:51.199724 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60a9ee2cc5a42efa1201e12622d4df1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:51.199942 781 raft_consensus.cc:2468] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:52:51.200186 988 leader_election.cc:343] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.200522 1165 tablet_bootstrap.cc:654] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.200666 986 leader_election.cc:304] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.201184 1278 consensus_queue.cc:1048] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:51.201668 1278 raft_consensus.cc:2804] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.201817 1278 raft_consensus.cc:493] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.201920 1278 raft_consensus.cc:3060] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.210565 1174 ts_tablet_manager.cc:1929] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.211313 1278 raft_consensus.cc:515] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.214730 1165 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.214988 1165 ts_tablet_manager.cc:1403] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20260503 07:52:51.216005 1165 raft_consensus.cc:359] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.216287 1165 raft_consensus.cc:385] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.216391 1165 raft_consensus.cc:740] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.216742 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60a9ee2cc5a42efa1201e12622d4df1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:51.216671 1165 consensus_queue.cc:260] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.217476 1165 ts_tablet_manager.cc:1434] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260503 07:52:51.217571 988 leader_election.cc:343] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.217803 1165 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.219836 1165 tablet_bootstrap.cc:654] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.220641 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60a9ee2cc5a42efa1201e12622d4df1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:51.220881 1174 log.cc:1199] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c37459b741904a8696064201992d4591
I20260503 07:52:51.220927 1175 ts_tablet_manager.cc:1929] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.221071 1175 log.cc:1199] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:51.221468 1175 ts_tablet_manager.cc:1950] T dfb47ec875ab44fbaa270a84224f5432 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:51.221657 1174 ts_tablet_manager.cc:1950] T c37459b741904a8696064201992d4591 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.222640 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 125) took 1138 ms. Trace:
I20260503 07:52:51.222615 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet dfb47ec875ab44fbaa270a84224f5432 (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
I20260503 07:52:51.222859 1174 rpcz_store.cc:276] 0503 07:52:50.084329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.084697 (+ 368us) service_pool.cc:224] Handling call
0503 07:52:51.186382 (+1101685us) ts_tablet_manager.cc:1151] Deleting tablet c37459b741904a8696064201992d4591
0503 07:52:51.186396 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.202787 (+ 16391us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.210482 (+ 7695us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.222559 (+ 12077us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101516}
I20260503 07:52:51.223215 1278 leader_election.cc:290] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.223547 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c37459b741904a8696064201992d4591 (table default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]) successfully deleted
I20260503 07:52:51.224017 1174 tablet_replica.cc:333] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.228926 917 raft_consensus.cc:1275] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:51.230939 1174 raft_consensus.cc:2243] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.231380 781 raft_consensus.cc:3060] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.231612 1174 pending_rounds.cc:70] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:51.231686 1174 pending_rounds.cc:77] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847379274264576 op_type: NO_OP noop_request { }
I20260503 07:52:51.231803 1174 raft_consensus.cc:2889] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:51.231895 1174 raft_consensus.cc:2272] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.233693 1175 tablet_replica.cc:333] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:51.233939 1174 ts_tablet_manager.cc:1916] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.233935 1175 raft_consensus.cc:2243] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.234091 1175 raft_consensus.cc:2272] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.234966 781 raft_consensus.cc:2468] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:52:51.234756 425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 48286.3us
I20260503 07:52:51.235899 986 leader_election.cc:304] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.243168 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.252370 1165 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
W20260503 07:52:51.253314 854 leader_election.cc:343] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:51.253515 1165 ts_tablet_manager.cc:1403] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.006s
I20260503 07:52:51.253523 854 leader_election.cc:304] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.255096 1401 raft_consensus.cc:2749] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.257320 1174 ts_tablet_manager.cc:1929] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.261396 1174 log.cc:1199] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:51.262172 1174 ts_tablet_manager.cc:1950] T 1609d01e6cdc440085a6ebdb652d54f1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.262205 1175 ts_tablet_manager.cc:1916] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.258819 1165 raft_consensus.cc:359] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.263793 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 124) took 1179 ms. Trace:
I20260503 07:52:51.265431 1174 rpcz_store.cc:276] 0503 07:52:50.084102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.084212 (+ 110us) service_pool.cc:224] Handling call
0503 07:52:51.223915 (+1139703us) ts_tablet_manager.cc:1151] Deleting tablet 1609d01e6cdc440085a6ebdb652d54f1
0503 07:52:51.223928 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.243429 (+ 19501us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.257254 (+ 13825us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.263724 (+ 6470us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131210}
I20260503 07:52:51.266561 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1609d01e6cdc440085a6ebdb652d54f1 (table default.Table_b89b9f7fb8b8435485a75bce914f0edd [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:51.264052 1165 raft_consensus.cc:385] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.266976 1165 raft_consensus.cc:740] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.267390 1165 consensus_queue.cc:260] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.268863 1165 ts_tablet_manager.cc:1434] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260503 07:52:51.269814 1165 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.272666 1165 tablet_bootstrap.cc:654] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.273031 1174 tablet_replica.cc:333] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.275964 1174 raft_consensus.cc:2243] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.276263 1174 raft_consensus.cc:2272] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.277321 1174 ts_tablet_manager.cc:1916] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.279443 1432 consensus_queue.cc:1048] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:51.280680 1432 raft_consensus.cc:2804] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:51.281097 1432 raft_consensus.cc:697] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:51.281534 1432 consensus_queue.cc:237] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.285459 1436 tablet.cc:1724] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:51.286273 1165 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.287076 1165 ts_tablet_manager.cc:1403] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
W20260503 07:52:51.289451 1166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s user 0.069s sys 0.107s
I20260503 07:52:51.288094 1165 raft_consensus.cc:359] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.289559 1166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s user 0.069s sys 0.107s
I20260503 07:52:51.289654 1165 raft_consensus.cc:385] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.289781 1165 raft_consensus.cc:740] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.289968 1166 ts_tablet_manager.cc:1434] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.661s user 0.069s sys 0.108s
W20260503 07:52:51.290096 1166 ts_tablet_manager.cc:1467] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Tablet startup took 660ms
I20260503 07:52:51.290066 1165 consensus_queue.cc:260] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.291829 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 55990.7us
I20260503 07:52:51.293490 1165 ts_tablet_manager.cc:1434] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
W20260503 07:52:51.290211 1166 ts_tablet_manager.cc:1469] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Trace:
0503 07:52:48.281547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:48.281756 (+ 209us) service_pool.cc:224] Handling call
0503 07:52:48.282257 (+ 501us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:52:48.282286 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:52:48.310008 (+ 27722us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:48.313207 (+ 3199us) tablet_replica.cc:206] Creating consensus instance
0503 07:52:48.313352 (+ 145us) inbound_call.cc:177] Queueing success response
0503 07:52:50.494105 (+2180753us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0503 07:52:50.629304 (+135199us) ts_tablet_manager.cc:1435] Starting tablet replica
0503 07:52:50.630583 (+ 1279us) tablet_replica.cc:261] Starting instrumentation
0503 07:52:50.630824 (+ 241us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":7944,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"tablet-open.queue_time_us":2180800,"thread_start_us":582056,"threads_started":1}
I20260503 07:52:51.294148 1166 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:51.294983 1165 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.295970 1166 tablet_bootstrap.cc:654] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.297371 1165 tablet_bootstrap.cc:654] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.301069 1174 ts_tablet_manager.cc:1929] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.301213 1174 log.cc:1199] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5690198617de4f568132e24708d77418
I20260503 07:52:51.301766 1174 ts_tablet_manager.cc:1950] T 5690198617de4f568132e24708d77418 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.302706 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 126) took 1073 ms. Trace:
I20260503 07:52:51.302857 1174 rpcz_store.cc:276] 0503 07:52:50.242487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.242824 (+ 337us) service_pool.cc:224] Handling call
0503 07:52:51.272933 (+1030109us) ts_tablet_manager.cc:1151] Deleting tablet 5690198617de4f568132e24708d77418
0503 07:52:51.272947 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.283218 (+ 10271us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.300950 (+ 17732us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.302660 (+ 1710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029914}
I20260503 07:52:51.303476 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5690198617de4f568132e24708d77418 (table default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:52:51.304641 1166 tablet_bootstrap.cc:492] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:51.304812 1166 ts_tablet_manager.cc:1403] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260503 07:52:51.307945 1166 raft_consensus.cc:359] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.308152 1166 raft_consensus.cc:385] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.308250 1166 raft_consensus.cc:740] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.308504 1166 consensus_queue.cc:260] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.309074 1166 ts_tablet_manager.cc:1434] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260503 07:52:51.309067 1435 tablet.cc:1724] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:51.309401 1166 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:51.309849 1165 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.310160 1165 ts_tablet_manager.cc:1403] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260503 07:52:51.311030 1166 tablet_bootstrap.cc:654] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.311050 1165 raft_consensus.cc:359] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.311565 1165 raft_consensus.cc:385] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.311743 1165 raft_consensus.cc:740] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.311290 1174 tablet_replica.cc:333] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.312367 1174 raft_consensus.cc:2243] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.313007 1174 raft_consensus.cc:2272] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.313587 1174 ts_tablet_manager.cc:1916] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.312599 1165 consensus_queue.cc:260] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.314538 1165 ts_tablet_manager.cc:1434] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:51.314898 1165 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.319159 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9a5f3d5305ab4390b83d2c3a51947d3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.319725 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a5f3d5305ab4390b83d2c3a51947d3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.323235 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_845a0fae63eb4ef386d3e5cb6f325657" } new_table_name: "default.Table_880c06e846564e03a359ab40393e5fe2" modify_external_catalogs: true
I20260503 07:52:51.323601 592 master_service.cc:954] ReplaceTablet: received request to replace tablet a19065f28ee44933a0522bfa28696058 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.324541 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 91d799ca2780461b89ced316e9f3ac92 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.324981 1165 tablet_bootstrap.cc:654] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.325147 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_17c257396f9c4761ba776cc3a79d2e11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.325641 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17c257396f9c4761ba776cc3a79d2e11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.327483 743 tablet_service.cc:1558] Processing DeleteTablet for tablet c37459b741904a8696064201992d4591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.327634 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.327862 743 tablet_service.cc:1558] Processing DeleteTablet for tablet d7807da20d4c4b90a9e387cb72813557 with delete_type TABLET_DATA_DELETED (replaced by tablet be15f49b155746d1924868d9f91e9206) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.328780 1174 ts_tablet_manager.cc:1929] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:52:51.329685 1174 log.cc:1199] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/06670a873e994cbea50627dc7eb02e0e
I20260503 07:52:51.330314 1174 ts_tablet_manager.cc:1950] T 06670a873e994cbea50627dc7eb02e0e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.331060 598 master_service.cc:954] ReplaceTablet: received request to replace tablet d4328cceebfa466fb6f56d0ffbc09bd2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.331486 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 06670a873e994cbea50627dc7eb02e0e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.332008 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_42857f9398f347ba8fb99ad7feb1cb50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.332533 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42857f9398f347ba8fb99ad7feb1cb50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.335309 1435 tablet.cc:1724] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:51.335680 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 127) took 1092 ms. Trace:
I20260503 07:52:51.348093 1450 tablet.cc:1724] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:51.343302 1449 tablet.cc:1724] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:51.349244 1174 rpcz_store.cc:276] 0503 07:52:50.242698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.243832 (+ 1134us) service_pool.cc:224] Handling call
0503 07:52:51.311212 (+1067380us) ts_tablet_manager.cc:1151] Deleting tablet 06670a873e994cbea50627dc7eb02e0e
0503 07:52:51.311222 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.323460 (+ 12238us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.328718 (+ 5258us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.335570 (+ 6852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1066845}
I20260503 07:52:51.349958 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_6706232b137041bd87a007ba2091f7c6 [id=a73654d3dcae49909e766eb795334a56]) successfully deleted
I20260503 07:52:51.350929 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 128) took 1031 ms. Trace:
I20260503 07:52:51.351378 1174 rpcz_store.cc:276] 0503 07:52:50.319823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.319863 (+ 40us) service_pool.cc:224] Handling call
0503 07:52:51.350722 (+1030859us) ts_tablet_manager.cc:1151] Deleting tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc
0503 07:52:51.350735 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.350868 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026973}
W20260503 07:52:51.352023 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc already in progress: creating tablet
I20260503 07:52:51.352596 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 131) took 1016 ms. Trace:
I20260503 07:52:51.352808 1174 rpcz_store.cc:276] 0503 07:52:50.335665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.335751 (+ 86us) service_pool.cc:224] Handling call
0503 07:52:51.352414 (+1016663us) ts_tablet_manager.cc:1151] Deleting tablet 8c4ec79454524d468c76fd01dec8eb1e
0503 07:52:51.352428 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.352536 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010879}
W20260503 07:52:51.353394 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8c4ec79454524d468c76fd01dec8eb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c4ec79454524d468c76fd01dec8eb1e already in progress: creating tablet
W20260503 07:52:51.353660 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e2c6d9dd87646ed9d1f86761f13f628 consensus state has no leader
I20260503 07:52:51.354446 1174 tablet_replica.cc:333] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.354703 1174 raft_consensus.cc:2243] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.354904 1174 raft_consensus.cc:2272] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.355379 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7e6e0bb0ee34448f983ab11cb086eba1" } new_table_name: "default.Table_12c9b352df284d9d9fc74382fdae7380" modify_external_catalogs: true
I20260503 07:52:51.356066 1165 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.356249 1165 ts_tablet_manager.cc:1403] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.002s
I20260503 07:52:51.356856 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2f491d2732c2492c8ba3fb5ad99aa755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.357363 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f491d2732c2492c8ba3fb5ad99aa755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.357264 1165 raft_consensus.cc:359] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.357481 1165 raft_consensus.cc:385] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.357584 1165 raft_consensus.cc:740] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.357906 1165 consensus_queue.cc:260] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.358435 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f407467a0c9c406faaa657ce70a1028b consensus state has no leader
I20260503 07:52:51.358644 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 06670a873e994cbea50627dc7eb02e0e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.360303 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet dd76629713d747b490c83581cc03596c (table default.Table_7777e79b5e0b47edac66885f4b7b9655 [id=e9446550434243a09cb7a71f278edef6]). Expected version 1 got 0
I20260503 07:52:51.360427 1165 ts_tablet_manager.cc:1434] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:51.360553 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]). Expected version 2 got 0
I20260503 07:52:51.360715 1165 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.360780 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:51.361944 1174 ts_tablet_manager.cc:1916] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.362102 892 tablet_service.cc:1511] Processing CreateTablet for tablet 656dfeb5247e4cdfaacd29690353da83 (DEFAULT_TABLE table=default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.362820 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656dfeb5247e4cdfaacd29690353da83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.363684 888 tablet_service.cc:1511] Processing CreateTablet for tablet cda8280b97254d1aaf3803f6b5cd223c (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.364001 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda8280b97254d1aaf3803f6b5cd223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.364578 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d50a71c1a4bf799de34af1064597d (DEFAULT_TABLE table=default.Table_f7a7f9d12ac04700b8fd3dc35af1591b [id=b4769938686e4c029e1acaf768d192e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.364989 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d50a71c1a4bf799de34af1064597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.364921 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 656dfeb5247e4cdfaacd29690353da83 (DEFAULT_TABLE table=default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.365253 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656dfeb5247e4cdfaacd29690353da83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.368206 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet dd76629713d747b490c83581cc03596c (table default.Table_7777e79b5e0b47edac66885f4b7b9655 [id=e9446550434243a09cb7a71f278edef6]). Expected version 1 got 0
I20260503 07:52:51.368547 1030 tablet_service.cc:1511] Processing CreateTablet for tablet efec3cb45daf44e59132ea4d8929bd43 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.368934 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efec3cb45daf44e59132ea4d8929bd43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.370173 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5dce60ad6aea4465a4ce04ea62bceb13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dce60ad6aea4465a4ce04ea62bceb13 already in progress: creating tablet
W20260503 07:52:51.370388 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af1b61a2548e4f3fafb4ed0982dbd9b2 already in progress: creating tablet
I20260503 07:52:51.371294 741 tablet_service.cc:1511] Processing CreateTablet for tablet 656dfeb5247e4cdfaacd29690353da83 (DEFAULT_TABLE table=default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.371443 747 tablet_service.cc:1511] Processing CreateTablet for tablet 388c63dc20da408ca3e141ada0200be6 (DEFAULT_TABLE table=default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.371526 743 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d50a71c1a4bf799de34af1064597d (DEFAULT_TABLE table=default.Table_f7a7f9d12ac04700b8fd3dc35af1591b [id=b4769938686e4c029e1acaf768d192e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.371640 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656dfeb5247e4cdfaacd29690353da83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.371846 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d50a71c1a4bf799de34af1064597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.372000 742 tablet_service.cc:1511] Processing CreateTablet for tablet cda8280b97254d1aaf3803f6b5cd223c (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.372218 745 tablet_service.cc:1511] Processing CreateTablet for tablet efec3cb45daf44e59132ea4d8929bd43 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.372407 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda8280b97254d1aaf3803f6b5cd223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.372435 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 388c63dc20da408ca3e141ada0200be6 (DEFAULT_TABLE table=default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.372599 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efec3cb45daf44e59132ea4d8929bd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.372712 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388c63dc20da408ca3e141ada0200be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.373027 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388c63dc20da408ca3e141ada0200be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.376437 1028 tablet_service.cc:1511] Processing CreateTablet for tablet cda8280b97254d1aaf3803f6b5cd223c (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.376742 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda8280b97254d1aaf3803f6b5cd223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.379025 1165 tablet_bootstrap.cc:654] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.379691 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5" } modify_external_catalogs: true
I20260503 07:52:51.379855 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5" } modify_external_catalogs: true
I20260503 07:52:51.381307 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_db12521206a44e77a439d7dc716a6cad" } modify_external_catalogs: true
I20260503 07:52:51.381448 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_db12521206a44e77a439d7dc716a6cad" } modify_external_catalogs: true
I20260503 07:52:51.383486 889 tablet_service.cc:1511] Processing CreateTablet for tablet 67387c8aba1f4d728b3691c5da720e4d (DEFAULT_TABLE table=default.Table_2e55a33b7465440fa8d8514ad988f3dc [id=bd345ab54d2640ab81ef3154b405dcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.383893 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67387c8aba1f4d728b3691c5da720e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.383914 746 tablet_service.cc:1511] Processing CreateTablet for tablet 67387c8aba1f4d728b3691c5da720e4d (DEFAULT_TABLE table=default.Table_2e55a33b7465440fa8d8514ad988f3dc [id=bd345ab54d2640ab81ef3154b405dcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.384724 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67387c8aba1f4d728b3691c5da720e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.386400 896 tablet_service.cc:1511] Processing CreateTablet for tablet 388c63dc20da408ca3e141ada0200be6 (DEFAULT_TABLE table=default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.386731 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388c63dc20da408ca3e141ada0200be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.387837 1275 raft_consensus.cc:493] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.387961 1275 raft_consensus.cc:515] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.388579 1275 leader_election.cc:290] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.388808 898 tablet_service.cc:1511] Processing CreateTablet for tablet e63048335fe349ebb6001b37e63a389e (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:51.388954 715 consensus_peers.cc:597] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:51.389168 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e63048335fe349ebb6001b37e63a389e (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.389252 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63048335fe349ebb6001b37e63a389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.389508 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63048335fe349ebb6001b37e63a389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.389698 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.390184 715 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.390309 754 tablet_service.cc:1511] Processing CreateTablet for tablet e63048335fe349ebb6001b37e63a389e (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.390666 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63048335fe349ebb6001b37e63a389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.390636 1275 raft_consensus.cc:493] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.390807 1275 raft_consensus.cc:515] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.391355 1275 leader_election.cc:290] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.392150 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.393667 715 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.395113 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 (DEFAULT_TABLE table=default.Table_1e38efcdb18e448da420a2bac887722e [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.395442 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4674c22562f744f5bce13d97ad8a52b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.395864 886 tablet_service.cc:1511] Processing CreateTablet for tablet efec3cb45daf44e59132ea4d8929bd43 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.396284 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efec3cb45daf44e59132ea4d8929bd43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.396368 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.62:44841, user_credentials={real_user=slave}} blocked reactor thread for 46912.8us
I20260503 07:52:51.396423 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.396628 1053 raft_consensus.cc:2468] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:51.397246 716 leader_election.cc:304] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.398132 1275 raft_consensus.cc:2804] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.398221 1275 raft_consensus.cc:493] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.398649 1275 raft_consensus.cc:3060] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.400092 744 tablet_service.cc:1511] Processing CreateTablet for tablet 36b6147bab7a44b19b4a22addf68961f (DEFAULT_TABLE table=default.Table_b8ad59be3a314aa6add6938852b18b80 [id=3d888bf2f21f4ebe977dc94daf24a8bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.400450 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b6147bab7a44b19b4a22addf68961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.400677 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 36b6147bab7a44b19b4a22addf68961f (DEFAULT_TABLE table=default.Table_b8ad59be3a314aa6add6938852b18b80 [id=3d888bf2f21f4ebe977dc94daf24a8bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.401015 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b6147bab7a44b19b4a22addf68961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.401103 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.401268 1052 raft_consensus.cc:2468] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:51.401626 716 leader_election.cc:304] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.403112 1170 raft_consensus.cc:2804] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.403208 1170 raft_consensus.cc:493] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.404429 1170 raft_consensus.cc:3060] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.406433 887 tablet_service.cc:1511] Processing CreateTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 (DEFAULT_TABLE table=default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.406776 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d4cfb8426c485eb7ff408e04f69141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.407202 743 tablet_service.cc:1511] Processing CreateTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 (DEFAULT_TABLE table=default.Table_1e38efcdb18e448da420a2bac887722e [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.408255 1029 tablet_service.cc:1511] Processing CreateTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 (DEFAULT_TABLE table=default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.408581 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d4cfb8426c485eb7ff408e04f69141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.414206 888 tablet_service.cc:1511] Processing CreateTablet for tablet 36b6147bab7a44b19b4a22addf68961f (DEFAULT_TABLE table=default.Table_b8ad59be3a314aa6add6938852b18b80 [id=3d888bf2f21f4ebe977dc94daf24a8bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.414311 1275 raft_consensus.cc:515] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.414734 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b6147bab7a44b19b4a22addf68961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.415373 889 tablet_service.cc:1511] Processing CreateTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 (DEFAULT_TABLE table=default.Table_1e38efcdb18e448da420a2bac887722e [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.415750 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4674c22562f744f5bce13d97ad8a52b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.416496 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:51.416680 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 67387c8aba1f4d728b3691c5da720e4d (DEFAULT_TABLE table=default.Table_2e55a33b7465440fa8d8514ad988f3dc [id=bd345ab54d2640ab81ef3154b405dcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.417065 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67387c8aba1f4d728b3691c5da720e4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.417029 715 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.415387 1170 raft_consensus.cc:515] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.421396 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:51.421991 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e004ece846459c89f920fb5567f2ad" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:51.422186 1053 raft_consensus.cc:3060] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.426126 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cb0d3dedda9548889d35745848bf96df" } modify_external_catalogs: true
I20260503 07:52:51.426311 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cb0d3dedda9548889d35745848bf96df" } modify_external_catalogs: true
W20260503 07:52:51.426617 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1498486dd3db414c8062cba2d54037bb consensus state has no leader
I20260503 07:52:51.426954 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_72659aafd2334ea8ae99e668e5c7ba4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.427534 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72659aafd2334ea8ae99e668e5c7ba4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.427945 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_65c6bc92985540169483b8658efddc00" } modify_external_catalogs: true
I20260503 07:52:51.428083 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_65c6bc92985540169483b8658efddc00" } modify_external_catalogs: true
I20260503 07:52:51.433454 1053 raft_consensus.cc:2468] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:51.434942 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3168a0cf68f4838b82266d53ad00419" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:51.435153 1052 raft_consensus.cc:3060] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.438824 1052 raft_consensus.cc:2468] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:51.439298 741 tablet_service.cc:1511] Processing CreateTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 (DEFAULT_TABLE table=default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.439834 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4674c22562f744f5bce13d97ad8a52b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.440407 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d4cfb8426c485eb7ff408e04f69141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.440444 1170 leader_election.cc:290] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:51.440672 715 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:51.440937 716 consensus_peers.cc:597] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51494da361814bf1917182ed2952e28d. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:51.441206 716 leader_election.cc:304] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.441820 716 leader_election.cc:304] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.442206 1232 raft_consensus.cc:2804] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:51.442595 1170 raft_consensus.cc:2804] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:51.446184 1275 leader_election.cc:290] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:51.448287 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c224dc90387c4848a5dd802d0674265d has no consensus state
I20260503 07:52:51.448689 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7777e79b5e0b47edac66885f4b7b9655" } modify_external_catalogs: true
I20260503 07:52:51.448884 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7777e79b5e0b47edac66885f4b7b9655" } modify_external_catalogs: true
I20260503 07:52:51.448932 895 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d50a71c1a4bf799de34af1064597d (DEFAULT_TABLE table=default.Table_f7a7f9d12ac04700b8fd3dc35af1591b [id=b4769938686e4c029e1acaf768d192e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.449383 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d50a71c1a4bf799de34af1064597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.450333 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d] alter complete (version 3)
I20260503 07:52:51.451527 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a19065f28ee44933a0522bfa28696058
I20260503 07:52:51.451957 592 catalog_manager.cc:6741] ReplaceTablet: tablet a19065f28ee44933a0522bfa28696058 deleted and replaced by tablet 8d0487d02934453fbb25104f3b8fe732
I20260503 07:52:51.452237 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a19065f28ee44933a0522bfa28696058 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d0487d02934453fbb25104f3b8fe732) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.452322 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:51.453002 596 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 11d53a50ac8b4999a48b72c99dac62a6
I20260503 07:52:51.453279 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bb96ba84739c45b7847f0c43ab4a08e7
I20260503 07:52:51.455785 1450 tablet.cc:1724] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:51.456714 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a19065f28ee44933a0522bfa28696058 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d0487d02934453fbb25104f3b8fe732) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.457023 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.457203 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.459708 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.459771 747 tablet_service.cc:1558] Processing DeleteTablet for tablet a19065f28ee44933a0522bfa28696058 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d0487d02934453fbb25104f3b8fe732) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.459987 761 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.460629 884 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.461027 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.461234 1392 raft_consensus.cc:493] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.461398 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.462347 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.462546 742 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.461388 1392 raft_consensus.cc:515] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.463243 1392 leader_election.cc:290] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.463800 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:51.464972 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:51.465031 854 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 9c01aea82d584140bbabba1f5be65539
I20260503 07:52:51.465655 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:51.467059 851 leader_election.cc:343] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9c01aea82d584140bbabba1f5be65539
I20260503 07:52:51.467170 851 leader_election.cc:304] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.467408 1392 raft_consensus.cc:2749] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.467689 1165 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.467902 1165 ts_tablet_manager.cc:1403] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.003s
I20260503 07:52:51.468989 1165 raft_consensus.cc:359] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.469270 1165 raft_consensus.cc:385] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.469362 1165 raft_consensus.cc:740] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.469699 1165 consensus_queue.cc:260] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.470752 1165 ts_tablet_manager.cc:1434] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:51.471144 1165 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.473496 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.477645 1173 ts_tablet_manager.cc:1929] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.477859 1173 log.cc:1199] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c37459b741904a8696064201992d4591
I20260503 07:52:51.478458 1173 ts_tablet_manager.cc:1950] T c37459b741904a8696064201992d4591 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:51.479434 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 121) took 1384 ms. Trace:
W20260503 07:52:51.479921 1171 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.652s user 0.141s sys 0.164s
W20260503 07:52:51.480042 1171 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.652s user 0.141s sys 0.164s
I20260503 07:52:51.481103 1171 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.481259 1171 ts_tablet_manager.cc:1403] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.657s user 0.143s sys 0.164s
I20260503 07:52:51.482223 1165 tablet_bootstrap.cc:654] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.482143 1171 raft_consensus.cc:359] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.482326 1171 raft_consensus.cc:385] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.482424 1171 raft_consensus.cc:740] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.482659 1171 consensus_queue.cc:260] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.483389 1171 ts_tablet_manager.cc:1434] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:51.483672 1171 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:51.439265 1174 ts_tablet_manager.cc:1929] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.485134 1174 log.cc:1199] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:51.485731 1275 raft_consensus.cc:493] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.485948 1275 raft_consensus.cc:515] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.487123 1275 leader_election.cc:290] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.487252 1171 tablet_bootstrap.cc:654] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.487929 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:51.488605 716 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.488902 1170 raft_consensus.cc:697] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:51.489259 1170 consensus_queue.cc:237] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.490777 1232 raft_consensus.cc:697] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:51.491109 1232 consensus_queue.cc:237] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.492861 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]). Expected version 3 got 0
I20260503 07:52:51.493322 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dd76629713d747b490c83581cc03596c
I20260503 07:52:51.495311 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet dd76629713d747b490c83581cc03596c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.495479 1174 ts_tablet_manager.cc:1950] T dfb47ec875ab44fbaa270a84224f5432 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.496842 1174 tablet_replica.cc:333] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.497126 1174 raft_consensus.cc:2243] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.497403 1174 pending_rounds.cc:70] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:51.497495 1174 pending_rounds.cc:77] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847380713271296 op_type: NO_OP noop_request { }
I20260503 07:52:51.499507 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet dfb47ec875ab44fbaa270a84224f5432 (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
W20260503 07:52:51.499768 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 96f7244292c3400dad2812e0adb162ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96f7244292c3400dad2812e0adb162ef already in progress: creating tablet
I20260503 07:52:51.499912 1171 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.500248 1173 rpcz_store.cc:276] 0503 07:52:50.095187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.095244 (+ 57us) service_pool.cc:224] Handling call
0503 07:52:51.059046 (+963802us) ts_tablet_manager.cc:1151] Deleting tablet c37459b741904a8696064201992d4591
0503 07:52:51.059058 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.267203 (+208145us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.477545 (+210342us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.479399 (+ 1854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963597}
I20260503 07:52:51.500564 1171 ts_tablet_manager.cc:1403] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.007s
I20260503 07:52:51.500631 1165 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.500758 1165 ts_tablet_manager.cc:1403] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260503 07:52:51.501881 1171 raft_consensus.cc:359] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.502110 1171 raft_consensus.cc:385] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.502194 1171 raft_consensus.cc:740] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.502506 1171 consensus_queue.cc:260] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.503355 1171 ts_tablet_manager.cc:1434] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:51.504309 1175 ts_tablet_manager.cc:1929] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.504499 1175 log.cc:1199] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:51.504962 1175 ts_tablet_manager.cc:1950] T 7ce867777c0e46d1af4785e667e7a18e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:51.497617 1174 raft_consensus.cc:2889] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:51.505604 1174 raft_consensus.cc:2272] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.505895 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c37459b741904a8696064201992d4591 (table default.Table_9316d28baa15464dab512f62ff026c9b [id=e584f5aeed87488bb32ed60f397d9d90]) successfully deleted
I20260503 07:52:51.506069 1171 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:51.506282 1173 tablet_replica.cc:333] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:51.506291 1165 raft_consensus.cc:359] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.506466 1165 raft_consensus.cc:385] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.506560 1165 raft_consensus.cc:740] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.506696 1173 raft_consensus.cc:2243] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.506903 1173 raft_consensus.cc:2272] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.507331 1174 ts_tablet_manager.cc:1916] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.507565 1173 ts_tablet_manager.cc:1916] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.508567 887 tablet_service.cc:1558] Processing DeleteTablet for tablet dd76629713d747b490c83581cc03596c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.484529 1166 tablet_bootstrap.cc:492] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:51.508819 1166 ts_tablet_manager.cc:1403] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.200s user 0.002s sys 0.002s
I20260503 07:52:51.509093 1171 tablet_bootstrap.cc:654] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.487030 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.498837 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c01aea82d584140bbabba1f5be65539 with delete_type TABLET_DATA_DELETED (replaced by tablet 430e7da7fa8f462781163322dbe3e2c0) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:51.510100 715 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.510176 743 tablet_service.cc:1558] Processing DeleteTablet for tablet dd76629713d747b490c83581cc03596c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.510281 715 leader_election.cc:304] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.510392 1166 raft_consensus.cc:359] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.510596 1166 raft_consensus.cc:385] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.510684 1166 raft_consensus.cc:740] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.510947 1170 raft_consensus.cc:2749] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.510914 1166 consensus_queue.cc:260] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.511299 1165 consensus_queue.cc:260] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.511996 1165 ts_tablet_manager.cc:1434] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260503 07:52:51.515064 1166 ts_tablet_manager.cc:1434] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:52:51.516359 1166 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:51.516956 1165 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.518812 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 91d799ca2780461b89ced316e9f3ac92 with delete_type TABLET_DATA_DELETED (replaced by tablet 96f7244292c3400dad2812e0adb162ef) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.519940 1165 tablet_bootstrap.cc:654] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.521454 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3ad664ab8d5b44e388431152c86fa2c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.522087 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ad664ab8d5b44e388431152c86fa2c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.522632 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7de9390d9cce4a0ab3ed232174f9ed0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.523201 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7de9390d9cce4a0ab3ed232174f9ed0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.525799 1166 tablet_bootstrap.cc:654] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.529258 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_41955bf1ee7940bbba5877433307da3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.529824 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41955bf1ee7940bbba5877433307da3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.531726 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ab17883c0da04bce9b118eed3644a137" } new_table_name: "default.Table_ef6bd24087bd4d8185d51b095d3aa5f0" modify_external_catalogs: true
I20260503 07:52:51.533434 1171 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.533684 1171 ts_tablet_manager.cc:1403] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.007s
I20260503 07:52:51.534682 1392 raft_consensus.cc:493] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.534852 1392 raft_consensus.cc:515] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.534899 1171 raft_consensus.cc:359] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.535463 1392 leader_election.cc:290] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.535596 1171 raft_consensus.cc:385] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.535718 1171 raft_consensus.cc:740] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.535972 1171 consensus_queue.cc:260] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.537019 851 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9030916bd2e04c08b07f568123eead02
W20260503 07:52:51.537233 854 leader_election.cc:343] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 9030916bd2e04c08b07f568123eead02
I20260503 07:52:51.537343 854 leader_election.cc:304] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:51.537550 1392 raft_consensus.cc:2749] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.537779 1174 ts_tablet_manager.cc:1929] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.537894 1174 log.cc:1199] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:51.538285 1174 ts_tablet_manager.cc:1950] T 91d799ca2780461b89ced316e9f3ac92 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.538990 1171 ts_tablet_manager.cc:1434] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:52:51.539283 1171 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:51.541492 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 141) took 1021 ms. Trace:
I20260503 07:52:51.541607 1174 rpcz_store.cc:276] 0503 07:52:50.520043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.520121 (+ 78us) service_pool.cc:224] Handling call
0503 07:52:51.496766 (+976645us) ts_tablet_manager.cc:1151] Deleting tablet 91d799ca2780461b89ced316e9f3ac92
0503 07:52:51.496775 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.522515 (+ 25740us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.537670 (+ 15155us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.541456 (+ 3786us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":976449}
I20260503 07:52:51.543802 1171 tablet_bootstrap.cc:654] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.544401 1174 tablet_replica.cc:333] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.544516 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 91d799ca2780461b89ced316e9f3ac92 (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
I20260503 07:52:51.544584 1174 raft_consensus.cc:2243] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.544783 1174 raft_consensus.cc:2272] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.546324 1174 ts_tablet_manager.cc:1916] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:51.548270 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f11c020bd0484adfa6d7dae67818f7e5 consensus state has no leader
I20260503 07:52:51.553519 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 7ce867777c0e46d1af4785e667e7a18e (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
I20260503 07:52:51.554473 896 tablet_service.cc:1511] Processing CreateTablet for tablet e6fcade062b24ee280d4943d3254df03 (DEFAULT_TABLE table=default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.554988 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fcade062b24ee280d4943d3254df03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.556649 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_86865dc38b714cffba0b12cff2f8f53b [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 1 got 0
I20260503 07:52:51.559826 1175 tablet_replica.cc:333] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:51.560595 743 tablet_service.cc:1511] Processing CreateTablet for tablet 262678b948bd46b6886277f8dd790441 (DEFAULT_TABLE table=default.Table_11378258563d415586230d101efb0247 [id=6f2dee6dc12f4eb1a99cf69412d2d256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.561347 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262678b948bd46b6886277f8dd790441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.564323 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 262678b948bd46b6886277f8dd790441 (DEFAULT_TABLE table=default.Table_11378258563d415586230d101efb0247 [id=6f2dee6dc12f4eb1a99cf69412d2d256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.564776 1029 tablet_service.cc:1511] Processing CreateTablet for tablet e6fcade062b24ee280d4943d3254df03 (DEFAULT_TABLE table=default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.566641 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262678b948bd46b6886277f8dd790441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.566696 741 tablet_service.cc:1511] Processing CreateTablet for tablet e6fcade062b24ee280d4943d3254df03 (DEFAULT_TABLE table=default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.567111 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fcade062b24ee280d4943d3254df03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.567878 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1c047f13d94420949c1288b12725a5 (DEFAULT_TABLE table=default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.568288 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1c047f13d94420949c1288b12725a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.569284 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:51.569499 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_86865dc38b714cffba0b12cff2f8f53b [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 1 got 0
I20260503 07:52:51.574190 595 master_service.cc:954] ReplaceTablet: received request to replace tablet dda159becff6466abdcd84193f40a65e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.582075 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fcade062b24ee280d4943d3254df03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.582754 593 master_service.cc:954] ReplaceTablet: received request to replace tablet efec3cb45daf44e59132ea4d8929bd43 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.582831 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f7a7f9d12ac04700b8fd3dc35af1591b" } new_table_name: "default.Table_62a09d48e39c4cbd9d1a556f9f36ea79" modify_external_catalogs: true
I20260503 07:52:51.584003 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dda159becff6466abdcd84193f40a65e
I20260503 07:52:51.583916 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_37fe199604d94951a1102d8fa23209d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.584462 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37fe199604d94951a1102d8fa23209d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.585006 595 catalog_manager.cc:6741] ReplaceTablet: tablet dda159becff6466abdcd84193f40a65e deleted and replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3
I20260503 07:52:51.585094 1174 ts_tablet_manager.cc:1929] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.585222 1174 log.cc:1199] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:51.585552 1174 ts_tablet_manager.cc:1950] T 295cfe6e7a7043b2905a6e90dd520002 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.585516 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f331a5d6fa53414699446191d6622545"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.585947 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f331a5d6fa53414699446191d6622545 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.586287 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 142) took 1066 ms. Trace:
I20260503 07:52:51.586421 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89a64841c9a24c769960fd2771507347" } new_table_name: "default.Table_8d86476402b74bc1b5074ad74a7f08ab" modify_external_catalogs: true
I20260503 07:52:51.586371 1174 rpcz_store.cc:276] 0503 07:52:50.522274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.522382 (+ 108us) service_pool.cc:224] Handling call
0503 07:52:51.544336 (+1021954us) ts_tablet_manager.cc:1151] Deleting tablet 295cfe6e7a7043b2905a6e90dd520002
0503 07:52:51.544347 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.582123 (+ 37776us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.585030 (+ 2907us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.586229 (+ 1199us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007152}
I20260503 07:52:51.587172 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 295cfe6e7a7043b2905a6e90dd520002 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
I20260503 07:52:51.588047 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.589273 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1c047f13d94420949c1288b12725a5 (DEFAULT_TABLE table=default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.589684 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1c047f13d94420949c1288b12725a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.591248 1171 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.591405 1171 ts_tablet_manager.cc:1403] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.016s
I20260503 07:52:51.591562 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4b4c47d9f77147ee8df6ed83f184ea80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.592012 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4c47d9f77147ee8df6ed83f184ea80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.592605 1171 raft_consensus.cc:359] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.592793 1171 raft_consensus.cc:385] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.592862 1171 raft_consensus.cc:740] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.592981 1432 raft_consensus.cc:493] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.593094 1432 raft_consensus.cc:515] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.593153 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1c047f13d94420949c1288b12725a5 (DEFAULT_TABLE table=default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.593185 1171 consensus_queue.cc:260] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.593755 1171 ts_tablet_manager.cc:1434] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:51.594089 1171 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:51.594460 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet efec3cb45daf44e59132ea4d8929bd43
I20260503 07:52:51.594867 593 catalog_manager.cc:6741] ReplaceTablet: tablet efec3cb45daf44e59132ea4d8929bd43 deleted and replaced by tablet 314f539af5e44f048ff42619fcda1943
I20260503 07:52:51.595710 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.595860 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1c047f13d94420949c1288b12725a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.596365 1171 tablet_bootstrap.cc:654] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.597659 741 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.598271 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9457d5693eb4f3da5501a0e581fe75c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:51.598577 779 raft_consensus.cc:2468] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:51.593701 1432 leader_election.cc:290] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.600322 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 5e2c6d9dd87646ed9d1f86761f13f628 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.600569 986 leader_election.cc:304] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:51.601037 1432 raft_consensus.cc:2804] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.601150 1432 raft_consensus.cc:493] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.601233 1432 raft_consensus.cc:3060] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.604453 1432 raft_consensus.cc:515] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.604909 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e9d50a71c1a4bf799de34af1064597d consensus state has no leader
I20260503 07:52:51.605733 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.609481 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9457d5693eb4f3da5501a0e581fe75c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:51.610226 988 leader_election.cc:343] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.610428 886 tablet_service.cc:1511] Processing CreateTablet for tablet 262678b948bd46b6886277f8dd790441 (DEFAULT_TABLE table=default.Table_11378258563d415586230d101efb0247 [id=6f2dee6dc12f4eb1a99cf69412d2d256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.610915 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9457d5693eb4f3da5501a0e581fe75c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.611506 895 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:51.611536 988 leader_election.cc:343] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.614117 1165 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.614296 1165 ts_tablet_manager.cc:1403] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.097s user 0.006s sys 0.016s
I20260503 07:52:51.615092 1165 raft_consensus.cc:359] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.615280 1165 raft_consensus.cc:385] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.615355 1165 raft_consensus.cc:740] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.615600 1165 consensus_queue.cc:260] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.617249 1165 ts_tablet_manager.cc:1434] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:52:51.617549 1165 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.620553 1165 tablet_bootstrap.cc:654] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.623246 1432 leader_election.cc:290] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.623680 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9457d5693eb4f3da5501a0e581fe75c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:51.623843 741 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.623917 779 raft_consensus.cc:3060] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.624025 1175 raft_consensus.cc:2243] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.624279 1175 raft_consensus.cc:2272] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.625088 1175 ts_tablet_manager.cc:1916] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.624953 892 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.626744 779 raft_consensus.cc:2468] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:51.627357 986 leader_election.cc:304] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.630228 1432 raft_consensus.cc:2804] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:51.630849 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b470d3e5308242b8979e833e01444cf3" } new_table_name: "default.Table_f0a921f6b8344bbab898c35c3c59d1a2" modify_external_catalogs: true
I20260503 07:52:51.631191 1432 raft_consensus.cc:697] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:51.631616 1432 consensus_queue.cc:237] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.632454 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_90dc37ff14be4d1e964da0574ac9bd31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:51.632906 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:51.632959 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90dc37ff14be4d1e964da0574ac9bd31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.634519 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_44421a5083b5445b90c4daedbcd54e3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.635273 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44421a5083b5445b90c4daedbcd54e3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.635540 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262678b948bd46b6886277f8dd790441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.642459 599 catalog_manager.cc:5671] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:51.642863 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_86865dc38b714cffba0b12cff2f8f53b [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 1 got 0
W20260503 07:52:51.643404 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26da686862f44940b13c7790e00ea3b1 consensus state has no leader
I20260503 07:52:51.645152 1165 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.645323 1165 ts_tablet_manager.cc:1403] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.007s
I20260503 07:52:51.646176 1165 raft_consensus.cc:359] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.646353 1165 raft_consensus.cc:385] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.646452 1165 raft_consensus.cc:740] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.646713 1165 consensus_queue.cc:260] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.649012 1174 tablet_replica.cc:333] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.649358 1174 raft_consensus.cc:2243] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.649822 1174 pending_rounds.cc:70] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:51.653800 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (DEFAULT_TABLE table=default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6 [id=2eaba4e8d05245a6bc3e02fad14314d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.654528 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 56749914e1a349f0876f52157affdf69 (DEFAULT_TABLE table=default.Table_bdbdd2e346404637b28164b4a3a71312 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.654964 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56749914e1a349f0876f52157affdf69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.660080 1166 tablet_bootstrap.cc:492] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:51.660272 1166 ts_tablet_manager.cc:1403] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.144s user 0.007s sys 0.005s
I20260503 07:52:51.661127 1166 raft_consensus.cc:359] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.661321 1166 raft_consensus.cc:385] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.661394 1166 raft_consensus.cc:740] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.661679 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ac8d392c3bb94f03819fae08fc009fbc (DEFAULT_TABLE table=default.Table_2c09bafa7c9e4f9784dfdb48a31685db [id=a95805f323654a5a9355c882cda4d708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.661767 1166 consensus_queue.cc:260] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:51.662200 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8d392c3bb94f03819fae08fc009fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.664419 1166 ts_tablet_manager.cc:1434] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:51.664649 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c224dc90387c4848a5dd802d0674265d (DEFAULT_TABLE table=default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.665122 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c224dc90387c4848a5dd802d0674265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.668506 1024 tablet_service.cc:1511] Processing CreateTablet for tablet eea048c5820349d481ac54a570b57649 (DEFAULT_TABLE table=default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.668954 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea048c5820349d481ac54a570b57649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.668946 1173 ts_tablet_manager.cc:1929] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.669080 1173 log.cc:1199] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d3a35d4033e24b95962a2acf9d19c13f
I20260503 07:52:51.669415 1173 ts_tablet_manager.cc:1950] T d3a35d4033e24b95962a2acf9d19c13f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:51.674612 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_17c257396f9c4761ba776cc3a79d2e11" } new_table_name: "default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75" modify_external_catalogs: true
I20260503 07:52:51.677394 1166 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:51.678257 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c8528bc9a27424185c3afea1df39fc9" } modify_external_catalogs: true
I20260503 07:52:51.678429 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c8528bc9a27424185c3afea1df39fc9" } modify_external_catalogs: true
I20260503 07:52:51.679106 887 tablet_service.cc:1511] Processing CreateTablet for tablet ac8d392c3bb94f03819fae08fc009fbc (DEFAULT_TABLE table=default.Table_2c09bafa7c9e4f9784dfdb48a31685db [id=a95805f323654a5a9355c882cda4d708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.681545 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 1609d01e6cdc440085a6ebdb652d54f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e634f8f2aaf4456a64ced5049bdfe21) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.681970 892 tablet_service.cc:1511] Processing CreateTablet for tablet 56749914e1a349f0876f52157affdf69 (DEFAULT_TABLE table=default.Table_bdbdd2e346404637b28164b4a3a71312 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.682387 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56749914e1a349f0876f52157affdf69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.682968 898 tablet_service.cc:1511] Processing CreateTablet for tablet eea048c5820349d481ac54a570b57649 (DEFAULT_TABLE table=default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.683442 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea048c5820349d481ac54a570b57649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.679109 889 tablet_service.cc:1511] Processing CreateTablet for tablet c224dc90387c4848a5dd802d0674265d (DEFAULT_TABLE table=default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.686760 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c224dc90387c4848a5dd802d0674265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.691413 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8d392c3bb94f03819fae08fc009fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.694633 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 117) took 1606 ms. Trace:
I20260503 07:52:51.694754 1173 rpcz_store.cc:276] 0503 07:52:50.088323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.098574 (+ 10251us) service_pool.cc:224] Handling call
0503 07:52:51.506219 (+1407645us) ts_tablet_manager.cc:1151] Deleting tablet d3a35d4033e24b95962a2acf9d19c13f
0503 07:52:51.506230 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.562493 (+ 56263us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.668863 (+106370us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.694579 (+ 25716us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407325}
I20260503 07:52:51.695122 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d3a35d4033e24b95962a2acf9d19c13f (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
I20260503 07:52:51.695230 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f291c68785bb4b6fb522386089fb2af3 (DEFAULT_TABLE table=default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.695668 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f291c68785bb4b6fb522386089fb2af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.695811 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d937bc608e824591965885933c947fb9" } modify_external_catalogs: true
I20260503 07:52:51.696506 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d937bc608e824591965885933c947fb9" } modify_external_catalogs: true
I20260503 07:52:51.697757 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_98e9901242b1442fb99571a1b25d7c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.698272 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98e9901242b1442fb99571a1b25d7c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.698848 895 tablet_service.cc:1511] Processing CreateTablet for tablet f291c68785bb4b6fb522386089fb2af3 (DEFAULT_TABLE table=default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.702977 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:52:51.703406 595 catalog_manager.cc:6741] ReplaceTablet: tablet 5e2c6d9dd87646ed9d1f86761f13f628 deleted and replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:52:51.704876 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_223806904cb84dcfb31434dee4a4d0e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.705339 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_223806904cb84dcfb31434dee4a4d0e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:51.706427 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f0489d86704462ab237e5226df1251f consensus state has no leader
I20260503 07:52:51.706676 592 master_service.cc:954] ReplaceTablet: received request to replace tablet c46873d43e1b4495a92996e07f93f918 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.707983 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2366a5c6383a445a94641d3de6d15462" } modify_external_catalogs: true
I20260503 07:52:51.708143 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2366a5c6383a445a94641d3de6d15462" } modify_external_catalogs: true
I20260503 07:52:51.709551 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aedf5ef6a71e40c194d650861851082d" } modify_external_catalogs: true
I20260503 07:52:51.709717 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aedf5ef6a71e40c194d650861851082d" } modify_external_catalogs: true
I20260503 07:52:51.711669 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.712100 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.712280 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:51.712687 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aaaeda1a5d6d436292cd1688f8a4d467 has no consensus state
I20260503 07:52:51.713352 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 65fbd09bd319440cadcc84f1d55e7bde
I20260503 07:52:51.714178 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.714512 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.714848 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b5459e78eccc4416aa5499c77c631adb" } modify_external_catalogs: true
I20260503 07:52:51.714982 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b5459e78eccc4416aa5499c77c631adb" } modify_external_catalogs: true
I20260503 07:52:51.726275 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c00976f3444c43618af30259f0567d17
I20260503 07:52:51.726969 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.727159 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.732678 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (DEFAULT_TABLE table=default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6 [id=2eaba4e8d05245a6bc3e02fad14314d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.738312 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_38ec270c366e4af089360207052b918a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:51.738451 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_435024514d32468b8d6241ec62521b54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.739001 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_435024514d32468b8d6241ec62521b54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:51.739120 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38ec270c366e4af089360207052b918a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.650660 1165 ts_tablet_manager.cc:1434] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260503 07:52:51.653725 743 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (DEFAULT_TABLE table=default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6 [id=2eaba4e8d05245a6bc3e02fad14314d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.744320 1174 pending_rounds.cc:77] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847379920240640 op_type: NO_OP noop_request { }
I20260503 07:52:51.744496 1174 raft_consensus.cc:2889] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:51.744606 1174 raft_consensus.cc:2272] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.744690 1165 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.744722 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.654484 741 tablet_service.cc:1511] Processing CreateTablet for tablet 56749914e1a349f0876f52157affdf69 (DEFAULT_TABLE table=default.Table_bdbdd2e346404637b28164b4a3a71312 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.748497 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56749914e1a349f0876f52157affdf69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.748553 1165 tablet_bootstrap.cc:654] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.753013 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_89408c07c1db4b7b806167183545cbd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.753633 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89408c07c1db4b7b806167183545cbd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.753953 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_86865dc38b714cffba0b12cff2f8f53b" } new_table_name: "default.Table_4917964578ff4ec598fb3f4a4494f466" modify_external_catalogs: true
I20260503 07:52:51.656478 742 tablet_service.cc:1511] Processing CreateTablet for tablet f291c68785bb4b6fb522386089fb2af3 (DEFAULT_TABLE table=default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.755625 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f291c68785bb4b6fb522386089fb2af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.665748 746 tablet_service.cc:1511] Processing CreateTablet for tablet ac8d392c3bb94f03819fae08fc009fbc (DEFAULT_TABLE table=default.Table_2c09bafa7c9e4f9784dfdb48a31685db [id=a95805f323654a5a9355c882cda4d708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.756513 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8d392c3bb94f03819fae08fc009fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.758949 1165 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.759095 1165 ts_tablet_manager.cc:1403] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20260503 07:52:51.759929 1165 raft_consensus.cc:359] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.760104 1165 raft_consensus.cc:385] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.760192 1165 raft_consensus.cc:740] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.666111 754 tablet_service.cc:1511] Processing CreateTablet for tablet c224dc90387c4848a5dd802d0674265d (DEFAULT_TABLE table=default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.760433 1165 consensus_queue.cc:260] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.760593 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c224dc90387c4848a5dd802d0674265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.760969 1165 ts_tablet_manager.cc:1434] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:51.761330 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c46873d43e1b4495a92996e07f93f918
I20260503 07:52:51.761778 592 catalog_manager.cc:6741] ReplaceTablet: tablet c46873d43e1b4495a92996e07f93f918 deleted and replaced by tablet 92c1709a2a49475daaa2372360610b1e
I20260503 07:52:51.762372 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.763401 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.764004 1165 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.764719 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.765585 1174 ts_tablet_manager.cc:1916] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.765700 1171 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.765831 1171 ts_tablet_manager.cc:1403] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.172s user 0.041s sys 0.062s
I20260503 07:52:51.766275 1456 raft_consensus.cc:493] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.766431 1456 raft_consensus.cc:515] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.766575 1171 raft_consensus.cc:359] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.766752 1171 raft_consensus.cc:385] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.766827 1171 raft_consensus.cc:740] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.766912 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]). Expected version 3 got 0
I20260503 07:52:51.767019 1171 consensus_queue.cc:260] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.767124 1456 leader_election.cc:290] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.666414 744 tablet_service.cc:1511] Processing CreateTablet for tablet eea048c5820349d481ac54a570b57649 (DEFAULT_TABLE table=default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.767459 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741a28af9fe946db8c9305aa1dabe999" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.767658 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea048c5820349d481ac54a570b57649. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.767936 715 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.769498 1165 tablet_bootstrap.cc:654] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.770527 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]). Expected version 3 got 0
I20260503 07:52:51.773072 1166 tablet_bootstrap.cc:654] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.773691 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f291c68785bb4b6fb522386089fb2af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.700448 1232 raft_consensus.cc:493] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.777473 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a45012e871b4c14a3fafb4443e1e92b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.777359 1232 raft_consensus.cc:515] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.777647 1165 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.777792 1165 ts_tablet_manager.cc:1403] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20260503 07:52:51.778079 1232 leader_election.cc:290] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.778473 1165 raft_consensus.cc:359] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.778638 1165 raft_consensus.cc:385] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.778738 1165 raft_consensus.cc:740] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.778923 1165 consensus_queue.cc:260] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.704308 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.779677 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 388c63dc20da408ca3e141ada0200be6
I20260503 07:52:51.714389 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.727321 745 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.728008 1170 raft_consensus.cc:493] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.780007 1170 raft_consensus.cc:515] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.780630 1170 leader_election.cc:290] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.780665 1165 ts_tablet_manager.cc:1434] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:52:51.780676 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.780944 1165 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.781365 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.782505 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a45012e871b4c14a3fafb4443e1e92b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.783324 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.784215 1165 tablet_bootstrap.cc:654] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:51.785650 715 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:51.785876 715 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.794441 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f291c68785bb4b6fb522386089fb2af3
I20260503 07:52:51.796464 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.799031 887 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.799329 1173 tablet_replica.cc:333] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:51.799571 1173 raft_consensus.cc:2243] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.799868 1173 raft_consensus.cc:2272] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.800904 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.805900 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:51.807379 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.808333 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.808787 1171 ts_tablet_manager.cc:1434] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:52:51.810791 1173 ts_tablet_manager.cc:1916] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.810920 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b27d2d45e739451ba9c47687239cfbf3" } new_table_name: "default.Table_fba12625060d45f8822e66e12a8564c3" modify_external_catalogs: true
I20260503 07:52:51.823211 1174 ts_tablet_manager.cc:1929] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.827344 601 master_service.cc:954] ReplaceTablet: received request to replace tablet b77c5c6954554eac970d1e3fb1387c2b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.831092 601 master_service.cc:954] ReplaceTablet: received request to replace tablet b77c5c6954554eac970d1e3fb1387c2b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:51.833529 1171 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:51.833691 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a45012e871b4c14a3fafb4443e1e92b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.830912 1170 raft_consensus.cc:493] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.833559 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741a28af9fe946db8c9305aa1dabe999" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.834297 1170 raft_consensus.cc:515] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:51.835121 1170 leader_election.cc:290] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.835855 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce867777c0e46d1af4785e667e7a18e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:51.836426 715 leader_election.cc:343] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.836668 1174 log.cc:1199] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/51494da361814bf1917182ed2952e28d
I20260503 07:52:51.837136 1174 ts_tablet_manager.cc:1950] T 51494da361814bf1917182ed2952e28d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:52:51.838173 716 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.838318 716 leader_election.cc:304] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.838886 1170 raft_consensus.cc:2749] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.838315 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 157) took 1160 ms. Trace:
W20260503 07:52:51.839658 716 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.839788 716 leader_election.cc:304] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.840055 1170 raft_consensus.cc:2749] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.841029 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.839479 1174 rpcz_store.cc:276] 0503 07:52:50.677817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.769043 (+ 91226us) service_pool.cc:224] Handling call
0503 07:52:51.647375 (+878332us) ts_tablet_manager.cc:1151] Deleting tablet 51494da361814bf1917182ed2952e28d
0503 07:52:51.648915 (+ 1540us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.819965 (+171050us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.823147 (+ 3182us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.838228 (+ 15081us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":873929}
I20260503 07:52:51.841241 1432 raft_consensus.cc:493] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.841660 1174 tablet_replica.cc:333] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.841785 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 51494da361814bf1917182ed2952e28d (table default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]) successfully deleted
I20260503 07:52:51.841984 1174 raft_consensus.cc:2243] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.842204 1174 raft_consensus.cc:2272] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.842527 1173 ts_tablet_manager.cc:1929] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:51.843240 1173 log.cc:1199] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/5690198617de4f568132e24708d77418
I20260503 07:52:51.843693 1173 ts_tablet_manager.cc:1950] T 5690198617de4f568132e24708d77418 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:51.843981 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.844724 1432 raft_consensus.cc:515] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.845366 1432 leader_election.cc:290] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.847604 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.847865 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.848184 1171 tablet_bootstrap.cc:654] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.848167 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_615397b098fd48f5881cdc79eb932980"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.848754 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_615397b098fd48f5881cdc79eb932980 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.848853 1052 raft_consensus.cc:2468] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:51.846999 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.849963 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c9b63835c2c34ebc91932d55e7621cf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.850135 988 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:51.850925 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9b63835c2c34ebc91932d55e7621cf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.846320 1165 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.846447 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:51.851177 779 raft_consensus.cc:2468] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:51.849457 716 leader_election.cc:304] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.851481 1165 ts_tablet_manager.cc:1403] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.070s user 0.012s sys 0.018s
I20260503 07:52:51.851588 986 leader_election.cc:304] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:51.851744 716 leader_election.cc:343] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:51.851881 716 leader_election.cc:304] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.851971 1432 raft_consensus.cc:2804] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.852053 1432 raft_consensus.cc:493] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.852145 1432 raft_consensus.cc:3060] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.852257 1170 raft_consensus.cc:2804] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.852373 1170 raft_consensus.cc:493] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.852311 1165 raft_consensus.cc:359] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.852463 1170 raft_consensus.cc:3060] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.852507 1165 raft_consensus.cc:385] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.852586 1165 raft_consensus.cc:740] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.852831 1165 consensus_queue.cc:260] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.853232 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_443ee7a0c4b748cfbd655c2326e527d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:51.853317 1165 ts_tablet_manager.cc:1434] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260503 07:52:51.853657 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_443ee7a0c4b748cfbd655c2326e527d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.854734 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b89b9f7fb8b8435485a75bce914f0edd" } new_table_name: "default.Table_157ae3f1f274402c9578a83a27a09e8a" modify_external_catalogs: true
I20260503 07:52:51.855266 1170 raft_consensus.cc:515] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.855973 1170 leader_election.cc:290] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.856618 1165 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.857653 1170 raft_consensus.cc:2749] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.858157 1165 tablet_bootstrap.cc:654] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.858438 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:51.861470 779 raft_consensus.cc:1275] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:51.862322 1175 ts_tablet_manager.cc:1929] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.862569 1438 consensus_queue.cc:1048] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:51.863142 1175 log.cc:1199] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f3e004ece846459c89f920fb5567f2ad
I20260503 07:52:51.863144 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:51.863656 1175 ts_tablet_manager.cc:1950] T f3e004ece846459c89f920fb5567f2ad P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:51.863698 592 catalog_manager.cc:6741] ReplaceTablet: tablet 8a45012e871b4c14a3fafb4443e1e92b deleted and replaced by tablet fb821b329d284643a889b07f9a4f287e
I20260503 07:52:51.868371 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b with delete_type TABLET_DATA_DELETED (replaced by tablet fb821b329d284643a889b07f9a4f287e) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:51.864217 1438 raft_consensus.cc:493] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.869046 1438 raft_consensus.cc:515] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.869608 1432 raft_consensus.cc:515] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.869738 1438 leader_election.cc:290] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.870149 1053 raft_consensus.cc:2393] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a924c2134c54fa0bb164825da53bdd0 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:51.870391 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:51.870586 781 raft_consensus.cc:2468] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:51.871119 986 leader_election.cc:304] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:51.871484 1438 raft_consensus.cc:2804] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.871577 1438 raft_consensus.cc:493] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.871677 1438 raft_consensus.cc:3060] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.874914 1438 raft_consensus.cc:515] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.875819 1438 leader_election.cc:290] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.876300 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:51.876506 781 raft_consensus.cc:3060] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.877086 1432 leader_election.cc:290] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.878019 1165 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.878202 1165 ts_tablet_manager.cc:1403] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.003s
I20260503 07:52:51.879245 1165 raft_consensus.cc:359] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.879458 781 raft_consensus.cc:2468] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:51.880431 986 leader_election.cc:304] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:51.844308 1174 ts_tablet_manager.cc:1916] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.880821 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:51.881049 781 raft_consensus.cc:2393] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c11eb9ffa7845269a6a8000e8ff248f in current term 1: Already voted for candidate 4a924c2134c54fa0bb164825da53bdd0 in this term.
I20260503 07:52:51.881515 1432 raft_consensus.cc:2804] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:51.881671 1432 raft_consensus.cc:697] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:51.881927 1432 consensus_queue.cc:237] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.879463 1165 raft_consensus.cc:385] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.885895 1165 raft_consensus.cc:740] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.886623 1165 consensus_queue.cc:260] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.888263 1171 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.868741 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b with delete_type TABLET_DATA_DELETED (replaced by tablet fb821b329d284643a889b07f9a4f287e) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:51.888437 1171 ts_tablet_manager.cc:1403] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.012s
I20260503 07:52:51.889246 1171 raft_consensus.cc:359] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.889432 1171 raft_consensus.cc:385] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.889555 1171 raft_consensus.cc:740] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.889815 1171 consensus_queue.cc:260] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.890339 1171 ts_tablet_manager.cc:1434] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:51.890620 1171 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:51.891453 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d647277295e42cdb65f45a619e63960 consensus state has no leader
I20260503 07:52:51.891834 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f3e004ece846459c89f920fb5567f2ad (table default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]) successfully deleted
I20260503 07:52:51.892508 1165 ts_tablet_manager.cc:1434] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260503 07:52:51.892807 1165 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.893292 1171 tablet_bootstrap.cc:654] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.893658 1175 tablet_replica.cc:333] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:51.893855 1175 raft_consensus.cc:2243] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.894019 1175 raft_consensus.cc:2272] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.894481 1175 ts_tablet_manager.cc:1916] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.896128 1165 tablet_bootstrap.cc:654] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.897647 1498 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:51.903647 1165 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.903815 1165 ts_tablet_manager.cc:1403] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260503 07:52:51.904527 1165 raft_consensus.cc:359] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.904716 1165 raft_consensus.cc:385] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.904773 1165 raft_consensus.cc:740] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.904980 1165 consensus_queue.cc:260] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.905376 1165 ts_tablet_manager.cc:1434] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:52:51.905645 1165 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.907649 1165 tablet_bootstrap.cc:654] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:51.910192 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1c704f0fb29c4a8983559bb1bddd8cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:51.911027 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_98e9901242b1442fb99571a1b25d7c42" } new_table_name: "default.Table_184be13fa24a4b018786f553392278f4" modify_external_catalogs: true
I20260503 07:52:51.897796 1449 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:51.912729 1171 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:51.915261 1171 ts_tablet_manager.cc:1403] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.001s
I20260503 07:52:51.917235 1495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.61:41759 every 8 connection(s)
I20260503 07:52:51.921479 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:51.924961 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c704f0fb29c4a8983559bb1bddd8cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.925276 1235 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.61:41759
I20260503 07:52:51.927279 1174 ts_tablet_manager.cc:1929] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.927328 1235 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
I20260503 07:52:51.927397 1174 log.cc:1199] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:51.927755 1174 ts_tablet_manager.cc:1950] T 4d4d8dfc410a40ec825d8e45e07388f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.927913 1171 raft_consensus.cc:359] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:51.928113 715 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.928290 715 leader_election.cc:304] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:51.928562 1170 raft_consensus.cc:2749] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:52:51.929420 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a33e9be9e212414fa02ff5ca89a05939" } modify_external_catalogs: true
I20260503 07:52:51.929634 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a33e9be9e212414fa02ff5ca89a05939" } modify_external_catalogs: true
I20260503 07:52:51.929718 1165 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:51.929844 1165 ts_tablet_manager.cc:1403] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260503 07:52:51.930559 1165 raft_consensus.cc:359] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.930755 1165 raft_consensus.cc:385] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.930855 1165 raft_consensus.cc:740] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.931234 1165 consensus_queue.cc:260] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.931538 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5ebfc83a66b04f3e91b9dc64f418a18a" } new_table_name: "default.Table_36df81222de94d7c86c22dec78ccd60b" modify_external_catalogs: true
I20260503 07:52:51.931758 1165 ts_tablet_manager.cc:1434] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:51.931766 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 1235
I20260503 07:52:51.932802 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_70a08a7d21814abd8119d3980268f54f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.933342 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70a08a7d21814abd8119d3980268f54f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.933717 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f0a921f6b8344bbab898c35c3c59d1a2" } modify_external_catalogs: true
I20260503 07:52:51.933866 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f0a921f6b8344bbab898c35c3c59d1a2" } modify_external_catalogs: true
W20260503 07:52:51.939841 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e634f8f2aaf4456a64ced5049bdfe21 consensus state has no leader
I20260503 07:52:51.940706 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 4d4d8dfc410a40ec825d8e45e07388f6 (table default.Table_0b06a748faa64b029ec876cdcfc0478f [id=27c0ca8e039e4316b8878cbe7df0ddb0]) successfully deleted
W20260503 07:52:51.941004 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ed95a89bf4bc4b6fa72b224f49082423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed95a89bf4bc4b6fa72b224f49082423 already in progress: creating tablet
I20260503 07:52:51.941032 1165 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:51.943122 1165 tablet_bootstrap.cc:654] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:51.946060 988 consensus_peers.cc:597] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:51.946600 1174 tablet_replica.cc:333] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:52:51.946712 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce181da64bad49389a64df1ade0e90ef has no consensus state
I20260503 07:52:51.946810 1174 raft_consensus.cc:2243] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.946971 1174 raft_consensus.cc:2272] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:51.947394 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3da9549389254875b94268abc5c3bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3da9549389254875b94268abc5c3bb3e already in progress: creating tablet
I20260503 07:52:51.947690 1174 ts_tablet_manager.cc:1916] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.949179 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b with delete_type TABLET_DATA_DELETED (replaced by tablet fb821b329d284643a889b07f9a4f287e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:51.950114 1171 raft_consensus.cc:385] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:51.950744 1171 raft_consensus.cc:740] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:51.951010 1171 consensus_queue.cc:260] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.951685 1171 ts_tablet_manager.cc:1434] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260503 07:52:51.951965 1171 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:51.952903 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0655ef28c1d4326b2f462ab6fd8d604 consensus state has no leader
I20260503 07:52:51.956451 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]). Expected version 2 got 0
I20260503 07:52:51.956594 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:51.957244 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]). Expected version 3 got 0
I20260503 07:52:51.957399 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 122) took 1697 ms. Trace:
I20260503 07:52:51.957599 1171 tablet_bootstrap.cc:654] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:51.957840 988 leader_election.cc:343] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.958974 1033 tablet_service.cc:1511] Processing CreateTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f (DEFAULT_TABLE table=default.Table_90dc37ff14be4d1e964da0574ac9bd31 [id=f334cc96ca794a41a2fcd3fc170444d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.959364 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0c0f5999ee4b9cae56cbb3695de12f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.959623 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 61228.1us
I20260503 07:52:51.961755 1174 ts_tablet_manager.cc:1929] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.961922 1174 log.cc:1199] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:51.962212 1174 ts_tablet_manager.cc:1950] T a60a9ee2cc5a42efa1201e12622d4df1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.962487 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 0f45941fd2c94161b5438fe65f858b95 (DEFAULT_TABLE table=default.Table_37fe199604d94951a1102d8fa23209d9 [id=d18504297995448bb3a4a0edad330588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.962563 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_3dd5aa971d3b4a8fb492904c36f285ce [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 1 got 0
I20260503 07:52:51.962883 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f45941fd2c94161b5438fe65f858b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.963555 1174 tablet_replica.cc:333] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.963719 1174 raft_consensus.cc:2243] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.963869 1174 raft_consensus.cc:2272] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.964421 1174 ts_tablet_manager.cc:1916] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.967610 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9dc3b574e7bb4a08a849197b8fd27ac2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.968180 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dc3b574e7bb4a08a849197b8fd27ac2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.968441 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 (DEFAULT_TABLE table=default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.971139 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f0de2626accf4770bdab3f0e2bcb9a10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:51.971679 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0de2626accf4770bdab3f0e2bcb9a10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:51.971937 742 tablet_service.cc:1511] Processing CreateTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f (DEFAULT_TABLE table=default.Table_90dc37ff14be4d1e964da0574ac9bd31 [id=f334cc96ca794a41a2fcd3fc170444d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.972302 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0c0f5999ee4b9cae56cbb3695de12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.974187 1174 ts_tablet_manager.cc:1929] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.974382 1174 log.cc:1199] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/a19065f28ee44933a0522bfa28696058
I20260503 07:52:51.974828 1174 ts_tablet_manager.cc:1950] T a19065f28ee44933a0522bfa28696058 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.976027 1174 tablet_replica.cc:333] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.976070 754 tablet_service.cc:1511] Processing CreateTablet for tablet 0f45941fd2c94161b5438fe65f858b95 (DEFAULT_TABLE table=default.Table_37fe199604d94951a1102d8fa23209d9 [id=d18504297995448bb3a4a0edad330588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.976351 1174 raft_consensus.cc:2243] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.976426 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f45941fd2c94161b5438fe65f858b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.976531 1174 raft_consensus.cc:2272] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.977087 1174 ts_tablet_manager.cc:1916] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.982528 1499 raft_consensus.cc:493] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.982671 1499 raft_consensus.cc:515] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.983284 1499 leader_election.cc:290] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:51.983841 1173 rpcz_store.cc:276] 0503 07:52:50.225261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.225318 (+ 57us) service_pool.cc:224] Handling call
0503 07:52:51.719119 (+1493801us) ts_tablet_manager.cc:1151] Deleting tablet 5690198617de4f568132e24708d77418
0503 07:52:51.799242 (+ 80123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.826217 (+ 26975us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.842417 (+ 16200us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:51.923094 (+ 80677us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1493347}
I20260503 07:52:51.984254 1173 tablet_replica.cc:333] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:51.984464 1173 raft_consensus.cc:2243] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:51.984692 1173 raft_consensus.cc:2272] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.984752 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19ad357f7845fc8389cb5b923bc253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.984763 1174 ts_tablet_manager.cc:1929] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:51.984869 1174 log.cc:1199] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:51.985211 1174 ts_tablet_manager.cc:1950] T 7ce867777c0e46d1af4785e667e7a18e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:51.985263 1173 ts_tablet_manager.cc:1916] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.985777 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:51.985952 781 raft_consensus.cc:2468] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:51.986346 986 leader_election.cc:304] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:51.986572 1174 tablet_replica.cc:333] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:51.986964 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 (DEFAULT_TABLE table=default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.987314 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b0329a61dd4476bc0a65e90404efb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.987439 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d79067c0c8594d50aa458d47b31d99af (DEFAULT_TABLE table=default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.987807 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79067c0c8594d50aa458d47b31d99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.989763 1170 raft_consensus.cc:493] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:51.989894 1170 raft_consensus.cc:515] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:51.990469 1170 leader_election.cc:290] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:51.991096 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:51.991719 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 5690198617de4f568132e24708d77418 (table default.Table_666b4a99d24544c2a0a8f2e466eda7c1 [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:52:51.991454 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:51.991931 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (DEFAULT_TABLE table=default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.992244 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:51.992522 716 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:51.992775 1499 raft_consensus.cc:2804] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:51.992882 1499 raft_consensus.cc:493] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:51.992969 1023 tablet_service.cc:1511] Processing CreateTablet for tablet d58deacb99c643d89a6641ef09b026ba (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:51.993320 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58deacb99c643d89a6641ef09b026ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:51.992987 1499 raft_consensus.cc:3060] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:51.994354 1174 raft_consensus.cc:2243] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:51.994663 1174 pending_rounds.cc:70] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:51.994774 1174 pending_rounds.cc:77] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847384023027712 op_type: NO_OP noop_request { }
I20260503 07:52:51.994956 1174 raft_consensus.cc:2889] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:51.995106 1174 raft_consensus.cc:2272] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:51.995157 593 catalog_manager.cc:5671] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:51.995549 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]). Expected version 3 got 0
I20260503 07:52:51.995999 1174 ts_tablet_manager.cc:1916] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:51.957132 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19065f28ee44933a0522bfa28696058" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:51.997638 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet a60a9ee2cc5a42efa1201e12622d4df1 (table default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]) successfully deleted
W20260503 07:52:51.997891 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet fe2b065666ec4f1299b47d45cd1f600b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe2b065666ec4f1299b47d45cd1f600b already in progress: creating tablet
W20260503 07:52:51.998131 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c37459b741904a8696064201992d4591 because the tablet was not found. No further retry: Not found: Tablet not found: c37459b741904a8696064201992d4591
W20260503 07:52:51.998307 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1609d01e6cdc440085a6ebdb652d54f1 because the tablet was not found. No further retry: Not found: Tablet not found: 1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:51.999950 741 tablet_service.cc:1511] Processing CreateTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 (DEFAULT_TABLE table=default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.000312 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19ad357f7845fc8389cb5b923bc253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.002863 1174 ts_tablet_manager.cc:1929] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:52.002976 1174 log.cc:1199] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b3168a0cf68f4838b82266d53ad00419
I20260503 07:52:52.003288 1174 ts_tablet_manager.cc:1950] T b3168a0cf68f4838b82266d53ad00419 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.004150 743 tablet_service.cc:1511] Processing CreateTablet for tablet d79067c0c8594d50aa458d47b31d99af (DEFAULT_TABLE table=default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.007555 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79067c0c8594d50aa458d47b31d99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.004458 744 tablet_service.cc:1511] Processing CreateTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 (DEFAULT_TABLE table=default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.012619 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b0329a61dd4476bc0a65e90404efb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.004571 1174 tablet_replica.cc:333] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.016444 1174 raft_consensus.cc:2243] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:52.016721 1174 pending_rounds.cc:70] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:52.016784 1174 pending_rounds.cc:77] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847384030629888 op_type: NO_OP noop_request { }
I20260503 07:52:52.016916 1174 raft_consensus.cc:2889] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:52.017025 1174 raft_consensus.cc:2272] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.004658 746 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (DEFAULT_TABLE table=default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.017598 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.017928 1174 ts_tablet_manager.cc:1916] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.004873 745 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 (DEFAULT_TABLE table=default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.019311 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f99c7855a4485b3523b68b0ea24c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.005129 747 tablet_service.cc:1511] Processing CreateTablet for tablet 314f539af5e44f048ff42619fcda1943 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.024323 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f539af5e44f048ff42619fcda1943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.005348 761 tablet_service.cc:1511] Processing CreateTablet for tablet e16d225dde3247d1b61a03cf14b21d63 (DEFAULT_TABLE table=default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.028576 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16d225dde3247d1b61a03cf14b21d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.029333 1505 sys_catalog.cc:263] Verifying existing consensus state
I20260503 07:52:52.031213 1174 ts_tablet_manager.cc:1929] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:52.031723 1174 log.cc:1199] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f3e004ece846459c89f920fb5567f2ad
I20260503 07:52:52.005563 751 tablet_service.cc:1511] Processing CreateTablet for tablet d58deacb99c643d89a6641ef09b026ba (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.033515 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58deacb99c643d89a6641ef09b026ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.033994 1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Bootstrap starting.
I20260503 07:52:52.005766 759 tablet_service.cc:1511] Processing CreateTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 (DEFAULT_TABLE table=default.Table_7de9390d9cce4a0ab3ed232174f9ed0a [id=1773e021ed7c489aa09d73e171b34837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.036564 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028017b7cc74ef6a199d6b9e0ba6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.006008 758 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 (DEFAULT_TABLE table=default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.040576 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeda1a5d6d436292cd1688f8a4d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.054461 1170 raft_consensus.cc:493] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.054649 1170 raft_consensus.cc:515] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.055215 1170 leader_election.cc:290] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.056033 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8a6c13c0ab45f0ae784e1ab352a0bc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:52.056798 716 leader_election.cc:343] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.057062 1173 ts_tablet_manager.cc:1929] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:52:52.057211 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.061707 886 tablet_service.cc:1511] Processing CreateTablet for tablet 0f45941fd2c94161b5438fe65f858b95 (DEFAULT_TABLE table=default.Table_37fe199604d94951a1102d8fa23209d9 [id=d18504297995448bb3a4a0edad330588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.062273 1173 log.cc:1199] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/06670a873e994cbea50627dc7eb02e0e
I20260503 07:52:52.062697 1173 ts_tablet_manager.cc:1950] T 06670a873e994cbea50627dc7eb02e0e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:52.063058 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 123) took 1837 ms. Trace:
I20260503 07:52:52.063145 1173 rpcz_store.cc:276] 0503 07:52:50.225985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.226034 (+ 49us) service_pool.cc:224] Handling call
0503 07:52:51.984172 (+1758138us) ts_tablet_manager.cc:1151] Deleting tablet 06670a873e994cbea50627dc7eb02e0e
0503 07:52:51.984183 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:51.988881 (+ 4698us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.007707 (+ 18826us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.063010 (+ 55303us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1757850}
I20260503 07:52:52.063584 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 128) took 1739 ms. Trace:
I20260503 07:52:52.063668 1173 rpcz_store.cc:276] 0503 07:52:50.323679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.323862 (+ 183us) service_pool.cc:224] Handling call
0503 07:52:52.063408 (+1739546us) ts_tablet_manager.cc:1151] Deleting tablet 8c4ec79454524d468c76fd01dec8eb1e
0503 07:52:52.063418 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.063539 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1739336}
I20260503 07:52:52.064054 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 129) took 1740 ms. Trace:
I20260503 07:52:52.064133 1173 rpcz_store.cc:276] 0503 07:52:50.323791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.324099 (+ 308us) service_pool.cc:224] Handling call
0503 07:52:52.063924 (+1739825us) ts_tablet_manager.cc:1151] Deleting tablet 5dce60ad6aea4465a4ce04ea62bceb13
0503 07:52:52.063932 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.064006 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1739663}
I20260503 07:52:52.064541 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 125) took 1741 ms. Trace:
I20260503 07:52:52.064613 1173 rpcz_store.cc:276] 0503 07:52:50.323334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.346240 (+ 22906us) service_pool.cc:224] Handling call
0503 07:52:52.064415 (+1718175us) ts_tablet_manager.cc:1151] Deleting tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc
0503 07:52:52.064424 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.064492 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1717861}
I20260503 07:52:52.064934 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 131) took 1706 ms. Trace:
I20260503 07:52:52.065008 1173 rpcz_store.cc:276] 0503 07:52:50.358757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.374124 (+ 15367us) service_pool.cc:224] Handling call
0503 07:52:52.064784 (+1690660us) ts_tablet_manager.cc:1151] Deleting tablet af1b61a2548e4f3fafb4ed0982dbd9b2
0503 07:52:52.064792 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.064884 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1690370}
I20260503 07:52:52.065250 1173 tablet_replica.cc:333] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:52.065407 1173 raft_consensus.cc:2243] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.065564 1173 raft_consensus.cc:2272] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.066109 1173 ts_tablet_manager.cc:1916] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.067845 1171 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.067698 1021 tablet_service.cc:1511] Processing CreateTablet for tablet e16d225dde3247d1b61a03cf14b21d63 (DEFAULT_TABLE table=default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.069200 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 314f539af5e44f048ff42619fcda1943 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.069635 896 tablet_service.cc:1511] Processing CreateTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f (DEFAULT_TABLE table=default.Table_90dc37ff14be4d1e964da0574ac9bd31 [id=f334cc96ca794a41a2fcd3fc170444d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.007025 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_72659aafd2334ea8ae99e668e5c7ba4e" } modify_external_catalogs: true
I20260503 07:52:52.060151 1175 ts_tablet_manager.cc:1929] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.070088 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_72659aafd2334ea8ae99e668e5c7ba4e" } modify_external_catalogs: true
I20260503 07:52:52.070166 1171 ts_tablet_manager.cc:1403] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.118s user 0.006s sys 0.007s
I20260503 07:52:52.070236 1175 log.cc:1199] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b3168a0cf68f4838b82266d53ad00419
I20260503 07:52:52.070621 1175 ts_tablet_manager.cc:1950] T b3168a0cf68f4838b82266d53ad00419 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:52.070636 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.070883 1022 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 (DEFAULT_TABLE table=default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.071096 1171 raft_consensus.cc:359] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.071581 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:52.052158 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5f99ea98c214f3681e6ffa4ff664cea" } modify_external_catalogs: true
I20260503 07:52:52.071698 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 (DEFAULT_TABLE table=default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.071792 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5f99ea98c214f3681e6ffa4ff664cea" } modify_external_catalogs: true
I20260503 07:52:52.072660 887 tablet_service.cc:1511] Processing CreateTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 (DEFAULT_TABLE table=default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:51.998498 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d7807da20d4c4b90a9e387cb72813557 because the tablet was not found. No further retry: Not found: Tablet not found: d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:52.074837 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 06670a873e994cbea50627dc7eb02e0e (table default.Table_6706232b137041bd87a007ba2091f7c6 [id=a73654d3dcae49909e766eb795334a56]) successfully deleted
W20260503 07:52:52.073801 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 75118.9us
I20260503 07:52:52.075022 1171 raft_consensus.cc:385] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.075122 1171 raft_consensus.cc:740] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:52.075112 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8c4ec79454524d468c76fd01dec8eb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c4ec79454524d468c76fd01dec8eb1e already in progress: creating tablet
W20260503 07:52:52.075304 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5dce60ad6aea4465a4ce04ea62bceb13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dce60ad6aea4465a4ce04ea62bceb13 already in progress: creating tablet
I20260503 07:52:52.071450 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 (DEFAULT_TABLE table=default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:52.075496 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc already in progress: creating tablet
W20260503 07:52:52.075717 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af1b61a2548e4f3fafb4ed0982dbd9b2 already in progress: creating tablet
I20260503 07:52:52.075780 895 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (DEFAULT_TABLE table=default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:52.077744 715 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.077957 715 leader_election.cc:304] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:52.077620 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0481b55721854d70a670a79ff2f42dd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0481b55721854d70a670a79ff2f42dd6 already in progress: creating tablet
I20260503 07:52:52.080483 884 tablet_service.cc:1511] Processing CreateTablet for tablet e16d225dde3247d1b61a03cf14b21d63 (DEFAULT_TABLE table=default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.080783 888 tablet_service.cc:1511] Processing CreateTablet for tablet 314f539af5e44f048ff42619fcda1943 (DEFAULT_TABLE table=default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.081009 897 tablet_service.cc:1511] Processing CreateTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e (DEFAULT_TABLE table=default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.081218 883 tablet_service.cc:1511] Processing CreateTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (DEFAULT_TABLE table=default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.082705 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 656dfeb5247e4cdfaacd29690353da83
I20260503 07:52:52.082819 1392 raft_consensus.cc:493] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.082959 1392 raft_consensus.cc:515] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:52.083506 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2f0489d86704462ab237e5226df1251f
I20260503 07:52:52.083563 1392 leader_election.cc:290] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.084015 892 tablet_service.cc:1511] Processing CreateTablet for tablet d79067c0c8594d50aa458d47b31d99af (DEFAULT_TABLE table=default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.084450 889 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 (DEFAULT_TABLE table=default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.084733 881 tablet_service.cc:1511] Processing CreateTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.085223 890 tablet_service.cc:1511] Processing CreateTablet for tablet d58deacb99c643d89a6641ef09b026ba (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.085309 885 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0487d02934453fbb25104f3b8fe732 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.086236 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8a6c13c0ab45f0ae784e1ab352a0bc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.086578 893 tablet_service.cc:1511] Processing CreateTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 (DEFAULT_TABLE table=default.Table_7de9390d9cce4a0ab3ed232174f9ed0a [id=1773e021ed7c489aa09d73e171b34837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.087013 894 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 (DEFAULT_TABLE table=default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.087502 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f45941fd2c94161b5438fe65f858b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.088305 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0c0f5999ee4b9cae56cbb3695de12f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.088702 715 leader_election.cc:343] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.088703 1457 raft_consensus.cc:2749] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.088863 715 leader_election.cc:304] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.089587 1170 raft_consensus.cc:2749] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.091202 1171 consensus_queue.cc:260] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.075362 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 (DEFAULT_TABLE table=default.Table_7de9390d9cce4a0ab3ed232174f9ed0a [id=1773e021ed7c489aa09d73e171b34837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.095000 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet a19065f28ee44933a0522bfa28696058 (table default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]) successfully deleted
W20260503 07:52:52.097961 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bb96ba84739c45b7847f0c43ab4a08e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96ba84739c45b7847f0c43ab4a08e7 already in progress: creating tablet
I20260503 07:52:52.033527 1174 ts_tablet_manager.cc:1950] T f3e004ece846459c89f920fb5567f2ad P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.102816 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 7ce867777c0e46d1af4785e667e7a18e (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
I20260503 07:52:52.108507 598 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_4917964578ff4ec598fb3f4a4494f466 [id=5d74e1e18e8b45e88fd4e85b6214c334] alter complete (version 2)
W20260503 07:52:52.111104 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_fba12625060d45f8822e66e12a8564c3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d647277295e42cdb65f45a619e63960 consensus state has no leader
I20260503 07:52:52.112608 1170 raft_consensus.cc:493] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.112807 1170 raft_consensus.cc:515] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.109858 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b3168a0cf68f4838b82266d53ad00419 (table default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]) successfully deleted
I20260503 07:52:52.114055 1170 leader_election.cc:290] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.117581 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f3e004ece846459c89f920fb5567f2ad (table default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]) successfully deleted
I20260503 07:52:52.118065 1165 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.118219 1165 ts_tablet_manager.cc:1403] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.177s user 0.002s sys 0.002s
W20260503 07:52:52.118304 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8dd0b6afae47432e9da300ba07e970e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dd0b6afae47432e9da300ba07e970e5 already in progress: creating tablet
I20260503 07:52:52.119026 1165 raft_consensus.cc:359] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.119225 1165 raft_consensus.cc:385] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.119297 1165 raft_consensus.cc:740] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.119508 1165 consensus_queue.cc:260] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.120271 1174 tablet_replica.cc:333] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.121322 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f539af5e44f048ff42619fcda1943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.122655 1165 ts_tablet_manager.cc:1434] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:52.122992 1165 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.124675 1165 tablet_bootstrap.cc:654] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.132056 1174 raft_consensus.cc:2243] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:52.134337 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0487d02934453fbb25104f3b8fe732 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.134994 1174 raft_consensus.cc:2272] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.135722 744 tablet_service.cc:1511] Processing CreateTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.136926 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0487d02934453fbb25104f3b8fe732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.139096 747 tablet_service.cc:1511] Processing CreateTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (DEFAULT_TABLE table=default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.144192 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.145162 1166 tablet_bootstrap.cc:492] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:52.145505 1174 ts_tablet_manager.cc:1916] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.148327 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ea29e3b4a84735bb3723dd11449ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.149595 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeda1a5d6d436292cd1688f8a4d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.149721 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.150259 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:52.150962 854 leader_election.cc:343] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:52.153115 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19ad357f7845fc8389cb5b923bc253. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.153165 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 51754.6us
I20260503 07:52:52.154749 1166 ts_tablet_manager.cc:1403] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.468s user 0.000s sys 0.015s
I20260503 07:52:52.155555 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b0329a61dd4476bc0a65e90404efb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.156530 851 leader_election.cc:343] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:52.156626 1170 raft_consensus.cc:493] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.156795 1170 raft_consensus.cc:515] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.119506 759 tablet_service.cc:1511] Processing CreateTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e (DEFAULT_TABLE table=default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.157407 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.157666 1170 leader_election.cc:290] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.157809 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.158984 715 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.160463 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.161278 851 leader_election.cc:304] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.163972 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f539af5e44f048ff42619fcda1943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.165323 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ccdf187eb4cae9688ff4929f3e95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.166004 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeda1a5d6d436292cd1688f8a4d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.166496 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16d225dde3247d1b61a03cf14b21d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.168569 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.169303 715 leader_election.cc:343] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.171430 742 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.171713 1166 raft_consensus.cc:359] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:52.171988 1392 raft_consensus.cc:2749] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.172103 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.172874 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58deacb99c643d89a6641ef09b026ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.171993 1166 raft_consensus.cc:385] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.176649 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e (DEFAULT_TABLE table=default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.179143 1166 raft_consensus.cc:740] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.179436 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9b674b3ac5a442eca15573187fd35bc3" } modify_external_catalogs: true
I20260503 07:52:52.179591 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_62a09d48e39c4cbd9d1a556f9f36ea79" } new_table_name: "default.Table_6e7c2c4846b846de92b7b4650492d1ea" modify_external_catalogs: true
I20260503 07:52:52.179665 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9b674b3ac5a442eca15573187fd35bc3" } modify_external_catalogs: true
W20260503 07:52:52.179668 988 leader_election.cc:343] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.180104 1171 ts_tablet_manager.cc:1434] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.107s user 0.001s sys 0.001s
I20260503 07:52:52.180256 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_df35866b78694258ae9f45c83948baf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.180801 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df35866b78694258ae9f45c83948baf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.181272 1500 raft_consensus.cc:493] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.182035 1171 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.182000 1500 raft_consensus.cc:515] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:52.182201 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 86285.3us
I20260503 07:52:52.182530 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e163878262b2436381f0eb9403e7acce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.182699 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:52.183025 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e163878262b2436381f0eb9403e7acce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.183017 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0487d02934453fbb25104f3b8fe732 (DEFAULT_TABLE table=default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:52.183606 716 leader_election.cc:343] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.184443 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_71e1d22f05b440089329a58f532fa712"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.184587 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c3a5f74835a5418b947a72d7eafd9b70" } new_table_name: "default.Table_99bda6e3b48643d29d0e70fd0b3813e9" modify_external_catalogs: true
W20260503 07:52:52.184903 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e1d22f05b440089329a58f532fa712 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.187345 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e16d225dde3247d1b61a03cf14b21d63
I20260503 07:52:52.188150 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_33d33732cee3402b871062f8882acc78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.189499 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:52.190214 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 (DEFAULT_TABLE table=default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.191227 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_faade3cbf89744b0adc4feaebb6e4acd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.191669 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faade3cbf89744b0adc4feaebb6e4acd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.193063 1175 tablet_replica.cc:333] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:52.193037 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 75dfcff75f90434caf7dc26408958a16
I20260503 07:52:52.193236 1175 raft_consensus.cc:2243] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:52.193759 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f99c7855a4485b3523b68b0ea24c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.193707 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_febf12acb2bc45d68d60fce8e8f84325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.193975 1175 pending_rounds.cc:70] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:52.194032 1175 pending_rounds.cc:77] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847383172653056 op_type: NO_OP noop_request { }
W20260503 07:52:52.194160 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_febf12acb2bc45d68d60fce8e8f84325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.191694 1053 raft_consensus.cc:2468] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:52.194790 1175 raft_consensus.cc:2889] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:52.194903 1175 raft_consensus.cc:2272] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:52.196360 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33d33732cee3402b871062f8882acc78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.198431 716 leader_election.cc:304] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.198931 716 leader_election.cc:304] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.199518 1457 raft_consensus.cc:2749] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.199764 1457 raft_consensus.cc:2804] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:52.199846 1457 raft_consensus.cc:493] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:52.199968 1457 raft_consensus.cc:3060] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:52.201872 1505 log.cc:826] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Log is configured to *not* fsync() on all Append() calls
I20260503 07:52:52.202557 1457 raft_consensus.cc:515] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.203197 1457 leader_election.cc:290] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:52.208559 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e9d50a71c1a4bf799de34af1064597d consensus state has no leader
I20260503 07:52:52.208634 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.208856 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ef6bd24087bd4d8185d51b095d3aa5f0" } new_table_name: "default.Table_0ebc08471c1142c6809ceb1ded79d2f1" modify_external_catalogs: true
I20260503 07:52:52.208969 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_443ee7a0c4b748cfbd655c2326e527d5" } new_table_name: "default.Table_8e054473f51a46658409679b60b4f097" modify_external_catalogs: true
I20260503 07:52:52.209640 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:52.211279 988 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.211442 988 leader_election.cc:304] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:52.212193 986 leader_election.cc:343] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:52.212816 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79067c0c8594d50aa458d47b31d99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.213497 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ccdf187eb4cae9688ff4929f3e95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.213804 1174 ts_tablet_manager.cc:1929] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:52.196182 1500 leader_election.cc:290] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.215734 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (DEFAULT_TABLE table=default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.216933 1175 ts_tablet_manager.cc:1916] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.217106 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:52.218324 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028017b7cc74ef6a199d6b9e0ba6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.222287 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:52.222503 1053 raft_consensus.cc:3060] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:52.222975 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ea29e3b4a84735bb3723dd11449ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.224355 1174 log.cc:1199] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/dd76629713d747b490c83581cc03596c
I20260503 07:52:52.224918 1174 ts_tablet_manager.cc:1950] T dd76629713d747b490c83581cc03596c P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.226100 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet dd76629713d747b490c83581cc03596c (table default.Table_7777e79b5e0b47edac66885f4b7b9655 [id=e9446550434243a09cb7a71f278edef6]) successfully deleted
W20260503 07:52:52.226830 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet dda159becff6466abdcd84193f40a65e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dda159becff6466abdcd84193f40a65e already in progress: creating tablet
I20260503 07:52:52.227039 1432 raft_consensus.cc:2749] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260503 07:52:52.227473 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet efec3cb45daf44e59132ea4d8929bd43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efec3cb45daf44e59132ea4d8929bd43 already in progress: creating tablet
I20260503 07:52:52.227560 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0487d02934453fbb25104f3b8fe732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.227761 1174 tablet_replica.cc:333] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.227993 1174 raft_consensus.cc:2243] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.228152 1174 raft_consensus.cc:2272] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.228720 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.228796 1174 ts_tablet_manager.cc:1916] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:52.231266 988 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.231757 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b3168a0cf68f4838b82266d53ad00419 (table default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]) successfully deleted
W20260503 07:52:52.232421 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fe2b065666ec4f1299b47d45cd1f600b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe2b065666ec4f1299b47d45cd1f600b already in progress: creating tablet
I20260503 07:52:52.230517 1165 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.232987 1165 ts_tablet_manager.cc:1403] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.002s
I20260503 07:52:52.228665 1499 raft_consensus.cc:515] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.233860 1165 raft_consensus.cc:359] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.234062 1165 raft_consensus.cc:385] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.234150 1165 raft_consensus.cc:740] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.239540 1165 consensus_queue.cc:260] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.240289 1165 ts_tablet_manager.cc:1434] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260503 07:52:52.241928 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf0f650d2efd4a5d9308952b32fa7d63 consensus state has no leader
I20260503 07:52:52.242354 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f9ea98989bfe45d0b35a23b8ef67cd69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.243289 1165 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:52.243439 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.248260 1165 tablet_bootstrap.cc:654] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.249485 882 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.224303 1166 consensus_queue.cc:260] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:52.252583 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.252454 1174 ts_tablet_manager.cc:1929] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.253026 1174 log.cc:1199] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:52.253449 1174 ts_tablet_manager.cc:1950] T 741a28af9fe946db8c9305aa1dabe999 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.256793 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 with delete_type TABLET_DATA_DELETED (replaced by tablet 75dfcff75f90434caf7dc26408958a16) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.257634 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 741a28af9fe946db8c9305aa1dabe999 (table default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]) successfully deleted
W20260503 07:52:52.258255 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c46873d43e1b4495a92996e07f93f918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c46873d43e1b4495a92996e07f93f918 already in progress: creating tablet
I20260503 07:52:52.260151 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:52.260361 781 raft_consensus.cc:3060] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:52.261013 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.262545 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.263195 1171 tablet_bootstrap.cc:654] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.263569 781 raft_consensus.cc:2468] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:52:52.264537 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5e2c6d9dd87646ed9d1f86761f13f628 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e2c6d9dd87646ed9d1f86761f13f628 already in progress: creating tablet
W20260503 07:52:52.265321 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 65fbd09bd319440cadcc84f1d55e7bde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65fbd09bd319440cadcc84f1d55e7bde already in progress: creating tablet
I20260503 07:52:52.266484 1499 leader_election.cc:290] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:52.267108 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c00976f3444c43618af30259f0567d17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00976f3444c43618af30259f0567d17 already in progress: creating tablet
W20260503 07:52:52.267973 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 388c63dc20da408ca3e141ada0200be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 388c63dc20da408ca3e141ada0200be6 already in progress: creating tablet
I20260503 07:52:52.268308 986 leader_election.cc:304] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:52:52.268959 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f291c68785bb4b6fb522386089fb2af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f291c68785bb4b6fb522386089fb2af3 already in progress: creating tablet
W20260503 07:52:52.269609 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9336e5b80c644ebcb75455770eb45d70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9336e5b80c644ebcb75455770eb45d70 already in progress: creating tablet
I20260503 07:52:52.272456 1174 tablet_replica.cc:333] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.273111 1174 raft_consensus.cc:2243] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.273497 1174 raft_consensus.cc:2272] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.274232 1174 ts_tablet_manager.cc:1916] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.274559 1499 raft_consensus.cc:2804] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:52.274888 1499 raft_consensus.cc:697] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:52.275730 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.279534 1053 raft_consensus.cc:2468] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:52.275475 1165 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.280366 1165 ts_tablet_manager.cc:1403] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.002s
I20260503 07:52:52.281494 716 leader_election.cc:304] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:52.281783 1457 raft_consensus.cc:2804] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:52.281939 1457 raft_consensus.cc:697] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:52.282200 1457 consensus_queue.cc:237] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.276052 1499 consensus_queue.cc:237] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.281282 1165 raft_consensus.cc:359] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.285283 1165 raft_consensus.cc:385] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.285411 1165 raft_consensus.cc:740] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.285722 1165 consensus_queue.cc:260] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.286684 1165 ts_tablet_manager.cc:1434] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:52.287155 1165 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.289425 1165 tablet_bootstrap.cc:654] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.299572 1174 ts_tablet_manager.cc:1929] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.300104 1174 log.cc:1199] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:52.300693 1174 ts_tablet_manager.cc:1950] T 8a45012e871b4c14a3fafb4443e1e92b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.302382 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8a45012e871b4c14a3fafb4443e1e92b (table default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:52:52.303423 1165 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.303625 1165 ts_tablet_manager.cc:1403] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.004s
I20260503 07:52:52.308149 1165 raft_consensus.cc:359] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.308813 1165 raft_consensus.cc:385] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.308964 1165 raft_consensus.cc:740] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.309551 1165 consensus_queue.cc:260] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.310196 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fedc936702dc4dfa92e62db580accb77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.310811 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fedc936702dc4dfa92e62db580accb77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.311481 1165 ts_tablet_manager.cc:1434] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260503 07:52:52.311542 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.311851 1165 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:52.315754 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 656dfeb5247e4cdfaacd29690353da83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 656dfeb5247e4cdfaacd29690353da83 already in progress: creating tablet
I20260503 07:52:52.316182 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2b1956063b4f5e8bbef9f3d0eba359" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:52.316601 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2f0489d86704462ab237e5226df1251f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0489d86704462ab237e5226df1251f already in progress: creating tablet
W20260503 07:52:52.316772 715 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.317538 1174 tablet_replica.cc:333] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.318339 1165 tablet_bootstrap.cc:654] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.318725 1174 raft_consensus.cc:2243] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.319851 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2e55a33b7465440fa8d8514ad988f3dc" } new_table_name: "default.Table_29f9d87b702f4f08a7d36b2f3bd2028c" modify_external_catalogs: true
I20260503 07:52:52.319782 1174 raft_consensus.cc:2272] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.324388 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]). Expected version 1 got 0
I20260503 07:52:52.326757 747 tablet_service.cc:1511] Processing CreateTablet for tablet f5896bb71c674358957c87a347b8fb79 (DEFAULT_TABLE table=default.Table_443ee7a0c4b748cfbd655c2326e527d5 [id=4d435b963bd742c0b3d6da1c384015e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.327162 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5896bb71c674358957c87a347b8fb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.332468 744 tablet_service.cc:1511] Processing CreateTablet for tablet 468a420c2a87466398cad5dfd959b3be (DEFAULT_TABLE table=default.Table_c9b63835c2c34ebc91932d55e7621cf5 [id=7388cb975bc54f82b1682be2e66385d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.335000 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_944e0955d9b24f8b87c7645170a69ed4 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 1 got 0
I20260503 07:52:52.335314 594 catalog_manager.cc:5671] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:52.335639 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ea29e3b4a84735bb3723dd11449ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.335752 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]). Expected version 2 got 0
I20260503 07:52:52.337148 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468a420c2a87466398cad5dfd959b3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.344715 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.347216 742 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe (DEFAULT_TABLE table=default.Table_223806904cb84dcfb31434dee4a4d0e7 [id=86c390e37de0437eb62b1643d194d66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.347620 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8c25addae8c94554a83344f07a11362f (DEFAULT_TABLE table=default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.348222 758 tablet_service.cc:1511] Processing CreateTablet for tablet 399acb90cf124fcf8a75bf936e3e426f (DEFAULT_TABLE table=default.Table_435024514d32468b8d6241ec62521b54 [id=4050cfa4cfd842f1aecc75f586518139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.348604 751 tablet_service.cc:1511] Processing CreateTablet for tablet fb821b329d284643a889b07f9a4f287e (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.349817 741 tablet_service.cc:1511] Processing CreateTablet for tablet ce181da64bad49389a64df1ade0e90ef (DEFAULT_TABLE table=default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.350186 754 tablet_service.cc:1511] Processing CreateTablet for tablet feb88812c6b0459d86bd441926f57ecf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.350490 761 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1709a2a49475daaa2372360610b1e (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.350579 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.350939 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2546e95e0f40ad99f1ba6bc512debe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.351418 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1709a2a49475daaa2372360610b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.351922 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb88812c6b0459d86bd441926f57ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.352342 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c25addae8c94554a83344f07a11362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.353618 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce181da64bad49389a64df1ade0e90ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.355422 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8c25addae8c94554a83344f07a11362f (DEFAULT_TABLE table=default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.356669 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb821b329d284643a889b07f9a4f287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.358639 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399acb90cf124fcf8a75bf936e3e426f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.358848 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 399acb90cf124fcf8a75bf936e3e426f (DEFAULT_TABLE table=default.Table_435024514d32468b8d6241ec62521b54 [id=4050cfa4cfd842f1aecc75f586518139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.359412 1027 tablet_service.cc:1511] Processing CreateTablet for tablet feb88812c6b0459d86bd441926f57ecf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.359872 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f5896bb71c674358957c87a347b8fb79 (DEFAULT_TABLE table=default.Table_443ee7a0c4b748cfbd655c2326e527d5 [id=4d435b963bd742c0b3d6da1c384015e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.361418 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 468a420c2a87466398cad5dfd959b3be (DEFAULT_TABLE table=default.Table_c9b63835c2c34ebc91932d55e7621cf5 [id=7388cb975bc54f82b1682be2e66385d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.356823 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe (DEFAULT_TABLE table=default.Table_223806904cb84dcfb31434dee4a4d0e7 [id=86c390e37de0437eb62b1643d194d66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.365597 1029 tablet_service.cc:1511] Processing CreateTablet for tablet ce181da64bad49389a64df1ade0e90ef (DEFAULT_TABLE table=default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.366462 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1709a2a49475daaa2372360610b1e (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.368525 891 tablet_service.cc:1511] Processing CreateTablet for tablet 399acb90cf124fcf8a75bf936e3e426f (DEFAULT_TABLE table=default.Table_435024514d32468b8d6241ec62521b54 [id=4050cfa4cfd842f1aecc75f586518139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.368914 882 tablet_service.cc:1511] Processing CreateTablet for tablet f5896bb71c674358957c87a347b8fb79 (DEFAULT_TABLE table=default.Table_443ee7a0c4b748cfbd655c2326e527d5 [id=4d435b963bd742c0b3d6da1c384015e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.372783 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399acb90cf124fcf8a75bf936e3e426f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.381639 1171 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.381800 1171 ts_tablet_manager.cc:1403] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.201s user 0.007s sys 0.000s
I20260503 07:52:52.382714 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5896bb71c674358957c87a347b8fb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.383627 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1709a2a49475daaa2372360610b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.384037 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2546e95e0f40ad99f1ba6bc512debe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.384850 1166 ts_tablet_manager.cc:1434] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.157s user 0.001s sys 0.002s
I20260503 07:52:52.384999 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce181da64bad49389a64df1ade0e90ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.385035 1171 raft_consensus.cc:359] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.385203 1171 raft_consensus.cc:385] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.385738 1171 raft_consensus.cc:740] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.386489 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c25addae8c94554a83344f07a11362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.386720 1171 consensus_queue.cc:260] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.388556 1171 ts_tablet_manager.cc:1434] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:52.390699 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_808dbcf79af44f209e756d91fe98e82c" } modify_external_catalogs: true
I20260503 07:52:52.390913 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_808dbcf79af44f209e756d91fe98e82c" } modify_external_catalogs: true
I20260503 07:52:52.392374 600 catalog_manager.cc:5671] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:52.392832 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:52.392753 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 (DEFAULT_TABLE table=default.Table_1c704f0fb29c4a8983559bb1bddd8cb6 [id=d778245ff437405896430039f772e652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.394133 743 tablet_service.cc:1511] Processing CreateTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 (DEFAULT_TABLE table=default.Table_1c704f0fb29c4a8983559bb1bddd8cb6 [id=d778245ff437405896430039f772e652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.394542 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3650ec1de28c4f1bafd979257dd2b778. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.395902 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67387c8aba1f4d728b3691c5da720e4d consensus state has no leader
I20260503 07:52:52.396342 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468a420c2a87466398cad5dfd959b3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.396428 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2852281bb46a43eaa811335946a96990"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.396497 745 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (DEFAULT_TABLE table=default.Table_615397b098fd48f5881cdc79eb932980 [id=e4b1a8554c72416ababa0c721ec1fd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.396804 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9edbc50a8e4194a46ecb1666daa5f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.396955 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2852281bb46a43eaa811335946a96990 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:52.397500 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f11c020bd0484adfa6d7dae67818f7e5 consensus state has no leader
I20260503 07:52:52.397903 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ef63c1684f794aa696a7cb6077e06031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.398382 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef63c1684f794aa696a7cb6077e06031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:52.399513 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5896bb71c674358957c87a347b8fb79 consensus state has no leader
I20260503 07:52:52.400501 1457 raft_consensus.cc:493] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.400661 1457 raft_consensus.cc:515] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.401396 1457 leader_election.cc:290] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.396915 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_91536c63cda14993a1239c5b47af0f7b" } modify_external_catalogs: true
I20260503 07:52:52.402424 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_91536c63cda14993a1239c5b47af0f7b" } modify_external_catalogs: true
I20260503 07:52:52.404510 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:52:52.406625 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (DEFAULT_TABLE table=default.Table_615397b098fd48f5881cdc79eb932980 [id=e4b1a8554c72416ababa0c721ec1fd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.411253 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_98bf34009bfe4112bc02fc3b4688a1f6" } modify_external_catalogs: true
I20260503 07:52:52.411459 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_98bf34009bfe4112bc02fc3b4688a1f6" } modify_external_catalogs: true
I20260503 07:52:52.412791 1457 raft_consensus.cc:493] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.413774 1457 raft_consensus.cc:515] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.414003 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.414933 1457 leader_election.cc:290] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.415827 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2f491d2732c2492c8ba3fb5ad99aa755" } modify_external_catalogs: true
I20260503 07:52:52.415983 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2f491d2732c2492c8ba3fb5ad99aa755" } modify_external_catalogs: true
I20260503 07:52:52.418005 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b21f69cb6b1340b99c5f77b579063c15" } new_table_name: "default.Table_1c5b17831e3840c39a9fd9555ff84a2e" modify_external_catalogs: true
I20260503 07:52:52.419286 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_417aebd794cf47178e1eb3faf7d6b585"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.419900 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_417aebd794cf47178e1eb3faf7d6b585 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.382587 1031 tablet_service.cc:1511] Processing CreateTablet for tablet fb821b329d284643a889b07f9a4f287e (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.421962 1166 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:52.424108 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ccdf187eb4cae9688ff4929f3e95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.426857 1457 raft_consensus.cc:493] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.427024 1457 raft_consensus.cc:515] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.427667 1457 leader_election.cc:290] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.429018 879 tablet_service.cc:1511] Processing CreateTablet for tablet 8c25addae8c94554a83344f07a11362f (DEFAULT_TABLE table=default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.435930 886 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe (DEFAULT_TABLE table=default.Table_223806904cb84dcfb31434dee4a4d0e7 [id=86c390e37de0437eb62b1643d194d66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.437218 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.437759 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f99c7855a4485b3523b68b0ea24c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.429132 880 tablet_service.cc:1511] Processing CreateTablet for tablet 468a420c2a87466398cad5dfd959b3be (DEFAULT_TABLE table=default.Table_c9b63835c2c34ebc91932d55e7621cf5 [id=7388cb975bc54f82b1682be2e66385d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:52.438293 715 leader_election.cc:343] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.438572 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:52.438967 1171 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:52.440447 716 leader_election.cc:343] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.441140 716 leader_election.cc:304] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.441573 1457 raft_consensus.cc:2749] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.444581 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.444664 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4d8dfc410a40ec825d8e45e07388f6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.445122 715 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.447813 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89572734813f4d28846ffe38868a15c3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:52.445026 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89572734813f4d28846ffe38868a15c3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.450405 715 leader_election.cc:343] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:52.450556 716 leader_election.cc:343] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.450714 716 leader_election.cc:304] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.451373 1170 raft_consensus.cc:2749] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.451568 1170 raft_consensus.cc:493] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.451663 1170 raft_consensus.cc:515] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.451774 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb88812c6b0459d86bd441926f57ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.452280 1170 leader_election.cc:290] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.455367 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.456991 715 leader_election.cc:343] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.457630 1174 ts_tablet_manager.cc:1916] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.460521 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399acb90cf124fcf8a75bf936e3e426f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.462370 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 (DEFAULT_TABLE table=default.Table_89408c07c1db4b7b806167183545cbd5 [id=cb3204cb6061405bb6a2cdff89916775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.464287 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:52.465773 1520 log.cc:927] Time spent T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260503 07:52:52.467233 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_37fe199604d94951a1102d8fa23209d9" } new_table_name: "default.Table_5859483307f54d36a9343787dfc93b4b" modify_external_catalogs: true
I20260503 07:52:52.467464 759 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 (DEFAULT_TABLE table=default.Table_89408c07c1db4b7b806167183545cbd5 [id=cb3204cb6061405bb6a2cdff89916775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.468009 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d15e70ec4856a15ed7c6175cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.480458 1165 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.480636 1165 ts_tablet_manager.cc:1403] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.169s user 0.004s sys 0.000s
I20260503 07:52:52.481478 1165 raft_consensus.cc:359] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.481729 1165 raft_consensus.cc:385] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.481809 1165 raft_consensus.cc:740] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.482199 1165 consensus_queue.cc:260] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.484509 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468a420c2a87466398cad5dfd959b3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.489336 1173 ts_tablet_manager.cc:1929] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.489492 1173 log.cc:1199] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d7807da20d4c4b90a9e387cb72813557
I20260503 07:52:52.483516 1165 ts_tablet_manager.cc:1434] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:52.494598 1175 ts_tablet_manager.cc:1929] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:52.495003 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e6d4cfb8426c485eb7ff408e04f69141
I20260503 07:52:52.495162 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_003d62e0eb9b4711b3ac9683b00fd194"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.495751 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_003d62e0eb9b4711b3ac9683b00fd194 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.495816 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c4e16481e61b48ea8c0ffb18d855f20f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.496372 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4e16481e61b48ea8c0ffb18d855f20f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.498687 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.499327 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:52.499637 988 leader_election.cc:343] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:52.499891 716 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.500052 716 leader_election.cc:304] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.500537 1170 raft_consensus.cc:2749] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.500698 1499 raft_consensus.cc:493] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.501811 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a1079ce0e4e6da9779ccd401e98f9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:52.502161 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2546e95e0f40ad99f1ba6bc512debe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.508718 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5896bb71c674358957c87a347b8fb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.509562 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_28f49895d1f749fc903b0abd23078009"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.510052 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28f49895d1f749fc903b0abd23078009 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.511292 880 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1709a2a49475daaa2372360610b1e (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.514443 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:52.515024 716 leader_election.cc:343] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.515172 716 leader_election.cc:304] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.515581 1170 raft_consensus.cc:2749] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.516594 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3650ec1de28c4f1bafd979257dd2b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.519166 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 89572734813f4d28846ffe38868a15c3
I20260503 07:52:52.519914 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7d48574ee8e7473ca1daa0dd9301d7ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.520097 1170 raft_consensus.cc:493] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:52.520503 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d48574ee8e7473ca1daa0dd9301d7ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.520509 1170 raft_consensus.cc:515] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.521169 1170 leader_election.cc:290] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:52.521659 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 89572734813f4d28846ffe38868a15c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.522286 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ae5c088a97ba4ae4b68eaa5de9349bff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.522756 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae5c088a97ba4ae4b68eaa5de9349bff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.524917 1165 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.525949 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f407467a0c9c406faaa657ce70a1028b
I20260503 07:52:52.527573 742 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.528203 742 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.529062 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:52:52.529914 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.532640 1165 tablet_bootstrap.cc:654] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.536518 988 leader_election.cc:304] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.537036 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9edbc50a8e4194a46ecb1666daa5f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.537782 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62ac84e88ebe478fb6200bb5052a8f84 consensus state has no leader
I20260503 07:52:52.538739 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d15e70ec4856a15ed7c6175cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.540469 1174 ts_tablet_manager.cc:1929] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.540704 1174 log.cc:1199] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:52.541138 1175 log.cc:1199] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:52.541949 1500 raft_consensus.cc:2749] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:52.542119 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 51957us
I20260503 07:52:52.544597 1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 07:52:52.545411 1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Bootstrap complete.
I20260503 07:52:52.547713 1174 ts_tablet_manager.cc:1950] T be381bee559841bfb90a4d2ce8c4fa5f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.548875 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet be381bee559841bfb90a4d2ce8c4fa5f (table default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]) successfully deleted
I20260503 07:52:52.550633 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb821b329d284643a889b07f9a4f287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.551074 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:52.551576 1165 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
W20260503 07:52:52.551555 716 leader_election.cc:343] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.551738 1165 ts_tablet_manager.cc:1403] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.001s
I20260503 07:52:52.552675 1174 tablet_replica.cc:333] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.552894 1174 raft_consensus.cc:2243] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.553109 1174 raft_consensus.cc:2272] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.553428 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1709a2a49475daaa2372360610b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.553733 1174 ts_tablet_manager.cc:1916] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.535452 896 tablet_service.cc:1511] Processing CreateTablet for tablet ce181da64bad49389a64df1ade0e90ef (DEFAULT_TABLE table=default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.554298 1165 raft_consensus.cc:359] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.554569 1173 ts_tablet_manager.cc:1950] T d7807da20d4c4b90a9e387cb72813557 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:52.554908 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 135) took 2169 ms. Trace:
I20260503 07:52:52.555016 1173 rpcz_store.cc:276] 0503 07:52:50.385664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.386208 (+ 544us) service_pool.cc:224] Handling call
0503 07:52:52.065185 (+1678977us) ts_tablet_manager.cc:1151] Deleting tablet d7807da20d4c4b90a9e387cb72813557
0503 07:52:52.065192 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.160300 (+ 95108us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.480096 (+319796us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.554866 (+ 74770us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678771}
I20260503 07:52:52.555461 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 136) took 2169 ms. Trace:
I20260503 07:52:52.555562 1173 rpcz_store.cc:276] 0503 07:52:50.385780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.386448 (+ 668us) service_pool.cc:224] Handling call
0503 07:52:52.555335 (+2168887us) ts_tablet_manager.cc:1151] Deleting tablet 96f7244292c3400dad2812e0adb162ef
0503 07:52:52.555345 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.555430 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168720}
I20260503 07:52:52.555920 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 137) took 2170 ms. Trace:
I20260503 07:52:52.556028 1173 rpcz_store.cc:276] 0503 07:52:50.385893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.386642 (+ 749us) service_pool.cc:224] Handling call
0503 07:52:52.555757 (+2169115us) ts_tablet_manager.cc:1151] Deleting tablet 295cfe6e7a7043b2905a6e90dd520002
0503 07:52:52.555766 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.555873 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168968}
I20260503 07:52:52.556286 1173 tablet_replica.cc:333] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:52.556463 1173 raft_consensus.cc:2243] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.556617 1173 raft_consensus.cc:2272] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.557170 1173 ts_tablet_manager.cc:1916] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.557492 1499 raft_consensus.cc:515] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.558477 1165 raft_consensus.cc:385] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.558662 1165 raft_consensus.cc:740] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.559969 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.559960 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.558984 1165 consensus_queue.cc:260] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.561542 1171 tablet_bootstrap.cc:654] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.563341 1174 ts_tablet_manager.cc:1929] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.563535 1174 log.cc:1199] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3b8a6c13c0ab45f0ae784e1ab352a0bc
I20260503 07:52:52.563997 1174 ts_tablet_manager.cc:1950] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.565223 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (table default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]) successfully deleted
I20260503 07:52:52.566015 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:52.566190 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e16d225dde3247d1b61a03cf14b21d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e16d225dde3247d1b61a03cf14b21d63 already in progress: creating tablet
I20260503 07:52:52.566282 1174 tablet_replica.cc:333] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:52:52.566431 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 75dfcff75f90434caf7dc26408958a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75dfcff75f90434caf7dc26408958a16 already in progress: creating tablet
I20260503 07:52:52.566489 1174 raft_consensus.cc:2243] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:52.566633 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 55eb2ad7619a4a9aabe8b8d062455390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55eb2ad7619a4a9aabe8b8d062455390 already in progress: creating tablet
I20260503 07:52:52.566658 1174 raft_consensus.cc:2272] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:52.566874 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e6d4cfb8426c485eb7ff408e04f69141 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6d4cfb8426c485eb7ff408e04f69141 already in progress: creating tablet
I20260503 07:52:52.567442 1174 ts_tablet_manager.cc:1916] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.567414 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 89572734813f4d28846ffe38868a15c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.568060 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
W20260503 07:52:52.570603 988 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.571825 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.572009 1165 ts_tablet_manager.cc:1434] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260503 07:52:52.572340 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.573220 1175 ts_tablet_manager.cc:1950] T a60a9ee2cc5a42efa1201e12622d4df1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:52.575637 986 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:52.576937 1174 ts_tablet_manager.cc:1929] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.577270 1174 log.cc:1199] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/89572734813f4d28846ffe38868a15c3
I20260503 07:52:52.577690 1174 ts_tablet_manager.cc:1950] T 89572734813f4d28846ffe38868a15c3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.578765 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 89572734813f4d28846ffe38868a15c3 (table default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]) successfully deleted
I20260503 07:52:52.578816 1174 tablet_replica.cc:333] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.579022 1174 raft_consensus.cc:2243] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:52.579196 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f407467a0c9c406faaa657ce70a1028b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f407467a0c9c406faaa657ce70a1028b already in progress: creating tablet
I20260503 07:52:52.579830 1174 raft_consensus.cc:2272] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.580902 1499 leader_election.cc:290] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.581842 1165 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.586054 891 tablet_service.cc:1511] Processing CreateTablet for tablet feb88812c6b0459d86bd441926f57ecf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.584501 1174 ts_tablet_manager.cc:1916] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.590912 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d7807da20d4c4b90a9e387cb72813557 (table default.Table_bcef633acbb44764bf85c66781243af3 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
W20260503 07:52:52.591158 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 96f7244292c3400dad2812e0adb162ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96f7244292c3400dad2812e0adb162ef already in progress: creating tablet
W20260503 07:52:52.591836 715 leader_election.cc:343] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.591964 715 leader_election.cc:304] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:52.592391 1170 raft_consensus.cc:2749] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.589464 1165 tablet_bootstrap.cc:654] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.595831 1392 raft_consensus.cc:493] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.595983 1392 raft_consensus.cc:515] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
W20260503 07:52:52.599071 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f45941fd2c94161b5438fe65f858b95 consensus state has no leader
I20260503 07:52:52.599354 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce181da64bad49389a64df1ade0e90ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.601342 1174 ts_tablet_manager.cc:1929] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.601464 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c9b63835c2c34ebc91932d55e7621cf5" } new_table_name: "default.Table_4fa48e379ec44c65b934bd27193a5a43" modify_external_catalogs: true
I20260503 07:52:52.602340 1505 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:52.604096 1174 log.cc:1199] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:52.604431 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2fc55691a0234d4ba696f36f2d875131" } new_table_name: "default.Table_0c3ec91290084114899616ae3dcd851b" modify_external_catalogs: true
I20260503 07:52:52.604920 1174 ts_tablet_manager.cc:1950] T b77c5c6954554eac970d1e3fb1387c2b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:52:52.605683 851 leader_election.cc:343] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:52.605767 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_045b6da91766482c8248e5d78e7c2da2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.606073 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b77c5c6954554eac970d1e3fb1387c2b (table default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]) successfully deleted
W20260503 07:52:52.606321 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_045b6da91766482c8248e5d78e7c2da2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.608155 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_08672a5853854c39b2aae8d52960f924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.608686 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08672a5853854c39b2aae8d52960f924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.609243 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 51494da361814bf1917182ed2952e28d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:47 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:52.609618 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eb362fee7bc4f948d3a5b660e9cbd1a already in progress: creating tablet
I20260503 07:52:52.610291 1174 tablet_replica.cc:333] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.610491 1174 raft_consensus.cc:2243] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.611054 1174 raft_consensus.cc:2272] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.611536 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a45012e871b4c14a3fafb4443e1e92b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:52.611945 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.612056 1174 ts_tablet_manager.cc:1916] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:52.612089 988 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.612586 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0487d02934453fbb25104f3b8fe732. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.612665 854 leader_election.cc:343] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:52.615696 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028017b7cc74ef6a199d6b9e0ba6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.615738 854 leader_election.cc:304] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.618067 1505 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4eda3aaddc4d46a7e8b24b782a7e5c, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.619314 1505 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:52.622969 886 tablet_service.cc:1511] Processing CreateTablet for tablet fb821b329d284643a889b07f9a4f287e (DEFAULT_TABLE table=default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.625993 1505 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:52:52.624100 1527 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:52.630873 1527 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:52.630884 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (DEFAULT_TABLE table=default.Table_615397b098fd48f5881cdc79eb932980 [id=e4b1a8554c72416ababa0c721ec1fd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.631386 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d7953d2fc1484a4f8a3a6c2f8c1827b6" } new_table_name: "default.Table_51087a0beaaa4072b4342bcee0bd985f" modify_external_catalogs: true
I20260503 07:52:52.631762 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_880c06e846564e03a359ab40393e5fe2" } modify_external_catalogs: true
I20260503 07:52:52.631937 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_880c06e846564e03a359ab40393e5fe2" } modify_external_catalogs: true
I20260503 07:52:52.633737 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb4d150eadb479d9978f2450637bd3e (DEFAULT_TABLE table=default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.634171 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb4d150eadb479d9978f2450637bd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.616544 1392 leader_election.cc:290] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.637132 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 (DEFAULT_TABLE table=default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.637480 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6c9fb96d5a4397b51611254be1a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.642872 1174 ts_tablet_manager.cc:1929] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.643831 1174 log.cc:1199] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/65fbd09bd319440cadcc84f1d55e7bde
I20260503 07:52:52.644294 988 leader_election.cc:304] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.644572 1174 ts_tablet_manager.cc:1950] T 65fbd09bd319440cadcc84f1d55e7bde P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.644649 744 tablet_service.cc:1511] Processing CreateTablet for tablet efbf07a603be411895839aece99fa78c (DEFAULT_TABLE table=default.Table_71e1d22f05b440089329a58f532fa712 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.645058 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbf07a603be411895839aece99fa78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.645874 1499 raft_consensus.cc:2749] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.646061 1499 raft_consensus.cc:493] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.646199 1499 raft_consensus.cc:515] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.647478 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 175) took 1412 ms. Trace:
I20260503 07:52:52.647744 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 65fbd09bd319440cadcc84f1d55e7bde (table default.Table_2c8528bc9a27424185c3afea1df39fc9 [id=d60f7489816c4a0ba96ec72d3fdfe261]) successfully deleted
I20260503 07:52:52.647675 1175 rpcz_store.cc:276] 0503 07:52:51.176047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.186474 (+ 10427us) service_pool.cc:224] Handling call
0503 07:52:52.166802 (+980328us) ts_tablet_manager.cc:1151] Deleting tablet a60a9ee2cc5a42efa1201e12622d4df1
0503 07:52:52.166813 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.310086 (+143273us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.494527 (+184441us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.588407 (+ 93880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":979122}
I20260503 07:52:52.648464 1175 tablet_replica.cc:333] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:52.648769 1175 raft_consensus.cc:2243] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.648912 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet a60a9ee2cc5a42efa1201e12622d4df1 (table default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]) successfully deleted
I20260503 07:52:52.649289 1166 tablet_bootstrap.cc:654] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.649927 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 2146fa5f2fd54bf0baae1681ffb3547b (DEFAULT_TABLE table=default.Table_febf12acb2bc45d68d60fce8e8f84325 [id=63f0f416d7c54be89355008b47b3c7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.650337 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2146fa5f2fd54bf0baae1681ffb3547b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.652530 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb4d150eadb479d9978f2450637bd3e (DEFAULT_TABLE table=default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.652595 1392 raft_consensus.cc:2749] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.653055 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb4d150eadb479d9978f2450637bd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.654742 1027 tablet_service.cc:1511] Processing CreateTablet for tablet efbf07a603be411895839aece99fa78c (DEFAULT_TABLE table=default.Table_71e1d22f05b440089329a58f532fa712 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.655198 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbf07a603be411895839aece99fa78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.656643 1499 leader_election.cc:290] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.655898 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741a28af9fe946db8c9305aa1dabe999" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.658457 988 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:52.659157 986 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:52.659287 986 leader_election.cc:304] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.659723 1175 raft_consensus.cc:2272] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.660147 888 tablet_service.cc:1511] Processing CreateTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 (DEFAULT_TABLE table=default.Table_1c704f0fb29c4a8983559bb1bddd8cb6 [id=d778245ff437405896430039f772e652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.662724 1499 raft_consensus.cc:2749] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.663280 883 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 (DEFAULT_TABLE table=default.Table_89408c07c1db4b7b806167183545cbd5 [id=cb3204cb6061405bb6a2cdff89916775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.663645 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 (DEFAULT_TABLE table=default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.665339 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6c9fb96d5a4397b51611254be1a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.667054 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ecc39d127c71412ea867a0b3cad10452 (DEFAULT_TABLE table=default.Table_df35866b78694258ae9f45c83948baf1 [id=9290461419df4394a2c203b5ca8992eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.667747 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc39d127c71412ea867a0b3cad10452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.668040 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.670149 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16d225dde3247d1b61a03cf14b21d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.672562 1175 ts_tablet_manager.cc:1916] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.678961 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c25addae8c94554a83344f07a11362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.680575 887 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.681401 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 89572734813f4d28846ffe38868a15c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.682463 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb88812c6b0459d86bd441926f57ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.680362 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2146fa5f2fd54bf0baae1681ffb3547b (DEFAULT_TABLE table=default.Table_febf12acb2bc45d68d60fce8e8f84325 [id=63f0f416d7c54be89355008b47b3c7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.684530 892 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.687547 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3650ec1de28c4f1bafd979257dd2b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.689674 894 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb4d150eadb479d9978f2450637bd3e (DEFAULT_TABLE table=default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.691072 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:52.693854 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.695077 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 596130e78eb1444a96480fc1075478cd (DEFAULT_TABLE table=default.Table_9dc3b574e7bb4a08a849197b8fd27ac2 [id=04182b9dfa4f41738dedf12d85d54147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.695331 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2146fa5f2fd54bf0baae1681ffb3547b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.699659 744 tablet_service.cc:1511] Processing CreateTablet for tablet ecc39d127c71412ea867a0b3cad10452 (DEFAULT_TABLE table=default.Table_df35866b78694258ae9f45c83948baf1 [id=9290461419df4394a2c203b5ca8992eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.699729 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6f865a421e104d8a8631dc2cd65327de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.699961 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_39e289dea2d0425e8f661ed42d89b6e5" } modify_external_catalogs: true
I20260503 07:52:52.700299 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc39d127c71412ea867a0b3cad10452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.700275 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_39e289dea2d0425e8f661ed42d89b6e5" } modify_external_catalogs: true
W20260503 07:52:52.700325 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f865a421e104d8a8631dc2cd65327de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.703527 1171 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.703935 1171 ts_tablet_manager.cc:1403] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.265s user 0.010s sys 0.000s
I20260503 07:52:52.703982 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9edbc50a8e4194a46ecb1666daa5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.704442 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d15e70ec4856a15ed7c6175cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.705086 1171 raft_consensus.cc:359] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.705376 1171 raft_consensus.cc:385] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.705490 1171 raft_consensus.cc:740] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.705868 1171 consensus_queue.cc:260] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.705926 897 tablet_service.cc:1511] Processing CreateTablet for tablet ecc39d127c71412ea867a0b3cad10452 (DEFAULT_TABLE table=default.Table_df35866b78694258ae9f45c83948baf1 [id=9290461419df4394a2c203b5ca8992eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.706343 881 tablet_service.cc:1511] Processing CreateTablet for tablet efbf07a603be411895839aece99fa78c (DEFAULT_TABLE table=default.Table_71e1d22f05b440089329a58f532fa712 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.703433 742 tablet_service.cc:1511] Processing CreateTablet for tablet 596130e78eb1444a96480fc1075478cd (DEFAULT_TABLE table=default.Table_9dc3b574e7bb4a08a849197b8fd27ac2 [id=04182b9dfa4f41738dedf12d85d54147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.707146 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596130e78eb1444a96480fc1075478cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.709415 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_3dd5aa971d3b4a8fb492904c36f285ce [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 1 got 0
I20260503 07:52:52.711619 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_236b0866169c40e49811e486bed7c716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.712440 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_236b0866169c40e49811e486bed7c716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.714010 1017 tablet_service.cc:1511] Processing CreateTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae (DEFAULT_TABLE table=default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.714478 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebec2b05025444ccaf0bf0bb4ab62dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.714882 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dce60ad6aea4465a4ce04ea62bceb13 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:52.715339 751 tablet_service.cc:1511] Processing CreateTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae (DEFAULT_TABLE table=default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.715710 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebec2b05025444ccaf0bf0bb4ab62dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.718142 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (DEFAULT_TABLE table=default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.718489 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdaa3dd3a844d8b57def2b9faa03d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.721146 761 tablet_service.cc:1511] Processing CreateTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (DEFAULT_TABLE table=default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.721508 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdaa3dd3a844d8b57def2b9faa03d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.722437 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_312a588ec1c840c187461ae93b58a342" } modify_external_catalogs: true
I20260503 07:52:52.722592 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_312a588ec1c840c187461ae93b58a342" } modify_external_catalogs: true
I20260503 07:52:52.690541 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2146fa5f2fd54bf0baae1681ffb3547b (DEFAULT_TABLE table=default.Table_febf12acb2bc45d68d60fce8e8f84325 [id=63f0f416d7c54be89355008b47b3c7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.736683 1171 ts_tablet_manager.cc:1434] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.033s user 0.000s sys 0.001s
I20260503 07:52:52.738871 1171 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.741711 1171 tablet_bootstrap.cc:654] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.747709 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596130e78eb1444a96480fc1075478cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.749636 891 tablet_service.cc:1511] Processing CreateTablet for tablet 596130e78eb1444a96480fc1075478cd (DEFAULT_TABLE table=default.Table_9dc3b574e7bb4a08a849197b8fd27ac2 [id=04182b9dfa4f41738dedf12d85d54147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.750061 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc39d127c71412ea867a0b3cad10452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.750491 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbf07a603be411895839aece99fa78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.752406 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb4d150eadb479d9978f2450637bd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.753188 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb821b329d284643a889b07f9a4f287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.753595 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596130e78eb1444a96480fc1075478cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.754149 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2146fa5f2fd54bf0baae1681ffb3547b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.756191 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4446badf064ecabc01b330f3babde2 (DEFAULT_TABLE table=default.Table_fedc936702dc4dfa92e62db580accb77 [id=42229936a86a4dc29d6c778f946c494e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.756587 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4446badf064ecabc01b330f3babde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.757587 882 tablet_service.cc:1511] Processing CreateTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae (DEFAULT_TABLE table=default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.758158 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebec2b05025444ccaf0bf0bb4ab62dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.763038 1392 raft_consensus.cc:493] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.763200 1392 raft_consensus.cc:515] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } }
I20260503 07:52:52.766433 1392 leader_election.cc:290] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:52.768113 854 leader_election.cc:343] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 51494da361814bf1917182ed2952e28d
I20260503 07:52:52.768882 761 tablet_service.cc:1511] Processing CreateTablet for tablet b7a65f69a6c145438e8c721fe2096080 (DEFAULT_TABLE table=default.Table_faade3cbf89744b0adc4feaebb6e4acd [id=f172f2d652b645e2a1de7166bc496664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.769279 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a65f69a6c145438e8c721fe2096080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.773430 1166 tablet_bootstrap.cc:492] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:52.774384 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b7a65f69a6c145438e8c721fe2096080 (DEFAULT_TABLE table=default.Table_faade3cbf89744b0adc4feaebb6e4acd [id=f172f2d652b645e2a1de7166bc496664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.774843 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a65f69a6c145438e8c721fe2096080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.782449 897 tablet_service.cc:1511] Processing CreateTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (DEFAULT_TABLE table=default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.785077 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4446badf064ecabc01b330f3babde2 (DEFAULT_TABLE table=default.Table_fedc936702dc4dfa92e62db580accb77 [id=42229936a86a4dc29d6c778f946c494e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.785610 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4446badf064ecabc01b330f3babde2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:52.795157 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 468a420c2a87466398cad5dfd959b3be consensus state has no leader
I20260503 07:52:52.796306 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_3dd5aa971d3b4a8fb492904c36f285ce [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 1 got 0
I20260503 07:52:52.797034 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c609207b4a1c47cbb38b1193163cb037" } modify_external_catalogs: true
I20260503 07:52:52.797215 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c609207b4a1c47cbb38b1193163cb037" } modify_external_catalogs: true
I20260503 07:52:52.798892 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75" } modify_external_catalogs: true
I20260503 07:52:52.799065 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75" } modify_external_catalogs: true
I20260503 07:52:52.800840 1175 ts_tablet_manager.cc:1929] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:52.802163 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8055ed2748e4a0e9ba1194c40afb5e2 consensus state has no leader
I20260503 07:52:52.802502 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_febf12acb2bc45d68d60fce8e8f84325" } new_table_name: "default.Table_fd434aa643a94db8b792d842cddbede3" modify_external_catalogs: true
I20260503 07:52:52.811127 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1498486dd3db414c8062cba2d54037bb
I20260503 07:52:52.807461 1499 raft_consensus.cc:493] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:52.811698 601 master_service.cc:954] ReplaceTablet: received request to replace tablet f3e004ece846459c89f920fb5567f2ad from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:52.811645 1499 raft_consensus.cc:515] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.812315 1499 leader_election.cc:290] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:52.812379 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8b84d41bdf374871a096d1dc30dd3543
I20260503 07:52:52.812660 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.812973 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1c704f0fb29c4a8983559bb1bddd8cb6" } new_table_name: "default.Table_50b3d54db78b4a0fa4c0735349d51cad" modify_external_catalogs: true
W20260503 07:52:52.813426 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1498486dd3db414c8062cba2d54037bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1498486dd3db414c8062cba2d54037bb already in progress: creating tablet
W20260503 07:52:52.813941 986 leader_election.cc:343] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:52.814244 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.809444 1171 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.814599 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet eea048c5820349d481ac54a570b57649
I20260503 07:52:52.814646 1171 ts_tablet_manager.cc:1403] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.000s
W20260503 07:52:52.814908 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8b84d41bdf374871a096d1dc30dd3543 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b84d41bdf374871a096d1dc30dd3543 already in progress: creating tablet
I20260503 07:52:52.815493 1171 raft_consensus.cc:359] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.815670 1171 raft_consensus.cc:385] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.815706 761 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.815773 1171 raft_consensus.cc:740] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.815994 1171 consensus_queue.cc:260] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:52.816387 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet eea048c5820349d481ac54a570b57649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea048c5820349d481ac54a570b57649 already in progress: creating tablet
W20260503 07:52:52.816663 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 consensus state has no leader
I20260503 07:52:52.816851 1165 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.817358 1165 ts_tablet_manager.cc:1403] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.242s user 0.023s sys 0.049s
I20260503 07:52:52.817744 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_53bb1f4cbf584ad78026326484284bdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.818279 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53bb1f4cbf584ad78026326484284bdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.819706 1165 raft_consensus.cc:359] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.819975 1165 raft_consensus.cc:385] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.820102 1165 raft_consensus.cc:740] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.820400 1165 consensus_queue.cc:260] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.821532 1165 ts_tablet_manager.cc:1434] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:52.823793 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.824100 1165 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.824074 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.824513 1171 ts_tablet_manager.cc:1434] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260503 07:52:52.824697 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.825585 1171 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.827286 1171 tablet_bootstrap.cc:654] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.827445 1165 tablet_bootstrap.cc:654] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.828177 1175 log.cc:1199] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/a19065f28ee44933a0522bfa28696058
I20260503 07:52:52.828606 1175 ts_tablet_manager.cc:1950] T a19065f28ee44933a0522bfa28696058 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:52.829355 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 191) took 1372 ms. Trace:
I20260503 07:52:52.829519 1175 rpcz_store.cc:276] 0503 07:52:51.456512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.456588 (+ 76us) service_pool.cc:224] Handling call
0503 07:52:52.648370 (+1191782us) ts_tablet_manager.cc:1151] Deleting tablet a19065f28ee44933a0522bfa28696058
0503 07:52:52.648382 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.691445 (+ 43063us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.800741 (+109296us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.829324 (+ 28583us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191468}
I20260503 07:52:52.829993 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet a19065f28ee44933a0522bfa28696058 (table default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe [id=ff32cf0130ba49fbbe5d93a0507bdc80]) successfully deleted
I20260503 07:52:52.830440 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 192) took 1373 ms. Trace:
I20260503 07:52:52.830574 1175 rpcz_store.cc:276] 0503 07:52:51.456700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.456941 (+ 241us) service_pool.cc:224] Handling call
0503 07:52:52.830315 (+1373374us) ts_tablet_manager.cc:1151] Deleting tablet 0481b55721854d70a670a79ff2f42dd6
0503 07:52:52.830324 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.830414 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373192}
W20260503 07:52:52.831051 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0481b55721854d70a670a79ff2f42dd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0481b55721854d70a670a79ff2f42dd6 already in progress: creating tablet
I20260503 07:52:52.831779 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 193) took 1374 ms. Trace:
I20260503 07:52:52.831913 1175 rpcz_store.cc:276] 0503 07:52:51.456846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.457152 (+ 306us) service_pool.cc:224] Handling call
0503 07:52:52.831657 (+1374505us) ts_tablet_manager.cc:1151] Deleting tablet bb96ba84739c45b7847f0c43ab4a08e7
0503 07:52:52.831665 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.831752 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1374364}
W20260503 07:52:52.832948 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bb96ba84739c45b7847f0c43ab4a08e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96ba84739c45b7847f0c43ab4a08e7 already in progress: creating tablet
I20260503 07:52:52.833145 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b6e488110fe04337ababb42ab1c2a09e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:52.833443 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 194) took 1368 ms. Trace:
I20260503 07:52:52.833564 1175 rpcz_store.cc:276] 0503 07:52:51.464808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.464859 (+ 51us) service_pool.cc:224] Handling call
0503 07:52:52.833192 (+1368333us) ts_tablet_manager.cc:1151] Deleting tablet 8dd0b6afae47432e9da300ba07e970e5
0503 07:52:52.833201 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.833408 (+ 207us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1368069}
W20260503 07:52:52.833659 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6e488110fe04337ababb42ab1c2a09e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:52.834118 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8dd0b6afae47432e9da300ba07e970e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dd0b6afae47432e9da300ba07e970e5 already in progress: creating tablet
I20260503 07:52:52.834484 1175 tablet_replica.cc:333] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:52.834758 1175 raft_consensus.cc:2243] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.834990 1175 raft_consensus.cc:2272] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.835708 1175 ts_tablet_manager.cc:1916] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.838789 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4d65be84be80405999a139de9e67ba15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.839331 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d65be84be80405999a139de9e67ba15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.840193 1165 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.840377 1165 ts_tablet_manager.cc:1403] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260503 07:52:52.840550 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c033039c8ea44f96a1fcf251572171bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.841039 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c033039c8ea44f96a1fcf251572171bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.841660 1165 raft_consensus.cc:359] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.842139 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7a5bfe063804400fa705183f46da98bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.842585 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a5bfe063804400fa705183f46da98bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.842811 1165 raft_consensus.cc:385] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.843034 1165 raft_consensus.cc:740] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.843389 1165 consensus_queue.cc:260] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.844265 1165 ts_tablet_manager.cc:1434] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260503 07:52:52.848654 1165 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.850245 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.856247 1171 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:52:52.857647 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2146fa5f2fd54bf0baae1681ffb3547b consensus state has no leader
I20260503 07:52:52.858054 1171 ts_tablet_manager.cc:1403] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260503 07:52:52.858031 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b65693d564704918b540c1c3dd8d1f60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:52.858527 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65693d564704918b540c1c3dd8d1f60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:52.859710 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6ce0e09526eb4c9ba4b47c36e741702d
I20260503 07:52:52.860828 1171 raft_consensus.cc:359] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.861377 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.861714 1174 tablet_replica.cc:333] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.861943 1174 raft_consensus.cc:2243] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.862123 1174 raft_consensus.cc:2272] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.863240 1174 ts_tablet_manager.cc:1916] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.864349 1171 raft_consensus.cc:385] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.864431 1171 raft_consensus.cc:740] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.864727 1171 consensus_queue.cc:260] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:52.864946 851 leader_election.cc:343] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 51494da361814bf1917182ed2952e28d
I20260503 07:52:52.865069 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.865365 851 leader_election.cc:304] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.744668 887 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 (DEFAULT_TABLE table=default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.870460 1392 raft_consensus.cc:2749] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.870513 1165 tablet_bootstrap.cc:654] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.872141 1053 raft_consensus.cc:1275] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Refusing update from remote peer 4a924c2134c54fa0bb164825da53bdd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:52.872519 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]). Expected version 2 got 0
I20260503 07:52:52.872721 1170 consensus_queue.cc:1048] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:52.873694 1174 ts_tablet_manager.cc:1929] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.873802 1174 log.cc:1199] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/6ce0e09526eb4c9ba4b47c36e741702d
I20260503 07:52:52.874171 1174 ts_tablet_manager.cc:1950] T 6ce0e09526eb4c9ba4b47c36e741702d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.875572 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:52.875543 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 6ce0e09526eb4c9ba4b47c36e741702d (table default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]) successfully deleted
I20260503 07:52:52.876281 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.876504 1174 tablet_replica.cc:333] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.876680 1174 raft_consensus.cc:2243] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.876816 1174 raft_consensus.cc:2272] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:52.876967 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 100197us
I20260503 07:52:52.877151 1171 ts_tablet_manager.cc:1434] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260503 07:52:52.877523 1171 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.880712 1174 ts_tablet_manager.cc:1916] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.864189 1175 ts_tablet_manager.cc:1929] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:52.881410 1175 log.cc:1199] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/dd76629713d747b490c83581cc03596c
I20260503 07:52:52.882222 1175 ts_tablet_manager.cc:1950] T dd76629713d747b490c83581cc03596c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:52.884073 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 195) took 1388 ms. Trace:
I20260503 07:52:52.884270 1175 rpcz_store.cc:276] 0503 07:52:51.495166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.495226 (+ 60us) service_pool.cc:224] Handling call
0503 07:52:52.834422 (+1339196us) ts_tablet_manager.cc:1151] Deleting tablet dd76629713d747b490c83581cc03596c
0503 07:52:52.834434 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.852047 (+ 17613us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.864106 (+ 12059us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.884028 (+ 19922us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338989}
W20260503 07:52:52.885056 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3650ec1de28c4f1bafd979257dd2b778 consensus state has no leader
I20260503 07:52:52.885022 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet dd76629713d747b490c83581cc03596c (table default.Table_7777e79b5e0b47edac66885f4b7b9655 [id=e9446550434243a09cb7a71f278edef6]) successfully deleted
I20260503 07:52:52.881829 1171 tablet_bootstrap.cc:654] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.886792 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:52:52.886981 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 199) took 1299 ms. Trace:
I20260503 07:52:52.888130 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.888434 761 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.888411 1175 rpcz_store.cc:276] 0503 07:52:51.587817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.587931 (+ 114us) service_pool.cc:224] Handling call
0503 07:52:52.886499 (+1298568us) ts_tablet_manager.cc:1151] Deleting tablet dda159becff6466abdcd84193f40a65e
0503 07:52:52.886510 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.886926 (+ 416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298259}
W20260503 07:52:52.888898 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet dda159becff6466abdcd84193f40a65e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dda159becff6466abdcd84193f40a65e already in progress: creating tablet
I20260503 07:52:52.889441 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 200) took 1294 ms. Trace:
I20260503 07:52:52.889583 1175 rpcz_store.cc:276] 0503 07:52:51.595344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.595610 (+ 266us) service_pool.cc:224] Handling call
0503 07:52:52.889170 (+1293560us) ts_tablet_manager.cc:1151] Deleting tablet efec3cb45daf44e59132ea4d8929bd43
0503 07:52:52.889178 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.889386 (+ 208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293324}
I20260503 07:52:52.890036 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295cfe6e7a7043b2905a6e90dd520002" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:52.890286 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet efec3cb45daf44e59132ea4d8929bd43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efec3cb45daf44e59132ea4d8929bd43 already in progress: creating tablet
I20260503 07:52:52.890561 1175 tablet_replica.cc:333] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:52.890861 715 consensus_peers.cc:597] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:52.891361 1175 raft_consensus.cc:2243] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.892201 1175 raft_consensus.cc:2272] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:52.892599 988 leader_election.cc:343] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:52.892706 988 leader_election.cc:304] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:52.893059 1499 raft_consensus.cc:2749] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:52.894210 1165 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.894677 1165 ts_tablet_manager.cc:1403] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.001s
I20260503 07:52:52.896041 1165 raft_consensus.cc:359] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.900702 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdaa3dd3a844d8b57def2b9faa03d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.901194 1165 raft_consensus.cc:385] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.901289 1165 raft_consensus.cc:740] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.904728 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]). Expected version 2 got 0
I20260503 07:52:52.905174 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6c9fb96d5a4397b51611254be1a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.905472 896 tablet_service.cc:1511] Processing CreateTablet for tablet b7a65f69a6c145438e8c721fe2096080 (DEFAULT_TABLE table=default.Table_faade3cbf89744b0adc4feaebb6e4acd [id=f172f2d652b645e2a1de7166bc496664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.907490 1171 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.907718 1171 ts_tablet_manager.cc:1403] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260503 07:52:52.908871 1166 ts_tablet_manager.cc:1403] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.388s user 0.003s sys 0.006s
I20260503 07:52:52.909375 1171 raft_consensus.cc:359] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.909495 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.909807 1171 raft_consensus.cc:385] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.910028 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a65f69a6c145438e8c721fe2096080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.910032 1171 raft_consensus.cc:740] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.910382 1171 consensus_queue.cc:260] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.911080 895 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.911540 1166 raft_consensus.cc:359] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.911841 1171 ts_tablet_manager.cc:1434] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:52.912207 1171 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.912299 1166 raft_consensus.cc:385] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.912402 1166 raft_consensus.cc:740] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.912985 1166 consensus_queue.cc:260] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.913466 1166 ts_tablet_manager.cc:1434] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260503 07:52:52.913656 1175 ts_tablet_manager.cc:1916] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.927538 1171 tablet_bootstrap.cc:654] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.928890 1165 consensus_queue.cc:260] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:52.930438 1175 ts_tablet_manager.cc:1929] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.930589 1175 log.cc:1199] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:52.930979 1175 ts_tablet_manager.cc:1950] T 4d4d8dfc410a40ec825d8e45e07388f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:52.932060 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 201) took 1326 ms. Trace:
I20260503 07:52:52.932233 1175 rpcz_store.cc:276] 0503 07:52:51.605451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.605631 (+ 180us) service_pool.cc:224] Handling call
0503 07:52:52.890484 (+1284853us) ts_tablet_manager.cc:1151] Deleting tablet 4d4d8dfc410a40ec825d8e45e07388f6
0503 07:52:52.890494 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.913419 (+ 22925us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x611000ab1c30. stack: 00007fe1a7f78086 00007fe1a7f77e40 00007fe1a6f313ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fe1bbc36efd 00007fe1b50dfc1e 00007fe1b520f6e7 00007fe1b7dd4a77 00007fe1b7e07b44 00007fe1b7de8560 00007fe1b7de82ed 0000000000aa4cac 00007fe1a7fbdf6f 00007fe1a7fc128b
0503 07:52:52.925421 (+ 12002us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.930323 (+ 4902us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.932028 (+ 1705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38655744,"tablet-delete.queue_time_us":1284586}
I20260503 07:52:52.932719 1165 ts_tablet_manager.cc:1434] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260503 07:52:52.933167 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 208) took 1221 ms. Trace:
I20260503 07:52:52.934872 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 4d4d8dfc410a40ec825d8e45e07388f6 (table default.Table_0b06a748faa64b029ec876cdcfc0478f [id=27c0ca8e039e4316b8878cbe7df0ddb0]) successfully deleted
I20260503 07:52:52.935676 601 master_service.cc:954] ReplaceTablet: received request to replace tablet b77c5c6954554eac970d1e3fb1387c2b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:52.936023 1165 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:52.936442 1175 rpcz_store.cc:276] 0503 07:52:51.711473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.711543 (+ 70us) service_pool.cc:224] Handling call
0503 07:52:52.933035 (+1221492us) ts_tablet_manager.cc:1151] Deleting tablet 5e2c6d9dd87646ed9d1f86761f13f628
0503 07:52:52.933043 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.933136 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221190}
W20260503 07:52:52.937376 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5e2c6d9dd87646ed9d1f86761f13f628 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e2c6d9dd87646ed9d1f86761f13f628 already in progress: creating tablet
I20260503 07:52:52.937912 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 209) took 1223 ms. Trace:
I20260503 07:52:52.938416 1175 rpcz_store.cc:276] 0503 07:52:51.714052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.714101 (+ 49us) service_pool.cc:224] Handling call
0503 07:52:52.937724 (+1223623us) ts_tablet_manager.cc:1151] Deleting tablet 65fbd09bd319440cadcc84f1d55e7bde
0503 07:52:52.937747 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.937878 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223218}
W20260503 07:52:52.939132 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 65fbd09bd319440cadcc84f1d55e7bde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65fbd09bd319440cadcc84f1d55e7bde already in progress: creating tablet
I20260503 07:52:52.939728 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 210) took 1212 ms. Trace:
I20260503 07:52:52.940611 1546 tablet.cc:1724] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:52.940864 1547 tablet.cc:1724] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:52.942672 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b2b1956063b4f5e8bbef9f3d0eba359 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:52.944139 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.944824 884 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.946448 1175 rpcz_store.cc:276] 0503 07:52:51.726824 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.726872 (+ 48us) service_pool.cc:224] Handling call
0503 07:52:52.939543 (+1212671us) ts_tablet_manager.cc:1151] Deleting tablet c00976f3444c43618af30259f0567d17
0503 07:52:52.939555 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.939689 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212452}
W20260503 07:52:52.946918 988 consensus_peers.cc:597] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:52.947479 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c00976f3444c43618af30259f0567d17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00976f3444c43618af30259f0567d17 already in progress: creating tablet
I20260503 07:52:52.947929 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 211) took 1184 ms. Trace:
I20260503 07:52:52.950424 1175 rpcz_store.cc:276] 0503 07:52:51.763309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.764624 (+ 1315us) service_pool.cc:224] Handling call
0503 07:52:52.947786 (+1183162us) ts_tablet_manager.cc:1151] Deleting tablet c46873d43e1b4495a92996e07f93f918
0503 07:52:52.947794 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.947896 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182918}
W20260503 07:52:52.951076 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c46873d43e1b4495a92996e07f93f918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c46873d43e1b4495a92996e07f93f918 already in progress: creating tablet
I20260503 07:52:52.951613 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 213) took 1113 ms. Trace:
I20260503 07:52:52.953305 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:52.953408 1175 rpcz_store.cc:276] 0503 07:52:51.837750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.837820 (+ 70us) service_pool.cc:224] Handling call
0503 07:52:52.951490 (+1113670us) ts_tablet_manager.cc:1151] Deleting tablet f291c68785bb4b6fb522386089fb2af3
0503 07:52:52.951501 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.951584 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1110323}
I20260503 07:52:52.953755 601 catalog_manager.cc:6741] ReplaceTablet: tablet 8b2b1956063b4f5e8bbef9f3d0eba359 deleted and replaced by tablet aef746161e6b446ab0d299d37e2151ea
W20260503 07:52:52.953812 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f291c68785bb4b6fb522386089fb2af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f291c68785bb4b6fb522386089fb2af3 already in progress: creating tablet
I20260503 07:52:52.954082 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 with delete_type TABLET_DATA_DELETED (replaced by tablet aef746161e6b446ab0d299d37e2151ea) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:52.954445 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 with delete_type TABLET_DATA_DELETED (replaced by tablet aef746161e6b446ab0d299d37e2151ea) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:52.954980 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 214) took 1116 ms. Trace:
I20260503 07:52:52.955076 1175 rpcz_store.cc:276] 0503 07:52:51.838855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.839037 (+ 182us) service_pool.cc:224] Handling call
0503 07:52:52.954855 (+1115818us) ts_tablet_manager.cc:1151] Deleting tablet 9336e5b80c644ebcb75455770eb45d70
0503 07:52:52.954864 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.954951 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1110767}
W20260503 07:52:52.957619 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9336e5b80c644ebcb75455770eb45d70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9336e5b80c644ebcb75455770eb45d70 already in progress: creating tablet
I20260503 07:52:52.961941 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:52.961970 1166 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:52.962929 1165 tablet_bootstrap.cc:654] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.964210 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.964406 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.966120 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 212) took 1158 ms. Trace:
I20260503 07:52:52.967041 883 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4446badf064ecabc01b330f3babde2 (DEFAULT_TABLE table=default.Table_fedc936702dc4dfa92e62db580accb77 [id=42229936a86a4dc29d6c778f946c494e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:52.966233 1175 rpcz_store.cc:276] 0503 07:52:51.807749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.810185 (+ 2436us) service_pool.cc:224] Handling call
0503 07:52:52.965999 (+1155814us) ts_tablet_manager.cc:1151] Deleting tablet 388c63dc20da408ca3e141ada0200be6
0503 07:52:52.966007 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.966091 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117971}
W20260503 07:52:52.967933 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 388c63dc20da408ca3e141ada0200be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 388c63dc20da408ca3e141ada0200be6 already in progress: creating tablet
I20260503 07:52:52.928388 1174 ts_tablet_manager.cc:1929] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.968528 1174 log.cc:1199] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5dce60ad6aea4465a4ce04ea62bceb13
I20260503 07:52:52.968618 1175 tablet_replica.cc:333] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:52.968839 1175 raft_consensus.cc:2243] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.968909 1174 ts_tablet_manager.cc:1950] T 5dce60ad6aea4465a4ce04ea62bceb13 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:52.969002 1175 raft_consensus.cc:2272] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.969532 1175 ts_tablet_manager.cc:1916] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.969918 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5dce60ad6aea4465a4ce04ea62bceb13 (table default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]) successfully deleted
W20260503 07:52:52.970460 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet aaaeda1a5d6d436292cd1688f8a4d467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeda1a5d6d436292cd1688f8a4d467 already in progress: creating tablet
I20260503 07:52:52.970479 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 with delete_type TABLET_DATA_DELETED (replaced by tablet aef746161e6b446ab0d299d37e2151ea) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.971648 1174 tablet_replica.cc:333] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:52.971858 1174 raft_consensus.cc:2243] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:52.972030 1174 raft_consensus.cc:2272] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:52.973362 1171 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:52.973455 1165 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:52.973515 1171 ts_tablet_manager.cc:1403] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.000s
I20260503 07:52:52.974037 1165 ts_tablet_manager.cc:1403] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260503 07:52:52.974674 1171 raft_consensus.cc:359] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.974867 1171 raft_consensus.cc:385] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.974946 1171 raft_consensus.cc:740] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.975211 1171 consensus_queue.cc:260] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.974716 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b3168a0cf68f4838b82266d53ad00419 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ddf8a2089ef4a4bb0eb71958490ad8e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:52.979326 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4446badf064ecabc01b330f3babde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:52.982730 1171 ts_tablet_manager.cc:1434] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260503 07:52:52.986796 1173 ts_tablet_manager.cc:1929] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:52.987161 1173 log.cc:1199] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d4328cceebfa466fb6f56d0ffbc09bd2
I20260503 07:52:52.987541 1173 ts_tablet_manager.cc:1950] T d4328cceebfa466fb6f56d0ffbc09bd2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:52.988374 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 138) took 2600 ms. Trace:
I20260503 07:52:52.988463 1173 rpcz_store.cc:276] 0503 07:52:50.387531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.387570 (+ 39us) service_pool.cc:224] Handling call
0503 07:52:52.556234 (+2168664us) ts_tablet_manager.cc:1151] Deleting tablet d4328cceebfa466fb6f56d0ffbc09bd2
0503 07:52:52.556242 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.828453 (+272211us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.986738 (+158285us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:52.987791 (+ 1053us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168458}
I20260503 07:52:52.989148 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d4328cceebfa466fb6f56d0ffbc09bd2 (table default.Table_0b29866176404837a575745301005a1b [id=3014867ee71a408f88061699f827b504]) successfully deleted
I20260503 07:52:52.990823 592 master_service.cc:954] ReplaceTablet: received request to replace tablet cda8280b97254d1aaf3803f6b5cd223c from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:52.991438 1171 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:52.993057 1171 tablet_bootstrap.cc:654] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:52.993301 1165 raft_consensus.cc:359] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.993484 1165 raft_consensus.cc:385] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:52.993571 1165 raft_consensus.cc:740] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:52.994161 1174 ts_tablet_manager.cc:1916] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:52.996443 1165 consensus_queue.cc:260] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:52.996819 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_615397b098fd48f5881cdc79eb932980" } new_table_name: "default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4" modify_external_catalogs: true
I20260503 07:52:52.999419 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:53.000800 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5927563641d44bc28addfeb760ee7280"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.000919 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.001331 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5927563641d44bc28addfeb760ee7280 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.002130 1165 ts_tablet_manager.cc:1434] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260503 07:52:53.007121 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7a5bfe063804400fa705183f46da98bf" } new_table_name: "default.Table_39bf2db361264e3989c6fa7caeba5e31" modify_external_catalogs: true
I20260503 07:52:53.007359 1165 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.011544 1165 tablet_bootstrap.cc:654] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.015550 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c1a2ce2e59084b5286d27b3efbd097d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.015892 742 tablet_service.cc:1511] Processing CreateTablet for tablet 057b62a991b74c859045a74df7dc716f (DEFAULT_TABLE table=default.Table_b65693d564704918b540c1c3dd8d1f60 [id=cab292402d754907b98a0e395457ce95]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.016040 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1a2ce2e59084b5286d27b3efbd097d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.016034 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 057b62a991b74c859045a74df7dc716f (DEFAULT_TABLE table=default.Table_b65693d564704918b540c1c3dd8d1f60 [id=cab292402d754907b98a0e395457ce95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.016333 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b62a991b74c859045a74df7dc716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.016360 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1dd726d9860044f19095052ccdc18252" } modify_external_catalogs: true
I20260503 07:52:53.016479 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b62a991b74c859045a74df7dc716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.016538 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1dd726d9860044f19095052ccdc18252" } modify_external_catalogs: true
W20260503 07:52:53.019348 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d9edbc50a8e4194a46ecb1666daa5f1 consensus state has no leader
I20260503 07:52:53.020115 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e163878262b2436381f0eb9403e7acce" } modify_external_catalogs: true
I20260503 07:52:53.020289 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e163878262b2436381f0eb9403e7acce" } modify_external_catalogs: true
I20260503 07:52:53.020474 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 08cfc6488f404a14af0b7aca20710101 (DEFAULT_TABLE table=default.Table_4d65be84be80405999a139de9e67ba15 [id=657bc6767471422495df0978d252121e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.021733 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7a31991e23ba4049b06ed10a27bc2206"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.021880 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cfc6488f404a14af0b7aca20710101. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:53.022212 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a31991e23ba4049b06ed10a27bc2206 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.023487 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42857f9398f347ba8fb99ad7feb1cb50" } modify_external_catalogs: true
I20260503 07:52:53.023656 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42857f9398f347ba8fb99ad7feb1cb50" } modify_external_catalogs: true
I20260503 07:52:53.026681 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 64c6dad26de642879307b7dca6ae85f5 (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.027093 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c6dad26de642879307b7dca6ae85f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.029364 761 tablet_service.cc:1511] Processing CreateTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 (DEFAULT_TABLE table=default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.029721 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bf46b34b1043e2ab6c9f8b2c871227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.031616 1171 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.031754 1171 ts_tablet_manager.cc:1403] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.002s
I20260503 07:52:53.032454 751 tablet_service.cc:1511] Processing CreateTablet for tablet cac435b09639484ca1ae82f3d4990d48 (DEFAULT_TABLE table=default.Table_ef63c1684f794aa696a7cb6077e06031 [id=cda676ee3d634f52aeefda3c2680f941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.032492 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 5a178957514e4f77afe8a1879b57a96b (DEFAULT_TABLE table=default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.032572 1171 raft_consensus.cc:359] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.032755 1171 raft_consensus.cc:385] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.032817 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac435b09639484ca1ae82f3d4990d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.032806 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a178957514e4f77afe8a1879b57a96b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.032835 1171 raft_consensus.cc:740] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.033077 1171 consensus_queue.cc:260] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.036494 1165 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:53.036648 1165 ts_tablet_manager.cc:1403] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20260503 07:52:53.036499 745 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 (DEFAULT_TABLE table=default.Table_c033039c8ea44f96a1fcf251572171bf [id=4b72deda123e4973bb5bad7303ca2fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.037348 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6a702c59445882a81ca2e3a0f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.037557 1165 raft_consensus.cc:359] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.037752 1165 raft_consensus.cc:385] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.037830 1165 raft_consensus.cc:740] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.038092 1165 consensus_queue.cc:260] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.038796 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24" } new_table_name: "default.Table_4f4045fcdcb741b6b5d95f46965d854a" modify_external_catalogs: true
I20260503 07:52:53.038870 1017 tablet_service.cc:1511] Processing CreateTablet for tablet cac435b09639484ca1ae82f3d4990d48 (DEFAULT_TABLE table=default.Table_ef63c1684f794aa696a7cb6077e06031 [id=cda676ee3d634f52aeefda3c2680f941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.039209 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac435b09639484ca1ae82f3d4990d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.040912 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]). Expected version 2 got 0
I20260503 07:52:53.044217 1165 ts_tablet_manager.cc:1434] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:52:53.044509 1165 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.044894 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5a178957514e4f77afe8a1879b57a96b (DEFAULT_TABLE table=default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.045145 1171 ts_tablet_manager.cc:1434] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260503 07:52:53.045233 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a178957514e4f77afe8a1879b57a96b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.045992 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_944e0955d9b24f8b87c7645170a69ed4 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 1 got 0
I20260503 07:52:53.047210 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.048629 1165 tablet_bootstrap.cc:654] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.050299 1171 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.052037 1171 tablet_bootstrap.cc:654] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.052762 744 tablet_service.cc:1511] Processing CreateTablet for tablet 08cfc6488f404a14af0b7aca20710101 (DEFAULT_TABLE table=default.Table_4d65be84be80405999a139de9e67ba15 [id=657bc6767471422495df0978d252121e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.053092 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cfc6488f404a14af0b7aca20710101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.053479 1175 ts_tablet_manager.cc:1929] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.053591 1175 log.cc:1199] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:53.053936 1175 ts_tablet_manager.cc:1950] T 8a45012e871b4c14a3fafb4443e1e92b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.054569 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 216) took 1189 ms. Trace:
I20260503 07:52:53.054646 1175 rpcz_store.cc:276] 0503 07:52:51.864828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.868643 (+ 3815us) service_pool.cc:224] Handling call
0503 07:52:52.968558 (+1099915us) ts_tablet_manager.cc:1151] Deleting tablet 8a45012e871b4c14a3fafb4443e1e92b
0503 07:52:52.968567 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.003403 (+ 34836us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.053416 (+ 50013us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.054524 (+ 1108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079966}
I20260503 07:52:53.055173 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8a45012e871b4c14a3fafb4443e1e92b (table default.Table_533217f337a4423fa89dc05d0ddf405e [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:52:53.055527 1175 tablet_replica.cc:333] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.055748 1175 raft_consensus.cc:2243] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.055949 1175 raft_consensus.cc:2272] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.056309 881 tablet_service.cc:1511] Processing CreateTablet for tablet 5a178957514e4f77afe8a1879b57a96b (DEFAULT_TABLE table=default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.056607 1175 ts_tablet_manager.cc:1916] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.057363 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_93bdeb41e88148ff957c1b458e976a4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.058044 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93bdeb41e88148ff957c1b458e976a4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.059749 1457 raft_consensus.cc:493] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.059952 1174 ts_tablet_manager.cc:1929] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.059928 1457 raft_consensus.cc:515] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.060580 1457 leader_election.cc:290] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:53.061105 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336e5b80c644ebcb75455770eb45d70" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:53.061288 884 tablet_service.cc:1511] Processing CreateTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 (DEFAULT_TABLE table=default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.061568 716 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.061779 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 134) took 2603 ms. Trace:
I20260503 07:52:53.062572 895 tablet_service.cc:1511] Processing CreateTablet for tablet cac435b09639484ca1ae82f3d4990d48 (DEFAULT_TABLE table=default.Table_ef63c1684f794aa696a7cb6077e06031 [id=cda676ee3d634f52aeefda3c2680f941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.060046 1174 log.cc:1199] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/96f7244292c3400dad2812e0adb162ef
I20260503 07:52:53.064287 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336e5b80c644ebcb75455770eb45d70" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:53.064337 885 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 (DEFAULT_TABLE table=default.Table_c033039c8ea44f96a1fcf251572171bf [id=4b72deda123e4973bb5bad7303ca2fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.064646 1174 ts_tablet_manager.cc:1950] T 96f7244292c3400dad2812e0adb162ef P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.064654 882 tablet_service.cc:1511] Processing CreateTablet for tablet 057b62a991b74c859045a74df7dc716f (DEFAULT_TABLE table=default.Table_b65693d564704918b540c1c3dd8d1f60 [id=cab292402d754907b98a0e395457ce95]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.064795 715 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.064934 715 leader_election.cc:304] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.064962 898 tablet_service.cc:1511] Processing CreateTablet for tablet 64c6dad26de642879307b7dca6ae85f5 (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.065099 742 tablet_service.cc:1511] Processing CreateTablet for tablet 64c6dad26de642879307b7dca6ae85f5 (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.065276 894 tablet_service.cc:1511] Processing CreateTablet for tablet 08cfc6488f404a14af0b7aca20710101 (DEFAULT_TABLE table=default.Table_4d65be84be80405999a139de9e67ba15 [id=657bc6767471422495df0978d252121e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.065323 1457 raft_consensus.cc:2749] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.065481 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c6dad26de642879307b7dca6ae85f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.065656 1174 tablet_replica.cc:333] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:53.065670 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a178957514e4f77afe8a1879b57a96b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.065829 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 96f7244292c3400dad2812e0adb162ef (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
I20260503 07:52:53.065896 1174 raft_consensus.cc:2243] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:53.066310 1174 raft_consensus.cc:2272] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.067283 1173 rpcz_store.cc:276] 0503 07:52:50.385504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.387862 (+ 2358us) service_pool.cc:224] Handling call
0503 07:52:52.988764 (+2600902us) ts_tablet_manager.cc:1151] Deleting tablet dfb47ec875ab44fbaa270a84224f5432
0503 07:52:52.988773 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:52.988865 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2600698}
W20260503 07:52:53.067998 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet dfb47ec875ab44fbaa270a84224f5432 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb47ec875ab44fbaa270a84224f5432 already in progress: creating tablet
I20260503 07:52:53.068867 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 (DEFAULT_TABLE table=default.Table_c033039c8ea44f96a1fcf251572171bf [id=4b72deda123e4973bb5bad7303ca2fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.069517 745 tablet_service.cc:1511] Processing CreateTablet for tablet a117f416c611418a96963db600da1d04 (DEFAULT_TABLE table=default.Table_ae5c088a97ba4ae4b68eaa5de9349bff [id=5a2aa391752141b78b08192babdec820]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.069852 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6a702c59445882a81ca2e3a0f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.069883 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a117f416c611418a96963db600da1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.070973 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bf46b34b1043e2ab6c9f8b2c871227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.071792 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd6a702c59445882a81ca2e3a0f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.072290 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac435b09639484ca1ae82f3d4990d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.073153 1173 tablet_replica.cc:333] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:53.073343 1173 raft_consensus.cc:2243] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.073872 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a117f416c611418a96963db600da1d04 (DEFAULT_TABLE table=default.Table_ae5c088a97ba4ae4b68eaa5de9349bff [id=5a2aa391752141b78b08192babdec820]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.074277 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a117f416c611418a96963db600da1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.074496 751 tablet_service.cc:1511] Processing CreateTablet for tablet 79d43ae066e6411896c490f7c0b11180 (DEFAULT_TABLE table=default.Table_6f865a421e104d8a8631dc2cd65327de [id=02296eaf13b0418ea0c47dfc4eeeb22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.074856 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d43ae066e6411896c490f7c0b11180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.077128 1174 ts_tablet_manager.cc:1916] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.080425 1165 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:53.080564 1165 ts_tablet_manager.cc:1403] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.003s
I20260503 07:52:53.081348 1165 raft_consensus.cc:359] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.081532 1165 raft_consensus.cc:385] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.081629 1165 raft_consensus.cc:740] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.081879 1171 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.082439 1165 consensus_queue.cc:260] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.083238 1171 ts_tablet_manager.cc:1403] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.003s
I20260503 07:52:53.083909 1171 raft_consensus.cc:359] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.084079 1171 raft_consensus.cc:385] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.084136 1171 raft_consensus.cc:740] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.084353 1171 consensus_queue.cc:260] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.084944 1165 ts_tablet_manager.cc:1434] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260503 07:52:53.085215 1165 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.085374 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c6dad26de642879307b7dca6ae85f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.087038 1165 tablet_bootstrap.cc:654] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.088255 889 tablet_service.cc:1511] Processing CreateTablet for tablet 79d43ae066e6411896c490f7c0b11180 (DEFAULT_TABLE table=default.Table_6f865a421e104d8a8631dc2cd65327de [id=02296eaf13b0418ea0c47dfc4eeeb22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.092288 1173 raft_consensus.cc:2272] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.092479 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 79d43ae066e6411896c490f7c0b11180 (DEFAULT_TABLE table=default.Table_6f865a421e104d8a8631dc2cd65327de [id=02296eaf13b0418ea0c47dfc4eeeb22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.092851 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d43ae066e6411896c490f7c0b11180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.092773 888 tablet_service.cc:1511] Processing CreateTablet for tablet a117f416c611418a96963db600da1d04 (DEFAULT_TABLE table=default.Table_ae5c088a97ba4ae4b68eaa5de9349bff [id=5a2aa391752141b78b08192babdec820]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.093267 1499 consensus_queue.cc:1048] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:53.094411 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 (DEFAULT_TABLE table=default.Table_08672a5853854c39b2aae8d52960f924 [id=8b97a76fa5184501849d21b058e53609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.094530 761 tablet_service.cc:1511] Processing CreateTablet for tablet 31025296f77e431da6238360724fd60a (DEFAULT_TABLE table=default.Table_236b0866169c40e49811e486bed7c716 [id=48e17ec9593b43d2a02157d5efdf14bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.094772 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296541e4c2fc4bc193d6f4cee8e65da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.094892 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31025296f77e431da6238360724fd60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.099328 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cfc6488f404a14af0b7aca20710101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.099846 759 tablet_service.cc:1511] Processing CreateTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 (DEFAULT_TABLE table=default.Table_08672a5853854c39b2aae8d52960f924 [id=8b97a76fa5184501849d21b058e53609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.100054 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d43ae066e6411896c490f7c0b11180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.100358 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296541e4c2fc4bc193d6f4cee8e65da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.101519 1166 tablet_bootstrap.cc:654] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.103992 1171 ts_tablet_manager.cc:1434] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260503 07:52:53.106096 1173 ts_tablet_manager.cc:1916] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.108536 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b62a991b74c859045a74df7dc716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.111472 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 31025296f77e431da6238360724fd60a (DEFAULT_TABLE table=default.Table_236b0866169c40e49811e486bed7c716 [id=48e17ec9593b43d2a02157d5efdf14bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.111840 754 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc (DEFAULT_TABLE table=default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.112223 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a0272fdc34044af78ba21b6ca31bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:53.113286 586 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 468a420c2a87466398cad5dfd959b3be consensus state has no leader
I20260503 07:52:53.115005 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31025296f77e431da6238360724fd60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.117703 879 tablet_service.cc:1511] Processing CreateTablet for tablet 31025296f77e431da6238360724fd60a (DEFAULT_TABLE table=default.Table_236b0866169c40e49811e486bed7c716 [id=48e17ec9593b43d2a02157d5efdf14bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.118383 886 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc (DEFAULT_TABLE table=default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.118770 1171 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.122946 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a117f416c611418a96963db600da1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.123996 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a0272fdc34044af78ba21b6ca31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.125000 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31025296f77e431da6238360724fd60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.113863 891 tablet_service.cc:1511] Processing CreateTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 (DEFAULT_TABLE table=default.Table_08672a5853854c39b2aae8d52960f924 [id=8b97a76fa5184501849d21b058e53609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.131443 1023 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc (DEFAULT_TABLE table=default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.131844 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a0272fdc34044af78ba21b6ca31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.132591 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 (DEFAULT_TABLE table=default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.132956 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bf46b34b1043e2ab6c9f8b2c871227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.136093 743 tablet_service.cc:1511] Processing CreateTablet for tablet d3fda3bba9234622b2c391a31c55dc3a (DEFAULT_TABLE table=default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.137044 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fda3bba9234622b2c391a31c55dc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.137873 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d3fda3bba9234622b2c391a31c55dc3a (DEFAULT_TABLE table=default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.139724 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fda3bba9234622b2c391a31c55dc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.142251 744 tablet_service.cc:1511] Processing CreateTablet for tablet 3be0ae78ada34cd88debca569b77d24a (DEFAULT_TABLE table=default.Table_53bb1f4cbf584ad78026326484284bdf [id=bcb02461828f4365ae8debf32812151b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.142616 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be0ae78ada34cd88debca569b77d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.149636 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f7654a4a85b6441f9d36527ced775aa2 (DEFAULT_TABLE table=default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.150223 742 tablet_service.cc:1511] Processing CreateTablet for tablet 9e162006cee34182b51f97629a174509 (DEFAULT_TABLE table=default.Table_28f49895d1f749fc903b0abd23078009 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.150308 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7654a4a85b6441f9d36527ced775aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.150701 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e162006cee34182b51f97629a174509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.156138 751 tablet_service.cc:1511] Processing CreateTablet for tablet f7654a4a85b6441f9d36527ced775aa2 (DEFAULT_TABLE table=default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.156526 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7654a4a85b6441f9d36527ced775aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.162484 890 tablet_service.cc:1511] Processing CreateTablet for tablet d3fda3bba9234622b2c391a31c55dc3a (DEFAULT_TABLE table=default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.162740 880 tablet_service.cc:1511] Processing CreateTablet for tablet f7654a4a85b6441f9d36527ced775aa2 (DEFAULT_TABLE table=default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.162945 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9e162006cee34182b51f97629a174509 (DEFAULT_TABLE table=default.Table_28f49895d1f749fc903b0abd23078009 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.165239 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce16dd96cf04ae293601108381a2a47 consensus state has no leader
I20260503 07:52:53.166601 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 3be0ae78ada34cd88debca569b77d24a (DEFAULT_TABLE table=default.Table_53bb1f4cbf584ad78026326484284bdf [id=bcb02461828f4365ae8debf32812151b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.168090 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.168195 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c033039c8ea44f96a1fcf251572171bf" } new_table_name: "default.Table_f6cd175e82ad4225afefa2c6b6ad38e5" modify_external_catalogs: true
I20260503 07:52:53.168583 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be0ae78ada34cd88debca569b77d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.175621 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296541e4c2fc4bc193d6f4cee8e65da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.176352 1171 tablet_bootstrap.cc:654] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.176990 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cda8280b97254d1aaf3803f6b5cd223c
I20260503 07:52:53.177453 592 catalog_manager.cc:6741] ReplaceTablet: tablet cda8280b97254d1aaf3803f6b5cd223c deleted and replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87
I20260503 07:52:53.177851 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.178817 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_f4052b0a8ee94acd8f4b0ee5a88e9b24 [id=c26dfdfa353040f69adc8d6123962647]). Expected version 3 got 0
I20260503 07:52:53.179754 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ae5c088a97ba4ae4b68eaa5de9349bff" } modify_external_catalogs: true
I20260503 07:52:53.179916 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ae5c088a97ba4ae4b68eaa5de9349bff" } modify_external_catalogs: true
I20260503 07:52:53.181185 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 15714a97dd7749bb8e2ca20f795c760a
I20260503 07:52:53.181834 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bcf8381e20f14ebcb7a812874b44213c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.160637 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3be0ae78ada34cd88debca569b77d24a (DEFAULT_TABLE table=default.Table_53bb1f4cbf584ad78026326484284bdf [id=bcb02461828f4365ae8debf32812151b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.182337 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcf8381e20f14ebcb7a812874b44213c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.183512 1174 ts_tablet_manager.cc:1929] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:53.183662 1174 log.cc:1199] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:53.184224 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0e7364b796a041c1a161bdb798b5a566"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.184671 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e7364b796a041c1a161bdb798b5a566 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.191205 896 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.192215 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.192790 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fda3bba9234622b2c391a31c55dc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.195269 1175 ts_tablet_manager.cc:1929] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.195431 1175 log.cc:1199] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:53.195763 1175 ts_tablet_manager.cc:1950] T 295cfe6e7a7043b2905a6e90dd520002 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.196913 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:52:53.196981 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 295cfe6e7a7043b2905a6e90dd520002 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
I20260503 07:52:53.197830 1171 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.198035 1171 ts_tablet_manager.cc:1403] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
I20260503 07:52:53.198132 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_78cb9693e91b4dc390a8f393e78efe28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.198663 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78cb9693e91b4dc390a8f393e78efe28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.199163 1171 raft_consensus.cc:359] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.199417 1171 raft_consensus.cc:385] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.199889 1171 raft_consensus.cc:740] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:53.200284 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e16d225dde3247d1b61a03cf14b21d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e16d225dde3247d1b61a03cf14b21d63 already in progress: creating tablet
W20260503 07:52:53.200943 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 75dfcff75f90434caf7dc26408958a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75dfcff75f90434caf7dc26408958a16 already in progress: creating tablet
I20260503 07:52:53.200243 1171 consensus_queue.cc:260] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.201287 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.201742 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2f0489d86704462ab237e5226df1251f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0489d86704462ab237e5226df1251f already in progress: creating tablet
I20260503 07:52:53.202298 1171 ts_tablet_manager.cc:1434] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260503 07:52:53.202782 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 656dfeb5247e4cdfaacd29690353da83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 656dfeb5247e4cdfaacd29690353da83 already in progress: creating tablet
I20260503 07:52:53.203084 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_99bda6e3b48643d29d0e70fd0b3813e9" } new_table_name: "default.Table_a32643442a2541d585cec3f44840509c" modify_external_catalogs: true
I20260503 07:52:53.204180 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7654a4a85b6441f9d36527ced775aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.204370 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d79067c0c8594d50aa458d47b31d99af
I20260503 07:52:53.205006 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_29f9d87b702f4f08a7d36b2f3bd2028c" } modify_external_catalogs: true
I20260503 07:52:53.205163 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_29f9d87b702f4f08a7d36b2f3bd2028c" } modify_external_catalogs: true
I20260503 07:52:53.206696 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.205636 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:52:53.206504 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.208485 1175 tablet_replica.cc:333] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.210558 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_079c0329f9e24361bd7fa7d067c93fe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.211081 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_079c0329f9e24361bd7fa7d067c93fe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.211236 1500 raft_consensus.cc:493] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.211354 1500 raft_consensus.cc:515] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.211941 1500 leader_election.cc:290] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.217120 1457 raft_consensus.cc:493] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.217270 1457 raft_consensus.cc:515] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.217968 1457 leader_election.cc:290] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:53.218564 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:53.219190 716 leader_election.cc:343] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.219488 1547 tablet.cc:1724] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:53.224084 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.224691 715 leader_election.cc:343] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.224839 715 leader_election.cc:304] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.225271 1457 raft_consensus.cc:2749] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.225409 1175 raft_consensus.cc:2243] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.225546 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5d8b2c631087445188d01c39291fb9a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.226495 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d8b2c631087445188d01c39291fb9a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.227296 743 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.184137 1174 ts_tablet_manager.cc:1950] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.230145 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]) successfully deleted
I20260503 07:52:53.230598 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 15714a97dd7749bb8e2ca20f795c760a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.231853 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9b18605b4adc4e3a80ea92cc4be7f484"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.232268 1174 tablet_replica.cc:333] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:53.232451 1174 raft_consensus.cc:2243] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:53.232477 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b18605b4adc4e3a80ea92cc4be7f484 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.232626 1174 raft_consensus.cc:2272] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.235369 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336e5b80c644ebcb75455770eb45d70" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.235886 988 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.236572 1174 ts_tablet_manager.cc:1916] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.237270 880 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.237501 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be0ae78ada34cd88debca569b77d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.239234 1175 raft_consensus.cc:2272] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.239612 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.229363 1171 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.241801 1171 tablet_bootstrap.cc:654] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.244656 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e162006cee34182b51f97629a174509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.242507 1175 ts_tablet_manager.cc:1916] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.242726 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 15714a97dd7749bb8e2ca20f795c760a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.248960 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 15714a97dd7749bb8e2ca20f795c760a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.252475 1171 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.253190 1171 ts_tablet_manager.cc:1403] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260503 07:52:53.255046 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.255509 1171 raft_consensus.cc:359] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.256696 1171 raft_consensus.cc:385] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.259050 1175 ts_tablet_manager.cc:1929] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.264485 1175 log.cc:1199] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:53.256975 1171 raft_consensus.cc:740] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.265534 1171 consensus_queue.cc:260] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.277809 1171 ts_tablet_manager.cc:1434] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260503 07:52:53.278739 1174 ts_tablet_manager.cc:1929] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.279130 1174 log.cc:1199] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:53.279924 1174 ts_tablet_manager.cc:1950] T 9336e5b80c644ebcb75455770eb45d70 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.281497 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9336e5b80c644ebcb75455770eb45d70 (table default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]) successfully deleted
I20260503 07:52:53.284529 1171 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.285023 1174 tablet_replica.cc:333] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:53.285311 1499 raft_consensus.cc:493] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.285589 1174 raft_consensus.cc:2243] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.285557 1499 raft_consensus.cc:515] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.286123 1174 raft_consensus.cc:2272] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.286435 1499 leader_election.cc:290] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:53.287774 1175 ts_tablet_manager.cc:1950] T 741a28af9fe946db8c9305aa1dabe999 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.288832 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 741a28af9fe946db8c9305aa1dabe999 (table default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]) successfully deleted
I20260503 07:52:53.289263 1175 tablet_replica.cc:333] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.289433 1175 raft_consensus.cc:2243] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.289577 1175 raft_consensus.cc:2272] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:53.289669 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 55eb2ad7619a4a9aabe8b8d062455390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55eb2ad7619a4a9aabe8b8d062455390 already in progress: creating tablet
W20260503 07:52:53.289891 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eb362fee7bc4f948d3a5b660e9cbd1a already in progress: creating tablet
W20260503 07:52:53.290081 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 89572734813f4d28846ffe38868a15c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89572734813f4d28846ffe38868a15c3 already in progress: creating tablet
W20260503 07:52:53.290246 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f407467a0c9c406faaa657ce70a1028b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f407467a0c9c406faaa657ce70a1028b already in progress: creating tablet
W20260503 07:52:53.290423 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e6d4cfb8426c485eb7ff408e04f69141 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6d4cfb8426c485eb7ff408e04f69141 already in progress: creating tablet
I20260503 07:52:53.290616 1174 ts_tablet_manager.cc:1916] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.291352 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f7244292c3400dad2812e0adb162ef" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:53.293473 1171 tablet_bootstrap.cc:654] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:53.295740 988 leader_election.cc:343] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.296008 1527 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac6a9a921d4741bacf707b8f217874. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:53.296307 1527 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:52:53.296500 1527 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04ac6a9a921d4741bacf707b8f217874)
I20260503 07:52:53.296710 1527 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:53.297099 1175 ts_tablet_manager.cc:1916] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.301568 1527 leader_election.cc:290] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841), 04ac6a9a921d4741bacf707b8f217874 (127.0.105.60:40873)
I20260503 07:52:53.319857 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:53.320082 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:52:53.327174 1499 raft_consensus.cc:493] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.327365 1499 raft_consensus.cc:515] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.328104 1499 leader_election.cc:290] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.328874 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.329448 988 leader_election.cc:343] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.330796 1174 ts_tablet_manager.cc:1929] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.332908 1171 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.333055 1171 ts_tablet_manager.cc:1403] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260503 07:52:53.334391 1171 raft_consensus.cc:359] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.334570 1171 raft_consensus.cc:385] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.334677 1171 raft_consensus.cc:740] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.334928 1171 consensus_queue.cc:260] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.336382 1174 log.cc:1199] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8b84d41bdf374871a096d1dc30dd3543
I20260503 07:52:53.337667 1171 ts_tablet_manager.cc:1434] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260503 07:52:53.338011 1171 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.338510 1174 ts_tablet_manager.cc:1950] T 8b84d41bdf374871a096d1dc30dd3543 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.340086 1171 tablet_bootstrap.cc:654] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.341372 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8b84d41bdf374871a096d1dc30dd3543 (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
W20260503 07:52:53.347054 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bdaa3dd3a844d8b57def2b9faa03d8 already in progress: creating tablet
I20260503 07:52:53.347559 1175 ts_tablet_manager.cc:1929] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:53.348069 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d79067c0c8594d50aa458d47b31d99af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d79067c0c8594d50aa458d47b31d99af already in progress: creating tablet
I20260503 07:52:53.348562 1175 log.cc:1199] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/3b8a6c13c0ab45f0ae784e1ab352a0bc
W20260503 07:52:53.349475 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cda8280b97254d1aaf3803f6b5cd223c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cda8280b97254d1aaf3803f6b5cd223c already in progress: creating tablet
I20260503 07:52:53.350128 1174 tablet_replica.cc:333] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:53.350767 1175 ts_tablet_manager.cc:1950] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.351893 1174 raft_consensus.cc:2243] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:53.352516 1174 raft_consensus.cc:2272] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.353469 1174 ts_tablet_manager.cc:1916] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.362177 1574 catalog_manager.cc:1269] Loaded cluster ID: e159b1db76c34313bb974acd3f2dcf52
I20260503 07:52:53.362725 1175 tablet_replica.cc:333] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.364966 1175 raft_consensus.cc:2243] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.365442 1175 raft_consensus.cc:2272] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:53.365199 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 154130us
I20260503 07:52:53.366225 1574 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: loading cluster ID for follower catalog manager: success
I20260503 07:52:53.366869 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:53.367081 780 raft_consensus.cc:2468] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:53.367193 1546 tablet.cc:1724] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:53.367599 1175 ts_tablet_manager.cc:1916] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.372437 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (table default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]) successfully deleted
W20260503 07:52:53.374011 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet eea048c5820349d481ac54a570b57649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea048c5820349d481ac54a570b57649 already in progress: creating tablet
W20260503 07:52:53.377733 986 leader_election.cc:343] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 96f7244292c3400dad2812e0adb162ef
I20260503 07:52:53.378348 986 leader_election.cc:304] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.378364 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce16dd96cf04ae293601108381a2a47 (DEFAULT_TABLE table=default.Table_39bf2db361264e3989c6fa7caeba5e31 [id=284b0bdf4f78412c9bc9ab30faaf0008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.378720 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce16dd96cf04ae293601108381a2a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.378909 1500 raft_consensus.cc:2749] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:53.379369 986 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:53.380267 986 leader_election.cc:304] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.380609 1500 raft_consensus.cc:2749] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:53.380020 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94cd6a702c59445882a81ca2e3a0f3f6 consensus state has no leader
I20260503 07:52:53.383283 1500 consensus_queue.cc:1048] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:53.383985 986 leader_election.cc:304] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.384334 1500 raft_consensus.cc:2804] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:53.384424 1500 raft_consensus.cc:493] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:53.384518 1500 raft_consensus.cc:3060] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:53.385618 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8b84d41bdf374871a096d1dc30dd3543 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b84d41bdf374871a096d1dc30dd3543 already in progress: creating tablet
W20260503 07:52:53.385804 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1498486dd3db414c8062cba2d54037bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1498486dd3db414c8062cba2d54037bb already in progress: creating tablet
I20260503 07:52:53.386780 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 376e9889ca584931ac1d91a9af2c0689 (DEFAULT_TABLE table=default.Table_b6e488110fe04337ababb42ab1c2a09e [id=a8b412e854214ea5b5f338060fffdee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.387240 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e9889ca584931ac1d91a9af2c0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.387881 1500 raft_consensus.cc:515] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.389158 744 tablet_service.cc:1511] Processing CreateTablet for tablet 376e9889ca584931ac1d91a9af2c0689 (DEFAULT_TABLE table=default.Table_b6e488110fe04337ababb42ab1c2a09e [id=a8b412e854214ea5b5f338060fffdee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.389521 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e9889ca584931ac1d91a9af2c0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.392084 1500 leader_election.cc:290] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.394532 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:53.394735 779 raft_consensus.cc:3060] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.397235 779 raft_consensus.cc:2468] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:53.397608 986 leader_election.cc:304] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:53.398566 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9e162006cee34182b51f97629a174509 (DEFAULT_TABLE table=default.Table_28f49895d1f749fc903b0abd23078009 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.399001 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e162006cee34182b51f97629a174509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.405172 1500 raft_consensus.cc:2804] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:53.405319 1500 raft_consensus.cc:697] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:53.405557 1500 consensus_queue.cc:237] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.407876 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a117f416c611418a96963db600da1d04
I20260503 07:52:53.410292 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_533217f337a4423fa89dc05d0ddf405e" } new_table_name: "default.Table_f3f0440daf4a4fe89f92e6c20afef7e5" modify_external_catalogs: true
I20260503 07:52:53.410967 1174 ts_tablet_manager.cc:1929] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:53.411082 1174 log.cc:1199] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/15714a97dd7749bb8e2ca20f795c760a
I20260503 07:52:53.411516 1174 ts_tablet_manager.cc:1950] T 15714a97dd7749bb8e2ca20f795c760a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.411844 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_560c3883f23a4519a1bd97a75c34eb29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.412359 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_560c3883f23a4519a1bd97a75c34eb29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.413398 1574 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: acquiring CA information for follower catalog manager: success
I20260503 07:52:53.413622 593 master_service.cc:954] ReplaceTablet: received request to replace tablet e6d4cfb8426c485eb7ff408e04f69141 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.413887 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 741a28af9fe946db8c9305aa1dabe999 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.414196 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_df35866b78694258ae9f45c83948baf1" } new_table_name: "default.Table_63d40973d4274e249dabcfbeb69433aa" modify_external_catalogs: true
I20260503 07:52:53.414362 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d48574ee8e7473ca1daa0dd9301d7ca" } modify_external_catalogs: true
I20260503 07:52:53.414554 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d48574ee8e7473ca1daa0dd9301d7ca" } modify_external_catalogs: true
I20260503 07:52:53.415555 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4a3b06105ee840a190bc1378c02837cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.416026 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a3b06105ee840a190bc1378c02837cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.417182 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 67387c8aba1f4d728b3691c5da720e4d
I20260503 07:52:53.417816 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87eaff35bf554a20a9dbff384c14205b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.418239 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87eaff35bf554a20a9dbff384c14205b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.419931 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3ad664ab8d5b44e388431152c86fa2c2" } modify_external_catalogs: true
I20260503 07:52:53.420089 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3ad664ab8d5b44e388431152c86fa2c2" } modify_external_catalogs: true
W20260503 07:52:53.426299 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf0f650d2efd4a5d9308952b32fa7d63 consensus state has no leader
I20260503 07:52:53.426798 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9dc3b574e7bb4a08a849197b8fd27ac2" } new_table_name: "default.Table_7f279670887e4606ab0d08db41d9affe" modify_external_catalogs: true
I20260503 07:52:53.429833 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163]) successfully deleted
I20260503 07:52:53.431023 744 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.431180 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.431645 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet a117f416c611418a96963db600da1d04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a117f416c611418a96963db600da1d04 already in progress: creating tablet
I20260503 07:52:53.431609 1409 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" instance_seqno: 1777794766844864) as {username='slave'} at 127.0.105.3:55257; Asking this server to re-register.
W20260503 07:52:53.432437 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 67387c8aba1f4d728b3691c5da720e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67387c8aba1f4d728b3691c5da720e4d already in progress: creating tablet
I20260503 07:52:53.434046 1408 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" instance_seqno: 1777794765898916) as {username='slave'} at 127.0.105.1:54403; Asking this server to re-register.
I20260503 07:52:53.435271 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:53.435662 828 heartbeater.cc:461] Registering TS with master...
W20260503 07:52:53.438745 585 catalog_manager.cc:5075] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): alter failed for tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]),no further retry: Not found: Tablet not found: 8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:53.440385 1175 ts_tablet_manager.cc:1929] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.440996 468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 330 } } ignore_live_leader: false dest_uuid: "65adddd546eb49779519c7f7378d0e60" is_pre_election: true
I20260503 07:52:53.440701 1100 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:53.442993 611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 330 } } ignore_live_leader: false dest_uuid: "04ac6a9a921d4741bacf707b8f217874" is_pre_election: true
I20260503 07:52:53.442845 1574 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260503 07:52:53.443629 1344 leader_election.cc:304] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd4eda3aaddc4d46a7e8b24b782a7e5c; no voters: 04ac6a9a921d4741bacf707b8f217874, 65adddd546eb49779519c7f7378d0e60
I20260503 07:52:53.445262 1569 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:53.447638 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.447966 883 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.451609 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_41955bf1ee7940bbba5877433307da3c" } modify_external_catalogs: true
I20260503 07:52:53.451808 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_41955bf1ee7940bbba5877433307da3c" } modify_external_catalogs: true
I20260503 07:52:53.453209 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:52:53.453883 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_af7472be34b44089a4f151c3a1324479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.454378 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af7472be34b44089a4f151c3a1324479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.456161 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.456681 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ecc39d127c71412ea867a0b3cad10452 consensus state has no leader
W20260503 07:52:53.457126 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0e5f99c7855a4485b3523b68b0ea24c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e5f99c7855a4485b3523b68b0ea24c1 already in progress: creating tablet
W20260503 07:52:53.457950 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 596130e78eb1444a96480fc1075478cd consensus state has no leader
W20260503 07:52:53.458451 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb821b329d284643a889b07f9a4f287e consensus state has no leader
I20260503 07:52:53.461637 888 tablet_service.cc:1511] Processing CreateTablet for tablet 376e9889ca584931ac1d91a9af2c0689 (DEFAULT_TABLE table=default.Table_b6e488110fe04337ababb42ab1c2a09e [id=a8b412e854214ea5b5f338060fffdee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.462083 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e9889ca584931ac1d91a9af2c0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.464140 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647] alter complete (version 4)
I20260503 07:52:53.465446 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce16dd96cf04ae293601108381a2a47 (DEFAULT_TABLE table=default.Table_39bf2db361264e3989c6fa7caeba5e31 [id=284b0bdf4f78412c9bc9ab30faaf0008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.469480 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5a178957514e4f77afe8a1879b57a96b
I20260503 07:52:53.470278 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.470932 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5a178957514e4f77afe8a1879b57a96b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a178957514e4f77afe8a1879b57a96b already in progress: creating tablet
I20260503 07:52:53.472797 1175 log.cc:1199] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/6ce0e09526eb4c9ba4b47c36e741702d
I20260503 07:52:53.477506 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.477716 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.477847 1166 tablet_bootstrap.cc:492] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:53.478009 1166 ts_tablet_manager.cc:1403] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.563s user 0.011s sys 0.004s
W20260503 07:52:53.479233 988 consensus_peers.cc:597] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:53.480545 988 leader_election.cc:343] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.480568 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.480685 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce16dd96cf04ae293601108381a2a47 (DEFAULT_TABLE table=default.Table_39bf2db361264e3989c6fa7caeba5e31 [id=284b0bdf4f78412c9bc9ab30faaf0008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.481057 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.481851 1165 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:53.482070 1165 ts_tablet_manager.cc:1403] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.397s user 0.031s sys 0.060s
I20260503 07:52:53.482903 1165 raft_consensus.cc:359] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.483206 1165 raft_consensus.cc:385] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.483345 1165 raft_consensus.cc:740] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.483673 1165 consensus_queue.cc:260] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.484274 1165 ts_tablet_manager.cc:1434] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:53.484618 1165 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.484863 1171 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.485090 1171 ts_tablet_manager.cc:1403] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.147s user 0.005s sys 0.001s
I20260503 07:52:53.485055 1173 ts_tablet_manager.cc:1929] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.485280 1175 ts_tablet_manager.cc:1950] T 6ce0e09526eb4c9ba4b47c36e741702d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.485350 1173 log.cc:1199] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9030916bd2e04c08b07f568123eead02
I20260503 07:52:53.485934 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.486076 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce16dd96cf04ae293601108381a2a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.486380 1165 tablet_bootstrap.cc:654] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.486469 1175 tablet_replica.cc:333] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.486686 1175 raft_consensus.cc:2243] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.486907 1175 raft_consensus.cc:2272] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.488003 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 6ce0e09526eb4c9ba4b47c36e741702d (table default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]) successfully deleted
W20260503 07:52:53.489087 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet aaaeda1a5d6d436292cd1688f8a4d467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeda1a5d6d436292cd1688f8a4d467 already in progress: creating tablet
I20260503 07:52:53.491613 1408 ts_manager.cc:194] Registered new tserver with Master: 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:53.493546 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.493765 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce16dd96cf04ae293601108381a2a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.494357 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:53.495039 1580 log.cc:927] Time spent T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260503 07:52:53.502534 601 master_service.cc:954] ReplaceTablet: received request to replace tablet af1b61a2548e4f3fafb4ed0982dbd9b2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.503865 1166 raft_consensus.cc:359] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.504127 1166 raft_consensus.cc:385] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.508214 1175 ts_tablet_manager.cc:1916] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.514407 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9c19ad357f7845fc8389cb5b923bc253
I20260503 07:52:53.516415 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.517091 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9c19ad357f7845fc8389cb5b923bc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c19ad357f7845fc8389cb5b923bc253 already in progress: creating tablet
I20260503 07:52:53.517408 601 master_service.cc:954] ReplaceTablet: received request to replace tablet cda8280b97254d1aaf3803f6b5cd223c from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.518563 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.519284 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.524883 1171 raft_consensus.cc:359] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.525151 1171 raft_consensus.cc:385] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.525240 1171 raft_consensus.cc:740] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.525511 1166 raft_consensus.cc:740] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.525513 1171 consensus_queue.cc:260] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.526177 1171 ts_tablet_manager.cc:1434] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.041s user 0.000s sys 0.000s
I20260503 07:52:53.526147 1166 consensus_queue.cc:260] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.530761 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.531433 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:53.531965 1173 ts_tablet_manager.cc:1950] T 9030916bd2e04c08b07f568123eead02 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:53.536577 1171 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.537518 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 154) took 2774 ms. Trace:
I20260503 07:52:53.537886 1173 rpcz_store.cc:276] 0503 07:52:50.759123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:50.760538 (+ 1415us) service_pool.cc:224] Handling call
0503 07:52:53.067671 (+2307133us) ts_tablet_manager.cc:1151] Deleting tablet 9030916bd2e04c08b07f568123eead02
0503 07:52:53.070026 (+ 2355us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.351783 (+281757us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.483419 (+131636us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.533926 (+ 50507us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2275456}
I20260503 07:52:53.539182 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 169) took 2368 ms. Trace:
I20260503 07:52:53.539556 1173 rpcz_store.cc:276] 0503 07:52:51.171131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.174563 (+ 3432us) service_pool.cc:224] Handling call
0503 07:52:53.539002 (+2364439us) ts_tablet_manager.cc:1151] Deleting tablet 4d4d8dfc410a40ec825d8e45e07388f6
0503 07:52:53.539019 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.539143 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2363837}
I20260503 07:52:53.540288 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 170) took 2366 ms. Trace:
I20260503 07:52:53.541036 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9030916bd2e04c08b07f568123eead02 (table default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]) successfully deleted
I20260503 07:52:53.540997 1173 rpcz_store.cc:276] 0503 07:52:51.173794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.174894 (+ 1100us) service_pool.cc:224] Handling call
0503 07:52:53.540123 (+2365229us) ts_tablet_manager.cc:1151] Deleting tablet ed95a89bf4bc4b6fa72b224f49082423
0503 07:52:53.540136 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.540257 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2365055}
W20260503 07:52:53.541308 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4d4d8dfc410a40ec825d8e45e07388f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d4d8dfc410a40ec825d8e45e07388f6 already in progress: creating tablet
W20260503 07:52:53.541563 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ed95a89bf4bc4b6fa72b224f49082423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed95a89bf4bc4b6fa72b224f49082423 already in progress: creating tablet
I20260503 07:52:53.541627 1171 tablet_bootstrap.cc:654] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.542260 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 173) took 2361 ms. Trace:
I20260503 07:52:53.544373 1175 ts_tablet_manager.cc:1929] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:53.544590 1175 log.cc:1199] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:53.545256 1175 ts_tablet_manager.cc:1950] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.545280 1173 rpcz_store.cc:276] 0503 07:52:51.181245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.182920 (+ 1675us) service_pool.cc:224] Handling call
0503 07:52:53.541488 (+2358568us) ts_tablet_manager.cc:1151] Deleting tablet fe2b065666ec4f1299b47d45cd1f600b
0503 07:52:53.541497 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.542221 (+ 724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357891}
W20260503 07:52:53.545838 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet fe2b065666ec4f1299b47d45cd1f600b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe2b065666ec4f1299b47d45cd1f600b already in progress: creating tablet
I20260503 07:52:53.545994 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 172) took 2364 ms. Trace:
I20260503 07:52:53.546263 1173 rpcz_store.cc:276] 0503 07:52:51.181105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.184301 (+ 3196us) service_pool.cc:224] Handling call
0503 07:52:53.545812 (+2361511us) ts_tablet_manager.cc:1151] Deleting tablet a60a9ee2cc5a42efa1201e12622d4df1
0503 07:52:53.545823 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.545906 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2361157}
I20260503 07:52:53.546432 1175 tablet_replica.cc:333] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:53.546696 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a60a9ee2cc5a42efa1201e12622d4df1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a60a9ee2cc5a42efa1201e12622d4df1 already in progress: creating tablet
I20260503 07:52:53.546808 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 171) took 2372 ms. Trace:
I20260503 07:52:53.546869 1175 raft_consensus.cc:2243] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.547117 1175 raft_consensus.cc:2272] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.547201 1173 rpcz_store.cc:276] 0503 07:52:51.173962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.243052 (+ 69090us) service_pool.cc:224] Handling call
0503 07:52:53.546687 (+2303635us) ts_tablet_manager.cc:1151] Deleting tablet 3da9549389254875b94268abc5c3bb3e
0503 07:52:53.546697 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.546778 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2303094}
I20260503 07:52:53.547458 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8b2b1956063b4f5e8bbef9f3d0eba359 (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]) successfully deleted
I20260503 07:52:53.547844 1175 ts_tablet_manager.cc:1916] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.547870 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 184) took 2095 ms. Trace:
W20260503 07:52:53.547732 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3da9549389254875b94268abc5c3bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3da9549389254875b94268abc5c3bb3e already in progress: creating tablet
I20260503 07:52:53.548717 1173 rpcz_store.cc:276] 0503 07:52:51.452062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.452118 (+ 56us) service_pool.cc:224] Handling call
0503 07:52:53.547736 (+2095618us) ts_tablet_manager.cc:1151] Deleting tablet a19065f28ee44933a0522bfa28696058
0503 07:52:53.547747 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.547836 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2095358}
W20260503 07:52:53.556105 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a19065f28ee44933a0522bfa28696058 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19065f28ee44933a0522bfa28696058 already in progress: creating tablet
I20260503 07:52:53.557684 1166 ts_tablet_manager.cc:1434] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.080s user 0.003s sys 0.000s
I20260503 07:52:53.556173 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 186) took 2095 ms. Trace:
I20260503 07:52:53.557915 1173 rpcz_store.cc:276] 0503 07:52:51.460500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.460546 (+ 46us) service_pool.cc:224] Handling call
0503 07:52:53.556042 (+2095496us) ts_tablet_manager.cc:1151] Deleting tablet bb96ba84739c45b7847f0c43ab4a08e7
0503 07:52:53.556050 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.556142 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2095288}
I20260503 07:52:53.563431 1165 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:53.563592 1165 ts_tablet_manager.cc:1403] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.079s user 0.013s sys 0.033s
I20260503 07:52:53.563872 1171 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.563994 1171 ts_tablet_manager.cc:1403] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260503 07:52:53.564476 1165 raft_consensus.cc:359] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.564649 1165 raft_consensus.cc:385] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.564741 1165 raft_consensus.cc:740] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.564777 1171 raft_consensus.cc:359] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.564934 1171 raft_consensus.cc:385] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.565016 1171 raft_consensus.cc:740] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.565011 1165 consensus_queue.cc:260] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.565240 1171 consensus_queue.cc:260] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.565478 1499 raft_consensus.cc:493] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.565513 1165 ts_tablet_manager.cc:1434] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:52:53.565601 1499 raft_consensus.cc:515] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.566077 1165 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.566233 1499 leader_election.cc:290] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.567155 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c5c6954554eac970d1e3fb1387c2b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.567651 986 leader_election.cc:343] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:53.567708 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 185) took 2107 ms. Trace:
I20260503 07:52:53.568194 600 master_service.cc:954] ReplaceTablet: received request to replace tablet feb88812c6b0459d86bd441926f57ecf from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.568308 1165 tablet_bootstrap.cc:654] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.568264 1173 rpcz_store.cc:276] 0503 07:52:51.460360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.461265 (+ 905us) service_pool.cc:224] Handling call
0503 07:52:53.558523 (+2097258us) ts_tablet_manager.cc:1151] Deleting tablet 0481b55721854d70a670a79ff2f42dd6
0503 07:52:53.567571 (+ 9048us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.567676 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2096804}
I20260503 07:52:53.568756 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 187) took 2102 ms. Trace:
W20260503 07:52:53.568771 988 leader_election.cc:343] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.568885 988 leader_election.cc:304] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.568951 1173 rpcz_store.cc:276] 0503 07:52:51.466779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.473416 (+ 6637us) service_pool.cc:224] Handling call
0503 07:52:53.568621 (+2095205us) ts_tablet_manager.cc:1151] Deleting tablet 8dd0b6afae47432e9da300ba07e970e5
0503 07:52:53.568631 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.568728 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2094942}
I20260503 07:52:53.569268 1564 raft_consensus.cc:2749] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.569473 1173 tablet_replica.cc:333] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:53.569721 1173 raft_consensus.cc:2243] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.569959 1173 raft_consensus.cc:2272] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.570557 1173 ts_tablet_manager.cc:1916] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.573500 1171 ts_tablet_manager.cc:1434] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
W20260503 07:52:53.574666 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bb96ba84739c45b7847f0c43ab4a08e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96ba84739c45b7847f0c43ab4a08e7 already in progress: creating tablet
I20260503 07:52:53.574775 1166 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:53.574952 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0481b55721854d70a670a79ff2f42dd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0481b55721854d70a670a79ff2f42dd6 already in progress: creating tablet
W20260503 07:52:53.575445 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8dd0b6afae47432e9da300ba07e970e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dd0b6afae47432e9da300ba07e970e5 already in progress: creating tablet
I20260503 07:52:53.576860 1171 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.577286 1166 tablet_bootstrap.cc:654] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.578241 882 tablet_service.cc:1558] Processing DeleteTablet for tablet a60a9ee2cc5a42efa1201e12622d4df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.584923 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_93bdeb41e88148ff957c1b458e976a4b" } new_table_name: "default.Table_08ac73e23e35413686867661229a09a6" modify_external_catalogs: true
I20260503 07:52:53.588232 1171 tablet_bootstrap.cc:654] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:53.592974 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5eb48844c2a04b5e8b6f73b9986127ee has no consensus state
I20260503 07:52:53.598680 1409 ts_manager.cc:194] Registered new tserver with Master: 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.606611 1408 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" instance_seqno: 1777794766364633) as {username='slave'} at 127.0.105.2:54183; Asking this server to re-register.
I20260503 07:52:53.608727 965 heartbeater.cc:461] Registering TS with master...
I20260503 07:52:53.611048 1175 ts_tablet_manager.cc:1929] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.611083 1410 ts_manager.cc:194] Registered new tserver with Master: 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:53.614041 1166 tablet_bootstrap.cc:492] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:53.614733 1166 ts_tablet_manager.cc:1403] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260503 07:52:53.615578 1166 raft_consensus.cc:359] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.616433 1166 raft_consensus.cc:385] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.616720 1166 raft_consensus.cc:740] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.617179 1166 consensus_queue.cc:260] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.617440 1175 log.cc:1199] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:53.617748 1166 ts_tablet_manager.cc:1434] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:53.617959 1175 ts_tablet_manager.cc:1950] T be381bee559841bfb90a4d2ce8c4fa5f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.621495 1166 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:53.621582 1500 raft_consensus.cc:493] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.621817 1500 raft_consensus.cc:515] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.622610 1500 leader_election.cc:290] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.618950 1171 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.623555 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:53.623664 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:53.623782 780 raft_consensus.cc:2468] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:53.624284 986 leader_election.cc:304] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:53.624877 1500 raft_consensus.cc:2804] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:52:53.625084 988 leader_election.cc:343] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.625763 1500 raft_consensus.cc:493] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:53.625901 1500 raft_consensus.cc:3060] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.631178 1500 raft_consensus.cc:515] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.632799 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:53.635829 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_61bdcd62fce249498039439c55beea00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.636242 425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 73361us
W20260503 07:52:53.636633 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61bdcd62fce249498039439c55beea00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.637439 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9b18605b4adc4e3a80ea92cc4be7f484" } modify_external_catalogs: true
I20260503 07:52:53.637627 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9b18605b4adc4e3a80ea92cc4be7f484" } modify_external_catalogs: true
I20260503 07:52:53.638278 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d8ce6874d4994d94a17c0514a7528886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.638839 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8ce6874d4994d94a17c0514a7528886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.639258 1500 leader_election.cc:290] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.639544 1171 ts_tablet_manager.cc:1403] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.004s
I20260503 07:52:53.640379 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_94e12289320e4776af30df060a853a04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.640861 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94e12289320e4776af30df060a853a04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.640864 1171 raft_consensus.cc:359] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.641229 1171 raft_consensus.cc:385] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.641362 1171 raft_consensus.cc:740] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.641772 1171 consensus_queue.cc:260] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.641844 1457 raft_consensus.cc:493] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.642014 1457 raft_consensus.cc:515] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.642470 1171 ts_tablet_manager.cc:1434] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:53.642781 1457 leader_election.cc:290] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:53.644340 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:53.645814 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.646396 716 leader_election.cc:343] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.640065 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1eff757e8b944d1d8167207905bce9a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.646904 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eff757e8b944d1d8167207905bce9a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.648083 715 leader_election.cc:343] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.648250 715 leader_election.cc:304] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.650983 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086c1b3968fd4ae4be703b72eaf05973" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:53.651183 780 raft_consensus.cc:3060] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.654081 780 raft_consensus.cc:2468] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:53.655055 986 leader_election.cc:304] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:53.655396 1564 raft_consensus.cc:2804] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:53.655401 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2b316333c1ba4f2fb97307e35ceff30b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.655548 1564 raft_consensus.cc:697] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:53.655891 1564 consensus_queue.cc:237] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.656513 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e481f5f62cba4f8b86b738ae055ce474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.657099 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b316333c1ba4f2fb97307e35ceff30b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.658402 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e481f5f62cba4f8b86b738ae055ce474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.659478 1457 raft_consensus.cc:2749] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:53.663589 988 leader_election.cc:343] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.664453 1166 tablet_bootstrap.cc:654] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.670411 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b6e488110fe04337ababb42ab1c2a09e" } modify_external_catalogs: true
I20260503 07:52:53.670603 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b6e488110fe04337ababb42ab1c2a09e" } modify_external_catalogs: true
I20260503 07:52:53.671350 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_820b52ee7a3945ae93798523632b0fdf" } new_table_name: "default.Table_72a2a09ade1d4c50b8838203b8eb121d" modify_external_catalogs: true
I20260503 07:52:53.678781 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bcef633acbb44764bf85c66781243af3" } new_table_name: "default.Table_20770d6cc8c7480c97d762c6d7a087f4" modify_external_catalogs: true
I20260503 07:52:53.680433 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_53bb1f4cbf584ad78026326484284bdf" } new_table_name: "default.Table_1342327adf9443718245c4e4b12fd53a" modify_external_catalogs: true
I20260503 07:52:53.681797 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7a31991e23ba4049b06ed10a27bc2206" } new_table_name: "default.Table_aab3c94e44334f51b254da90bfa43fcc" modify_external_catalogs: true
I20260503 07:52:53.683735 1173 ts_tablet_manager.cc:1929] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:53.683935 1173 log.cc:1199] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/dd76629713d747b490c83581cc03596c
I20260503 07:52:53.684410 1173 ts_tablet_manager.cc:1950] T dd76629713d747b490c83581cc03596c P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:52:53.687572 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61e9b97fafa145e0a45e4d81fc9d5947 consensus state has no leader
I20260503 07:52:53.687930 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e2e252c6379540cbba82d81b7a4418e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.688479 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2e252c6379540cbba82d81b7a4418e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.701363 1547 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:53.709424 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_49aeb9af1f3e46548302416f0651e300" } modify_external_catalogs: true
I20260503 07:52:53.709915 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_49aeb9af1f3e46548302416f0651e300" } modify_external_catalogs: true
I20260503 07:52:53.712672 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:53.713580 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b7c37b4b149a4e189caa1362c3fcbea7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.714169 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7c37b4b149a4e189caa1362c3fcbea7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.715408 601 catalog_manager.cc:5671] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:53.716158 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 188) took 2219 ms. Trace:
I20260503 07:52:53.716274 1173 rpcz_store.cc:276] 0503 07:52:51.496658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.508467 (+ 11809us) service_pool.cc:224] Handling call
0503 07:52:53.569416 (+2060949us) ts_tablet_manager.cc:1151] Deleting tablet dd76629713d747b490c83581cc03596c
0503 07:52:53.569424 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.573574 (+ 4150us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.683671 (+110097us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.716100 (+ 32429us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2060730}
I20260503 07:52:53.717799 742 tablet_service.cc:1511] Processing CreateTablet for tablet 61316b7a521e42a59bf955179b080f40 (DEFAULT_TABLE table=default.Table_5d8b2c631087445188d01c39291fb9a3 [id=e211b19acaf94e3d9c00d4e88d23f4f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.718258 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61316b7a521e42a59bf955179b080f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.720638 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5deea77f36d540bb8f721657b7e3500e (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.721046 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5deea77f36d540bb8f721657b7e3500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.722033 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet dd76629713d747b490c83581cc03596c (table default.Table_7777e79b5e0b47edac66885f4b7b9655 [id=e9446550434243a09cb7a71f278edef6]) successfully deleted
W20260503 07:52:53.722743 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be15f49b155746d1924868d9f91e9206 consensus state has no leader
I20260503 07:52:53.723413 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c2d55c4df0b54958ba726afe40ebaa0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.724263 1171 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:53.726006 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2d55c4df0b54958ba726afe40ebaa0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.727314 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5deea77f36d540bb8f721657b7e3500e (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.727711 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5deea77f36d540bb8f721657b7e3500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.728274 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 61316b7a521e42a59bf955179b080f40 (DEFAULT_TABLE table=default.Table_5d8b2c631087445188d01c39291fb9a3 [id=e211b19acaf94e3d9c00d4e88d23f4f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.728642 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61316b7a521e42a59bf955179b080f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.731498 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet be381bee559841bfb90a4d2ce8c4fa5f (table default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]) successfully deleted
W20260503 07:52:53.733273 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cda8280b97254d1aaf3803f6b5cd223c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cda8280b97254d1aaf3803f6b5cd223c already in progress: creating tablet
I20260503 07:52:53.734323 1175 tablet_replica.cc:333] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.735282 1175 raft_consensus.cc:2243] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.736027 888 tablet_service.cc:1511] Processing CreateTablet for tablet 61316b7a521e42a59bf955179b080f40 (DEFAULT_TABLE table=default.Table_5d8b2c631087445188d01c39291fb9a3 [id=e211b19acaf94e3d9c00d4e88d23f4f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.736147 1165 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:53.736508 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61316b7a521e42a59bf955179b080f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.736498 1165 ts_tablet_manager.cc:1403] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.170s user 0.053s sys 0.084s
I20260503 07:52:53.738353 1175 raft_consensus.cc:2272] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.738981 1175 ts_tablet_manager.cc:1916] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.739207 1165 raft_consensus.cc:359] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.739494 1165 raft_consensus.cc:385] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.739610 1165 raft_consensus.cc:740] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.742695 1165 consensus_queue.cc:260] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.743312 1165 ts_tablet_manager.cc:1434] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260503 07:52:53.737159 1171 tablet_bootstrap.cc:654] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:53.746552 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f64902f16534103be2968bdc1823a9e consensus state has no leader
I20260503 07:52:53.747459 1166 tablet_bootstrap.cc:492] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:53.747694 1166 ts_tablet_manager.cc:1403] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.001s
I20260503 07:52:53.747907 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:53.749229 1166 raft_consensus.cc:359] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.749631 1166 raft_consensus.cc:385] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.749785 1166 raft_consensus.cc:740] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:52:53.749981 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3be0ae78ada34cd88debca569b77d24a consensus state has no leader
I20260503 07:52:53.750351 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f0de2626accf4770bdab3f0e2bcb9a10" } modify_external_catalogs: true
I20260503 07:52:53.750515 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f0de2626accf4770bdab3f0e2bcb9a10" } modify_external_catalogs: true
I20260503 07:52:53.750129 1166 consensus_queue.cc:260] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.750974 1165 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:53.752733 1166 ts_tablet_manager.cc:1434] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:53.753067 1166 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:53.754894 1166 tablet_bootstrap.cc:654] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.755003 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.755262 1174 tablet_replica.cc:333] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:53.755470 1174 raft_consensus.cc:2243] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.755652 1174 raft_consensus.cc:2272] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.755760 1175 ts_tablet_manager.cc:1929] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.755934 1175 log.cc:1199] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:53.756346 1175 ts_tablet_manager.cc:1950] T b77c5c6954554eac970d1e3fb1387c2b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.757401 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5deea77f36d540bb8f721657b7e3500e (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.757752 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5deea77f36d540bb8f721657b7e3500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.757865 882 tablet_service.cc:1511] Processing CreateTablet for tablet e662fd10883b401c8f0d4a45735e2639 (DEFAULT_TABLE table=default.Table_9b18605b4adc4e3a80ea92cc4be7f484 [id=04f2fc2b32524124b168e59b80670c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.757906 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c8d970f11c484c07994854adfe178e80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.758219 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e662fd10883b401c8f0d4a45735e2639. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:53.758422 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8d970f11c484c07994854adfe178e80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.760313 888 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e004ece846459c89f920fb5567f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:48 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.760308 1546 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:53.760439 1175 tablet_replica.cc:333] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.760656 1175 raft_consensus.cc:2243] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.760833 1175 raft_consensus.cc:2272] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.761013 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b77c5c6954554eac970d1e3fb1387c2b (table default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]) successfully deleted
W20260503 07:52:53.761245 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d79067c0c8594d50aa458d47b31d99af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d79067c0c8594d50aa458d47b31d99af already in progress: creating tablet
I20260503 07:52:53.761448 1175 ts_tablet_manager.cc:1916] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:53.761489 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bdaa3dd3a844d8b57def2b9faa03d8 already in progress: creating tablet
I20260503 07:52:53.762524 1174 ts_tablet_manager.cc:1916] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.763916 1584 raft_consensus.cc:493] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.764035 1584 raft_consensus.cc:515] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.764850 1584 leader_election.cc:290] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:53.766052 854 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: f3e004ece846459c89f920fb5567f2ad
W20260503 07:52:53.766198 851 leader_election.cc:343] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f3e004ece846459c89f920fb5567f2ad
I20260503 07:52:53.766332 851 leader_election.cc:304] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.766741 1584 raft_consensus.cc:2749] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.767095 1173 tablet_replica.cc:333] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:53.767170 1175 ts_tablet_manager.cc:1929] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:53.767275 1173 raft_consensus.cc:2243] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.767336 1175 log.cc:1199] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/15714a97dd7749bb8e2ca20f795c760a
I20260503 07:52:53.767797 1175 ts_tablet_manager.cc:1950] T 15714a97dd7749bb8e2ca20f795c760a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.768814 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163]) successfully deleted
I20260503 07:52:53.768990 1175 tablet_replica.cc:333] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.767459 1173 raft_consensus.cc:2272] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.769217 1175 raft_consensus.cc:2243] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:53.769310 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0e5f99c7855a4485b3523b68b0ea24c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e5f99c7855a4485b3523b68b0ea24c1 already in progress: creating tablet
I20260503 07:52:53.769444 1175 raft_consensus.cc:2272] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.769557 1173 ts_tablet_manager.cc:1916] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:53.769551 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 67387c8aba1f4d728b3691c5da720e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67387c8aba1f4d728b3691c5da720e4d already in progress: creating tablet
I20260503 07:52:53.769953 1175 ts_tablet_manager.cc:1916] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.771713 1584 raft_consensus.cc:493] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.771849 1584 raft_consensus.cc:515] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.772511 1584 leader_election.cc:290] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:53.773339 851 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b3168a0cf68f4838b82266d53ad00419
W20260503 07:52:53.773998 854 leader_election.cc:343] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: b3168a0cf68f4838b82266d53ad00419
I20260503 07:52:53.774129 854 leader_election.cc:304] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.774358 1584 raft_consensus.cc:2749] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.776150 1175 ts_tablet_manager.cc:1929] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.776381 1175 log.cc:1199] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:53.776886 1175 ts_tablet_manager.cc:1950] T 9336e5b80c644ebcb75455770eb45d70 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.777787 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9336e5b80c644ebcb75455770eb45d70 (table default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]) successfully deleted
I20260503 07:52:53.778203 1175 tablet_replica.cc:333] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.778438 1175 raft_consensus.cc:2243] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.778656 1175 raft_consensus.cc:2272] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:53.779237 1175 ts_tablet_manager.cc:1916] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:53.780149 751 tablet_service.cc:1511] Processing CreateTablet for tablet e662fd10883b401c8f0d4a45735e2639 (DEFAULT_TABLE table=default.Table_9b18605b4adc4e3a80ea92cc4be7f484 [id=04f2fc2b32524124b168e59b80670c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.780632 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e662fd10883b401c8f0d4a45735e2639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.785046 1175 ts_tablet_manager.cc:1929] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.785243 1175 log.cc:1199] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/96f7244292c3400dad2812e0adb162ef
I20260503 07:52:53.785640 1175 ts_tablet_manager.cc:1950] T 96f7244292c3400dad2812e0adb162ef P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.786731 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 96f7244292c3400dad2812e0adb162ef (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
W20260503 07:52:53.787348 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5a178957514e4f77afe8a1879b57a96b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a178957514e4f77afe8a1879b57a96b already in progress: creating tablet
I20260503 07:52:53.787864 1500 raft_consensus.cc:493] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:53.787961 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9c19ad357f7845fc8389cb5b923bc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c19ad357f7845fc8389cb5b923bc253 already in progress: creating tablet
I20260503 07:52:53.788019 1500 raft_consensus.cc:515] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:53.788498 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet a117f416c611418a96963db600da1d04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a117f416c611418a96963db600da1d04 already in progress: creating tablet
I20260503 07:52:53.788807 1500 leader_election.cc:290] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.789439 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:53.790010 988 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.790488 1174 ts_tablet_manager.cc:1929] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.790647 1174 log.cc:1199] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:52:53.791004 1174 ts_tablet_manager.cc:1950] T 55eb2ad7619a4a9aabe8b8d062455390 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:53.791997 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 55eb2ad7619a4a9aabe8b8d062455390 (table default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]) successfully deleted
I20260503 07:52:53.792330 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:53.792549 780 raft_consensus.cc:2468] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:53.792977 986 leader_election.cc:304] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.793519 1500 raft_consensus.cc:2804] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:53.793661 1500 raft_consensus.cc:493] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:53.793780 1500 raft_consensus.cc:3060] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.799729 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e662fd10883b401c8f0d4a45735e2639 (DEFAULT_TABLE table=default.Table_9b18605b4adc4e3a80ea92cc4be7f484 [id=04f2fc2b32524124b168e59b80670c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.800031 1500 raft_consensus.cc:515] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.800200 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e662fd10883b401c8f0d4a45735e2639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.803319 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 (DEFAULT_TABLE table=default.Table_0e7364b796a041c1a161bdb798b5a566 [id=c702cea458024924addda2925295d7f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.803692 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30f15ad13340c89df3f5c8d65d63c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.804417 744 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee (DEFAULT_TABLE table=default.Table_08ac73e23e35413686867661229a09a6 [id=287a9ed55cc547da8a91b2209e99a201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.804805 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb48844c2a04b5e8b6f73b9986127ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.808461 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 (DEFAULT_TABLE table=default.Table_0e7364b796a041c1a161bdb798b5a566 [id=c702cea458024924addda2925295d7f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.808868 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30f15ad13340c89df3f5c8d65d63c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.810521 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf42130a55744429d2c64ed55671507 (DEFAULT_TABLE table=default.Table_78cb9693e91b4dc390a8f393e78efe28 [id=e51beedee3de425899d8e131b58e7b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.811003 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf42130a55744429d2c64ed55671507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.813521 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:52:53.814355 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_174f327e0a86469a89537e4b094329ef" } modify_external_catalogs: true
I20260503 07:52:53.814525 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_174f327e0a86469a89537e4b094329ef" } modify_external_catalogs: true
I20260503 07:52:53.816212 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.816277 1165 tablet_bootstrap.cc:654] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.818553 592 master_service.cc:954] ReplaceTablet: received request to replace tablet be15f49b155746d1924868d9f91e9206 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:53.820257 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 already in progress: creating tablet
I20260503 07:52:53.822942 1564 raft_consensus.cc:493] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.823076 1564 raft_consensus.cc:515] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.825340 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.825555 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:53.826229 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f6cd175e82ad4225afefa2c6b6ad38e5" } new_table_name: "default.Table_51fb3eec8b874340a588a54ee74d00cf" modify_external_catalogs: true
I20260503 07:52:53.826345 1584 raft_consensus.cc:493] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.826496 1584 raft_consensus.cc:515] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.827744 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet feb88812c6b0459d86bd441926f57ecf
I20260503 07:52:53.828262 600 catalog_manager.cc:6741] ReplaceTablet: tablet feb88812c6b0459d86bd441926f57ecf deleted and replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf
I20260503 07:52:53.828759 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e662fd10883b401c8f0d4a45735e2639
I20260503 07:52:53.829412 1584 leader_election.cc:290] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:53.830138 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:53.831081 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 376e9889ca584931ac1d91a9af2c0689
I20260503 07:52:53.832172 743 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.832787 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e662fd10883b401c8f0d4a45735e2639 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e662fd10883b401c8f0d4a45735e2639 already in progress: creating tablet
I20260503 07:52:53.832885 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.833397 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 376e9889ca584931ac1d91a9af2c0689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 376e9889ca584931ac1d91a9af2c0689 already in progress: creating tablet
I20260503 07:52:53.833807 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ebec2b05025444ccaf0bf0bb4ab62dae
I20260503 07:52:53.834923 744 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:53.835924 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet feb88812c6b0459d86bd441926f57ecf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feb88812c6b0459d86bd441926f57ecf already in progress: creating tablet
I20260503 07:52:53.837430 1500 leader_election.cc:290] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.837587 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 (DEFAULT_TABLE table=default.Table_0e7364b796a041c1a161bdb798b5a566 [id=c702cea458024924addda2925295d7f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.838028 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30f15ad13340c89df3f5c8d65d63c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.838585 744 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.838948 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.839278 1564 leader_election.cc:290] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:53.839479 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ebec2b05025444ccaf0bf0bb4ab62dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebec2b05025444ccaf0bf0bb4ab62dae already in progress: creating tablet
I20260503 07:52:53.839502 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf42130a55744429d2c64ed55671507 (DEFAULT_TABLE table=default.Table_78cb9693e91b4dc390a8f393e78efe28 [id=e51beedee3de425899d8e131b58e7b0a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.840523 988 leader_election.cc:343] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.841109 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.841423 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf42130a55744429d2c64ed55671507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.841454 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.841682 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.841908 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.842129 1175 tablet_replica.cc:333] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:53.842343 1175 raft_consensus.cc:2243] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:53.842526 1175 raft_consensus.cc:2272] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:53.842736 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 already in progress: creating tablet
W20260503 07:52:53.842902 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e662fd10883b401c8f0d4a45735e2639 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e662fd10883b401c8f0d4a45735e2639 already in progress: creating tablet
I20260503 07:52:53.843071 1175 ts_tablet_manager.cc:1916] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:53.843103 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 376e9889ca584931ac1d91a9af2c0689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 376e9889ca584931ac1d91a9af2c0689 already in progress: creating tablet
I20260503 07:52:53.844457 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:53.844636 779 raft_consensus.cc:2468] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:53.845503 986 leader_election.cc:304] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:53.845890 1564 raft_consensus.cc:2804] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:53.845997 1564 raft_consensus.cc:493] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:53.846079 1564 raft_consensus.cc:3060] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:53.848649 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ebec2b05025444ccaf0bf0bb4ab62dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebec2b05025444ccaf0bf0bb4ab62dae already in progress: creating tablet
I20260503 07:52:53.849251 1564 raft_consensus.cc:515] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.849903 1564 leader_election.cc:290] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:53.850270 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf42130a55744429d2c64ed55671507 (DEFAULT_TABLE table=default.Table_78cb9693e91b4dc390a8f393e78efe28 [id=e51beedee3de425899d8e131b58e7b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.850797 1175 ts_tablet_manager.cc:1929] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.850966 1175 log.cc:1199] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5dce60ad6aea4465a4ce04ea62bceb13
I20260503 07:52:53.851027 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:53.851239 779 raft_consensus.cc:3060] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.851502 1175 ts_tablet_manager.cc:1950] T 5dce60ad6aea4465a4ce04ea62bceb13 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:53.854337 779 raft_consensus.cc:2468] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:53.854772 986 leader_election.cc:304] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:53.855110 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5dce60ad6aea4465a4ce04ea62bceb13 (table default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]) successfully deleted
I20260503 07:52:53.855172 1564 raft_consensus.cc:2804] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:53.855350 1564 raft_consensus.cc:697] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:53.855710 1564 consensus_queue.cc:237] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.856768 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:53.856974 780 raft_consensus.cc:3060] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:53.860350 780 raft_consensus.cc:2468] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:53.860764 986 leader_election.cc:304] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:53.861042 1500 raft_consensus.cc:2804] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:53.861178 1500 raft_consensus.cc:697] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:53.861438 1500 consensus_queue.cc:237] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:53.862782 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:53.863617 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet feb88812c6b0459d86bd441926f57ecf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feb88812c6b0459d86bd441926f57ecf already in progress: creating tablet
I20260503 07:52:53.864774 593 catalog_manager.cc:5671] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:53.865180 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_3dd5aa971d3b4a8fb492904c36f285ce [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 1 got 0
I20260503 07:52:53.876349 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bd9bb4ec203641f392c86ef3291c86fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.876447 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.876936 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd9bb4ec203641f392c86ef3291c86fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.877058 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.878430 854 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:53.881389 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9ff03fba3d4a1794a8a5b94caa9731" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:53.881915 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6] alter complete (version 1)
W20260503 07:52:53.884236 851 leader_election.cc:343] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:53.884330 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:53.884370 988 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.884464 851 leader_election.cc:304] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:53.884732 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 55516.7us
I20260503 07:52:53.885442 883 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.885676 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.885906 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.886123 897 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.886299 1584 raft_consensus.cc:2749] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:53.884080 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 49910us
W20260503 07:52:53.886641 988 leader_election.cc:343] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:53.886719 1584 raft_consensus.cc:493] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:53.886835 1584 raft_consensus.cc:515] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.887416 1584 leader_election.cc:290] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:53.887415 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_770b887c7e33491ea821bf8d8a86448a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:53.887682 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf42130a55744429d2c64ed55671507. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:53.887992 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_770b887c7e33491ea821bf8d8a86448a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.889249 854 leader_election.cc:343] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:53.889281 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4735ea34fadb44c6bccac28390513b6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.889776 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4735ea34fadb44c6bccac28390513b6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.891173 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_697c8786165a446eb850b52821a12e95" } new_table_name: "default.Table_ba4ac916a85e49c793f64e171c13382a" modify_external_catalogs: true
I20260503 07:52:53.892395 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_eca13fd90a5d4612bf83442d4bc8e4f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.892882 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eca13fd90a5d4612bf83442d4bc8e4f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:53.908286 851 leader_election.cc:343] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:53.908464 851 leader_election.cc:304] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:53.908950 1584 raft_consensus.cc:2749] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:53.918488 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee (DEFAULT_TABLE table=default.Table_08ac73e23e35413686867661229a09a6 [id=287a9ed55cc547da8a91b2209e99a201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.932410 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb48844c2a04b5e8b6f73b9986127ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.945876 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee (DEFAULT_TABLE table=default.Table_08ac73e23e35413686867661229a09a6 [id=287a9ed55cc547da8a91b2209e99a201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.946327 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb48844c2a04b5e8b6f73b9986127ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.946717 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8f64902f16534103be2968bdc1823a9e (DEFAULT_TABLE table=default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.947080 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f64902f16534103be2968bdc1823a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.947340 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8f64902f16534103be2968bdc1823a9e (DEFAULT_TABLE table=default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.947671 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f64902f16534103be2968bdc1823a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.950887 1166 tablet_bootstrap.cc:492] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:53.951052 1166 ts_tablet_manager.cc:1403] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.198s user 0.003s sys 0.000s
I20260503 07:52:53.951327 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8f64902f16534103be2968bdc1823a9e (DEFAULT_TABLE table=default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.952134 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f64902f16534103be2968bdc1823a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.952371 1166 raft_consensus.cc:359] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.952584 1166 raft_consensus.cc:385] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.952658 1166 raft_consensus.cc:740] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.952893 1166 consensus_queue.cc:260] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.953501 1166 ts_tablet_manager.cc:1434] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260503 07:52:53.956511 1166 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:53.958129 1166 tablet_bootstrap.cc:654] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:53.959084 1171 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:53.959314 1171 ts_tablet_manager.cc:1403] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.236s user 0.042s sys 0.072s
I20260503 07:52:53.960405 1171 raft_consensus.cc:359] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.961156 1171 raft_consensus.cc:385] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:53.961328 1171 raft_consensus.cc:740] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:53.961594 1171 consensus_queue.cc:260] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:53.962258 1171 ts_tablet_manager.cc:1434] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:53.962791 1171 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:53.964937 891 tablet_service.cc:1511] Processing CreateTablet for tablet bdd151f5e0d54bdab58423c24186b38d (DEFAULT_TABLE table=default.Table_c1a2ce2e59084b5286d27b3efbd097d1 [id=058fdda874e841b99867dd1ad2fb40d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.965090 751 tablet_service.cc:1511] Processing CreateTablet for tablet bdd151f5e0d54bdab58423c24186b38d (DEFAULT_TABLE table=default.Table_c1a2ce2e59084b5286d27b3efbd097d1 [id=058fdda874e841b99867dd1ad2fb40d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.965245 1027 tablet_service.cc:1511] Processing CreateTablet for tablet bdd151f5e0d54bdab58423c24186b38d (DEFAULT_TABLE table=default.Table_c1a2ce2e59084b5286d27b3efbd097d1 [id=058fdda874e841b99867dd1ad2fb40d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.965580 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd151f5e0d54bdab58423c24186b38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.967501 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffec630db9a430fa3006268b0e28fcd (DEFAULT_TABLE table=default.Table_5927563641d44bc28addfeb760ee7280 [id=62cd8ca8c65b443a87799ad6b3e263a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.967625 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 16ea29e3b4a84735bb3723dd11449ec3
I20260503 07:52:53.968065 897 tablet_service.cc:1511] Processing CreateTablet for tablet aef746161e6b446ab0d299d37e2151ea (DEFAULT_TABLE table=default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.968451 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.967909 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffec630db9a430fa3006268b0e28fcd (DEFAULT_TABLE table=default.Table_5927563641d44bc28addfeb760ee7280 [id=62cd8ca8c65b443a87799ad6b3e263a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.969033 885 tablet_service.cc:1511] Processing CreateTablet for tablet 961d0f8f6daa4f359c15743ee42b9a87 (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.969674 898 tablet_service.cc:1511] Processing CreateTablet for tablet 618b858f6e424845b5a6b0010cb2b602 (DEFAULT_TABLE table=default.Table_bcf8381e20f14ebcb7a812874b44213c [id=9e7c2b0fbe4546e4b77540e7967e5a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.969646 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d86e37b23cee4cec9605969951db1bd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:53.970153 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d86e37b23cee4cec9605969951db1bd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.972147 742 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffec630db9a430fa3006268b0e28fcd (DEFAULT_TABLE table=default.Table_5927563641d44bc28addfeb760ee7280 [id=62cd8ca8c65b443a87799ad6b3e263a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.972375 745 tablet_service.cc:1511] Processing CreateTablet for tablet 618b858f6e424845b5a6b0010cb2b602 (DEFAULT_TABLE table=default.Table_bcf8381e20f14ebcb7a812874b44213c [id=9e7c2b0fbe4546e4b77540e7967e5a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.972574 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffec630db9a430fa3006268b0e28fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.972815 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b858f6e424845b5a6b0010cb2b602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.973044 744 tablet_service.cc:1511] Processing CreateTablet for tablet aef746161e6b446ab0d299d37e2151ea (DEFAULT_TABLE table=default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.973351 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef746161e6b446ab0d299d37e2151ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.976275 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd151f5e0d54bdab58423c24186b38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.976342 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:53.976748 759 tablet_service.cc:1511] Processing CreateTablet for tablet 961d0f8f6daa4f359c15743ee42b9a87 (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:53.976897 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef746161e6b446ab0d299d37e2151ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:53.977056 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 16ea29e3b4a84735bb3723dd11449ec3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ea29e3b4a84735bb3723dd11449ec3 already in progress: creating tablet
I20260503 07:52:53.977092 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961d0f8f6daa4f359c15743ee42b9a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:53.982146 1173 ts_tablet_manager.cc:1929] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:53.982306 1173 log.cc:1199] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9c01aea82d584140bbabba1f5be65539
I20260503 07:52:53.982313 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.982717 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 961d0f8f6daa4f359c15743ee42b9a87 (DEFAULT_TABLE table=default.Table_697c8786165a446eb850b52821a12e95 [id=f77e5c2d75e54caab615fea946fb7c73]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:53.983402 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 16ea29e3b4a84735bb3723dd11449ec3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ea29e3b4a84735bb3723dd11449ec3 already in progress: creating tablet
I20260503 07:52:53.984144 883 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:53.991701 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:53.991910 1175 tablet_replica.cc:333] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:54.003057 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dce60ad6aea4465a4ce04ea62bceb13 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:54.003257 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94cd6a702c59445882a81ca2e3a0f3f6 consensus state has no leader
I20260503 07:52:54.003616 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_39bf2db361264e3989c6fa7caeba5e31" } new_table_name: "default.Table_ef660e5b1231415e99e9d960d17d0ff3" modify_external_catalogs: true
I20260503 07:52:54.004273 593 catalog_manager.cc:5671] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:54.004763 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_944e0955d9b24f8b87c7645170a69ed4 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 1 got 0
I20260503 07:52:54.003638 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89408c07c1db4b7b806167183545cbd5" } new_table_name: "default.Table_dad6c6e91b084308a94abf81b5c120a3" modify_external_catalogs: true
I20260503 07:52:54.005153 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]). Expected version 1 got 0
I20260503 07:52:54.005415 593 catalog_manager.cc:5671] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:54.005752 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_36df81222de94d7c86c22dec78ccd60b" } new_table_name: "default.Table_f600236ddc034f64ab9796c1fc5831d6" modify_external_catalogs: true
I20260503 07:52:54.006532 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet be15f49b155746d1924868d9f91e9206
I20260503 07:52:54.007033 592 catalog_manager.cc:6741] ReplaceTablet: tablet be15f49b155746d1924868d9f91e9206 deleted and replaced by tablet 956600f557b84dac98be63ffe14f4e19
I20260503 07:52:54.007681 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2c1d486cfb2e4e21a2467ea56437fe6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.008194 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c1d486cfb2e4e21a2467ea56437fe6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.010174 743 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.010488 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961d0f8f6daa4f359c15743ee42b9a87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.011267 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet be15f49b155746d1924868d9f91e9206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be15f49b155746d1924868d9f91e9206 already in progress: creating tablet
I20260503 07:52:54.012426 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b858f6e424845b5a6b0010cb2b602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.005797 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]). Expected version 2 got 0
I20260503 07:52:54.015481 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 3da9549389254875b94268abc5c3bb3e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.016687 1166 tablet_bootstrap.cc:492] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.016834 1166 ts_tablet_manager.cc:1403] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260503 07:52:54.018337 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffec630db9a430fa3006268b0e28fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.021878 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08ac73e23e35413686867661229a09a6" } modify_external_catalogs: true
I20260503 07:52:54.022053 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08ac73e23e35413686867661229a09a6" } modify_external_catalogs: true
I20260503 07:52:54.025283 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c1eba299413e4b178556b5158d1b473c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.026104 897 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:54.026809 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1eba299413e4b178556b5158d1b473c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.018267 1166 raft_consensus.cc:359] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.032944 1166 raft_consensus.cc:385] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.033147 1166 raft_consensus.cc:740] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.033546 1166 consensus_queue.cc:260] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.039670 1166 ts_tablet_manager.cc:1434] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260503 07:52:54.042465 1166 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:54.042896 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd151f5e0d54bdab58423c24186b38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.043177 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961d0f8f6daa4f359c15743ee42b9a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.042950 1171 tablet_bootstrap.cc:654] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.043403 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffec630db9a430fa3006268b0e28fcd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.045714 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 961d0f8f6daa4f359c15743ee42b9a87 consensus state has no leader
W20260503 07:52:54.047768 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce16dd96cf04ae293601108381a2a47 consensus state has no leader
I20260503 07:52:54.048255 1028 tablet_service.cc:1511] Processing CreateTablet for tablet aef746161e6b446ab0d299d37e2151ea (DEFAULT_TABLE table=default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.048418 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0655ef28c1d4326b2f462ab6fd8d604 consensus state has no leader
I20260503 07:52:54.048693 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef746161e6b446ab0d299d37e2151ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.048753 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 89572734813f4d28846ffe38868a15c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.048949 1175 raft_consensus.cc:2243] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.049153 1175 raft_consensus.cc:2272] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.048698 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 618b858f6e424845b5a6b0010cb2b602 (DEFAULT_TABLE table=default.Table_bcf8381e20f14ebcb7a812874b44213c [id=9e7c2b0fbe4546e4b77540e7967e5a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.049873 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b858f6e424845b5a6b0010cb2b602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.052455 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:54.052908 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab33d15e70ec4856a15ed7c6175cd334 consensus state has no leader
I20260503 07:52:54.053071 1175 ts_tablet_manager.cc:1916] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.053087 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ce867777c0e46d1af4785e667e7a18e with delete_type TABLET_DATA_DELETED (replaced by tablet 8b84d41bdf374871a096d1dc30dd3543) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.056315 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_67b0255f537f478181bd75c8c5561b78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.056792 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67b0255f537f478181bd75c8c5561b78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.058290 1457 raft_consensus.cc:493] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.058450 1457 raft_consensus.cc:515] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.059223 1457 leader_election.cc:290] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:54.060108 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:54.061515 1166 tablet_bootstrap.cc:654] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.061671 1165 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:54.061802 1165 ts_tablet_manager.cc:1403] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.311s user 0.009s sys 0.017s
I20260503 07:52:54.062625 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f279670887e4606ab0d08db41d9affe" } modify_external_catalogs: true
I20260503 07:52:54.062813 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f279670887e4606ab0d08db41d9affe" } modify_external_catalogs: true
I20260503 07:52:54.063894 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c1a2ce2e59084b5286d27b3efbd097d1" } modify_external_catalogs: true
W20260503 07:52:54.063910 716 leader_election.cc:343] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.064057 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c1a2ce2e59084b5286d27b3efbd097d1" } modify_external_catalogs: true
I20260503 07:52:54.065083 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:52:54.065443 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:54.065956 715 leader_election.cc:343] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.066080 715 leader_election.cc:304] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.066406 1457 raft_consensus.cc:2749] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:54.069566 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f9ea98989bfe45d0b35a23b8ef67cd69" } modify_external_catalogs: true
I20260503 07:52:54.069723 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f9ea98989bfe45d0b35a23b8ef67cd69" } modify_external_catalogs: true
I20260503 07:52:54.072043 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ed54f32e26104932829e79bdf8b2f30f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.072288 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.072595 1175 ts_tablet_manager.cc:1929] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.072772 1175 log.cc:1199] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/65fbd09bd319440cadcc84f1d55e7bde
W20260503 07:52:54.072906 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed54f32e26104932829e79bdf8b2f30f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:53.984205 1173 ts_tablet_manager.cc:1950] T 9c01aea82d584140bbabba1f5be65539 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:54.073704 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 189) took 2575 ms. Trace:
I20260503 07:52:54.073840 1173 rpcz_store.cc:276] 0503 07:52:51.498322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.498746 (+ 424us) service_pool.cc:224] Handling call
0503 07:52:53.767019 (+2268273us) ts_tablet_manager.cc:1151] Deleting tablet 9c01aea82d584140bbabba1f5be65539
0503 07:52:53.767028 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:53.910375 (+143347us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:53.982063 (+ 71688us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.073669 (+ 91606us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2257115}
I20260503 07:52:54.074015 1175 ts_tablet_manager.cc:1950] T 65fbd09bd319440cadcc84f1d55e7bde P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:54.074229 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9c01aea82d584140bbabba1f5be65539 (table default.Table_7c27827418e046c5b6adefb0a1da904f [id=3fdd851753d44ba1b3c5fe8224102777]) successfully deleted
I20260503 07:52:54.074328 1173 tablet_replica.cc:333] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:54.074677 1173 raft_consensus.cc:2243] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.074851 1173 raft_consensus.cc:2272] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.075296 1175 tablet_replica.cc:333] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:54.075387 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 65fbd09bd319440cadcc84f1d55e7bde (table default.Table_2c8528bc9a27424185c3afea1df39fc9 [id=d60f7489816c4a0ba96ec72d3fdfe261]) successfully deleted
I20260503 07:52:54.075492 1175 raft_consensus.cc:2243] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.075673 1175 raft_consensus.cc:2272] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.075829 1173 ts_tablet_manager.cc:1916] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.076426 1175 ts_tablet_manager.cc:1916] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.076725 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.077031 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:54.078217 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5eb48844c2a04b5e8b6f73b9986127ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb48844c2a04b5e8b6f73b9986127ee already in progress: creating tablet
I20260503 07:52:54.093035 1166 tablet_bootstrap.cc:492] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.093220 1166 ts_tablet_manager.cc:1403] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260503 07:52:54.094046 1166 raft_consensus.cc:359] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.094242 1166 raft_consensus.cc:385] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.094365 1166 raft_consensus.cc:740] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.094306 1165 raft_consensus.cc:359] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.094488 1165 raft_consensus.cc:385] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.094581 1165 raft_consensus.cc:740] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.094631 595 master_service.cc:954] ReplaceTablet: received request to replace tablet bcbf3231ab114ce59de775f3dcc1e8f2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.094628 1166 consensus_queue.cc:260] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.094789 1165 consensus_queue.cc:260] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.095338 1165 ts_tablet_manager.cc:1434] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260503 07:52:54.096766 1165 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:54.098786 1165 tablet_bootstrap.cc:654] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.100803 888 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb47ec875ab44fbaa270a84224f5432 with delete_type TABLET_DATA_DELETED (replaced by tablet 77fa106f0cc24a35bd23b457660a45dc) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.102828 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:52:54.103041 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bdd151f5e0d54bdab58423c24186b38d
I20260503 07:52:54.104497 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.105020 885 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.105158 745 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:54.105784 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bdd151f5e0d54bdab58423c24186b38d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdd151f5e0d54bdab58423c24186b38d already in progress: creating tablet
I20260503 07:52:54.105887 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.106073 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.106722 1166 ts_tablet_manager.cc:1434] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
W20260503 07:52:54.106758 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8fb4d150eadb479d9978f2450637bd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fb4d150eadb479d9978f2450637bd3e already in progress: creating tablet
I20260503 07:52:54.108935 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:54.110072 742 tablet_service.cc:1558] Processing DeleteTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 57261ae6531348d7bdd8deb5dfd980b4) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.110352 1174 tablet_replica.cc:333] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:54.110395 888 tablet_service.cc:1558] Processing DeleteTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 57261ae6531348d7bdd8deb5dfd980b4) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.110581 1174 raft_consensus.cc:2243] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.110735 1166 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:54.110809 1174 raft_consensus.cc:2272] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.111397 1174 ts_tablet_manager.cc:1916] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:54.114064 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet fb821b329d284643a889b07f9a4f287e (table default.Table_f3f0440daf4a4fe89f92e6c20afef7e5 [id=f7f0f8a122cf4e0aa71cf15ecb71078c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fb821b329d284643a889b07f9a4f287e consensus state has no leader
I20260503 07:52:54.115597 1166 tablet_bootstrap.cc:654] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.119976 1174 ts_tablet_manager.cc:1929] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:54.120452 595 catalog_manager.cc:6741] ReplaceTablet: tablet bcbf3231ab114ce59de775f3dcc1e8f2 deleted and replaced by tablet 57261ae6531348d7bdd8deb5dfd980b4
I20260503 07:52:54.105180 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.122166 1174 log.cc:1199] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:54.122462 1173 ts_tablet_manager.cc:1929] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.123464 1174 ts_tablet_manager.cc:1950] T bcbf3231ab114ce59de775f3dcc1e8f2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:54.123653 1173 log.cc:1199] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/91d799ca2780461b89ced316e9f3ac92
I20260503 07:52:54.124061 1173 ts_tablet_manager.cc:1950] T 91d799ca2780461b89ced316e9f3ac92 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:54.124980 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 190) took 2607 ms. Trace:
I20260503 07:52:54.125137 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:54.126252 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.126438 1173 rpcz_store.cc:276] 0503 07:52:51.517877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.518713 (+ 836us) service_pool.cc:224] Handling call
0503 07:52:54.074269 (+2555556us) ts_tablet_manager.cc:1151] Deleting tablet 91d799ca2780461b89ced316e9f3ac92
0503 07:52:54.074278 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.089328 (+ 15050us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.122397 (+ 33069us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.124932 (+ 2535us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2555278}
I20260503 07:52:54.126909 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 91d799ca2780461b89ced316e9f3ac92 (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
I20260503 07:52:54.127179 1171 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:54.127205 1174 tablet_replica.cc:333] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:54.127297 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 194) took 2542 ms. Trace:
I20260503 07:52:54.127347 1171 ts_tablet_manager.cc:1403] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.165s user 0.003s sys 0.000s
I20260503 07:52:54.127388 1174 raft_consensus.cc:2243] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.127554 1174 raft_consensus.cc:2272] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.127501 1173 rpcz_store.cc:276] 0503 07:52:51.584519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.611309 (+ 26790us) service_pool.cc:224] Handling call
0503 07:52:54.126973 (+2515664us) ts_tablet_manager.cc:1151] Deleting tablet dda159becff6466abdcd84193f40a65e
0503 07:52:54.127083 (+ 110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.127186 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515145}
I20260503 07:52:54.116744 1175 ts_tablet_manager.cc:1929] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.121064 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bcbf3231ab114ce59de775f3dcc1e8f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 57261ae6531348d7bdd8deb5dfd980b4) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.128088 1175 log.cc:1199] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/89572734813f4d28846ffe38868a15c3
I20260503 07:52:54.128162 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 195) took 2532 ms. Trace:
I20260503 07:52:54.128264 1173 rpcz_store.cc:276] 0503 07:52:51.595339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.624869 (+ 29530us) service_pool.cc:224] Handling call
0503 07:52:54.128017 (+2503148us) ts_tablet_manager.cc:1151] Deleting tablet efec3cb45daf44e59132ea4d8929bd43
0503 07:52:54.128025 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.128114 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2502331}
I20260503 07:52:54.128907 1175 ts_tablet_manager.cc:1950] T 89572734813f4d28846ffe38868a15c3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:54.130115 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 89572734813f4d28846ffe38868a15c3 (table default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]) successfully deleted
I20260503 07:52:54.131033 1174 ts_tablet_manager.cc:1916] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:54.131386 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet efec3cb45daf44e59132ea4d8929bd43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efec3cb45daf44e59132ea4d8929bd43 already in progress: creating tablet
I20260503 07:52:54.131728 1173 tablet_replica.cc:333] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:54.128902 1171 raft_consensus.cc:359] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.132418 1171 raft_consensus.cc:385] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.132484 1171 raft_consensus.cc:740] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.132695 1173 raft_consensus.cc:2243] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.132699 1171 consensus_queue.cc:260] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.133168 1171 ts_tablet_manager.cc:1434] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:52:54.135265 1171 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:54.137125 1171 tablet_bootstrap.cc:654] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:54.139360 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet be15f49b155746d1924868d9f91e9206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be15f49b155746d1924868d9f91e9206 already in progress: creating tablet
W20260503 07:52:54.144609 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5eb48844c2a04b5e8b6f73b9986127ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb48844c2a04b5e8b6f73b9986127ee already in progress: creating tablet
W20260503 07:52:54.145220 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bdd151f5e0d54bdab58423c24186b38d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdd151f5e0d54bdab58423c24186b38d already in progress: creating tablet
I20260503 07:52:54.145578 1165 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:54.145733 1165 ts_tablet_manager.cc:1403] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.002s
W20260503 07:52:54.146199 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8fb4d150eadb479d9978f2450637bd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fb4d150eadb479d9978f2450637bd3e already in progress: creating tablet
I20260503 07:52:54.146445 1175 tablet_replica.cc:333] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:54.146524 1165 raft_consensus.cc:359] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.146703 1165 raft_consensus.cc:385] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.146767 1165 raft_consensus.cc:740] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.146818 1175 raft_consensus.cc:2243] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:54.147253 1175 raft_consensus.cc:2272] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.147845 1175 ts_tablet_manager.cc:1916] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.151361 1165 consensus_queue.cc:260] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.151890 1165 ts_tablet_manager.cc:1434] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:54.134398 1166 tablet_bootstrap.cc:492] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.152349 1166 ts_tablet_manager.cc:1403] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.005s
I20260503 07:52:54.152724 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 1609d01e6cdc440085a6ebdb652d54f1 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.153183 1166 raft_consensus.cc:359] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.153338 1166 raft_consensus.cc:385] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.153426 1166 raft_consensus.cc:740] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.153775 1166 consensus_queue.cc:260] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.155893 1165 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:54.158980 1166 ts_tablet_manager.cc:1434] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:54.160310 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a19065f28ee44933a0522bfa28696058 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d0487d02934453fbb25104f3b8fe732) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.164546 1166 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:54.167687 1165 tablet_bootstrap.cc:654] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.171205 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]). Expected version 1 got 0
I20260503 07:52:54.172156 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]). Expected version 1 got 0
I20260503 07:52:54.173554 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2852281bb46a43eaa811335946a96990" } modify_external_catalogs: true
I20260503 07:52:54.173765 1173 raft_consensus.cc:2272] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.173774 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2852281bb46a43eaa811335946a96990" } modify_external_catalogs: true
I20260503 07:52:54.176949 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]). Expected version 1 got 0
I20260503 07:52:54.176947 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 596130e78eb1444a96480fc1075478cd
I20260503 07:52:54.178292 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]). Expected version 1 got 0
I20260503 07:52:54.178740 1564 raft_consensus.cc:493] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.178870 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.178937 1564 raft_consensus.cc:515] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.179585 1564 leader_election.cc:290] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:54.180214 1174 ts_tablet_manager.cc:1929] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.180378 1174 log.cc:1199] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:54.180806 1174 ts_tablet_manager.cc:1950] T 8dd0b6afae47432e9da300ba07e970e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:54.183588 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:54.184013 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:54.184058 988 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.184485 1173 ts_tablet_manager.cc:1916] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.186640 1166 tablet_bootstrap.cc:654] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.190074 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:52:54.190893 1171 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:54.191058 1171 ts_tablet_manager.cc:1403] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.001s
I20260503 07:52:54.191237 888 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.191533 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.181012 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:54.192322 780 raft_consensus.cc:2468] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:54.181198 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.192934 742 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.193253 986 leader_election.cc:304] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.193687 1564 raft_consensus.cc:2804] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:54.193783 1564 raft_consensus.cc:493] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:54.193876 1564 raft_consensus.cc:3060] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:54.193877 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8dd0b6afae47432e9da300ba07e970e5 (table default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]) successfully deleted
W20260503 07:52:54.194689 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 596130e78eb1444a96480fc1075478cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596130e78eb1444a96480fc1075478cd already in progress: creating tablet
I20260503 07:52:54.195550 1173 ts_tablet_manager.cc:1929] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.195688 1173 log.cc:1199] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/1609d01e6cdc440085a6ebdb652d54f1
I20260503 07:52:54.196107 1173 ts_tablet_manager.cc:1950] T 1609d01e6cdc440085a6ebdb652d54f1 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:52:54.196403 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d3fda3bba9234622b2c391a31c55dc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fda3bba9234622b2c391a31c55dc3a already in progress: creating tablet
I20260503 07:52:54.197175 1564 raft_consensus.cc:515] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.198915 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:54.199096 780 raft_consensus.cc:3060] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:54.182797 1165 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:54.200261 1564 leader_election.cc:290] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:54.200650 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:54.201090 988 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.201921 1165 ts_tablet_manager.cc:1403] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260503 07:52:54.201961 888 tablet_service.cc:1511] Processing CreateTablet for tablet 773fca453dac452abc723e49b70111b9 (DEFAULT_TABLE table=default.Table_c8d970f11c484c07994854adfe178e80 [id=1b5a88d781d14f7d9ed7d8941e1571be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.202117 780 raft_consensus.cc:2468] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:54.202306 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773fca453dac452abc723e49b70111b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.202728 1165 raft_consensus.cc:359] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.206040 1165 raft_consensus.cc:385] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.206192 1165 raft_consensus.cc:740] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.204099 1171 raft_consensus.cc:359] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.206342 1171 raft_consensus.cc:385] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.206306 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (DEFAULT_TABLE table=default.Table_b7c37b4b149a4e189caa1362c3fcbea7 [id=ec636e2291634547aa977f3ab2a26ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.206458 1171 raft_consensus.cc:740] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.206722 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ea5f9f9964fbdb8eb92e6059e2531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.207188 1171 consensus_queue.cc:260] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.207602 742 tablet_service.cc:1511] Processing CreateTablet for tablet 773fca453dac452abc723e49b70111b9 (DEFAULT_TABLE table=default.Table_c8d970f11c484c07994854adfe178e80 [id=1b5a88d781d14f7d9ed7d8941e1571be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.207726 1171 ts_tablet_manager.cc:1434] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:52:54.207978 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773fca453dac452abc723e49b70111b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.212330 1165 consensus_queue.cc:260] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.214823 897 tablet_service.cc:1511] Processing CreateTablet for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (DEFAULT_TABLE table=default.Table_b7c37b4b149a4e189caa1362c3fcbea7 [id=ec636e2291634547aa977f3ab2a26ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.215073 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f42b9c55cc4943d18c8b37b7e1a42002"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.215212 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ea5f9f9964fbdb8eb92e6059e2531. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.215605 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f42b9c55cc4943d18c8b37b7e1a42002 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.215816 1166 tablet_bootstrap.cc:492] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.215991 1166 ts_tablet_manager.cc:1403] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260503 07:52:54.217358 1166 raft_consensus.cc:359] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.217537 1166 raft_consensus.cc:385] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.217607 1166 raft_consensus.cc:740] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.217610 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 773fca453dac452abc723e49b70111b9 (DEFAULT_TABLE table=default.Table_c8d970f11c484c07994854adfe178e80 [id=1b5a88d781d14f7d9ed7d8941e1571be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.217820 1166 consensus_queue.cc:260] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.217983 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773fca453dac452abc723e49b70111b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.217967 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8e75811b18d54faaa637076e44702c7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.218465 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e75811b18d54faaa637076e44702c7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.218508 1166 ts_tablet_manager.cc:1434] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260503 07:52:54.218819 1166 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:54.219782 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ff5c56a1ccc34821b5fdd1dfa9fc132c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.220335 986 leader_election.cc:304] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.205922 1175 ts_tablet_manager.cc:1929] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:54.220692 1175 log.cc:1199] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:54.220742 1499 raft_consensus.cc:2804] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:54.220943 1499 raft_consensus.cc:697] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:54.221136 1175 ts_tablet_manager.cc:1950] T bcbf3231ab114ce59de775f3dcc1e8f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:54.221187 1499 consensus_queue.cc:237] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.222085 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:54.222575 1166 tablet_bootstrap.cc:654] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:54.223835 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 596130e78eb1444a96480fc1075478cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596130e78eb1444a96480fc1075478cd already in progress: creating tablet
W20260503 07:52:54.224251 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff5c56a1ccc34821b5fdd1dfa9fc132c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:54.225126 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d3fda3bba9234622b2c391a31c55dc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fda3bba9234622b2c391a31c55dc3a already in progress: creating tablet
I20260503 07:52:54.227044 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e1a4953c942149fd9a76143ba3632364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.227466 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1a4953c942149fd9a76143ba3632364 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.227561 1171 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:54.224257 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_61bdcd62fce249498039439c55beea00" } new_table_name: "default.Table_db6ceb7013de4160aa0d9c608e618791" modify_external_catalogs: true
I20260503 07:52:54.229281 1171 tablet_bootstrap.cc:654] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.236217 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_4917964578ff4ec598fb3f4a4494f466 [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 2 got 0
W20260503 07:52:54.252509 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a845e02bdb54952806f90d3f7cd9fb2 consensus state has no leader
I20260503 07:52:54.254297 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ff5c56a1ccc34821b5fdd1dfa9fc132c" } new_table_name: "default.Table_ef8abe51f2574f0fb195e588e808102e" modify_external_catalogs: true
I20260503 07:52:54.254513 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_944e0955d9b24f8b87c7645170a69ed4" } new_table_name: "default.Table_f397484bea66470d840ab901d70b6e51" modify_external_catalogs: true
I20260503 07:52:54.254842 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87c6f90a432448319533430626fb7662"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.255460 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c6f90a432448319533430626fb7662 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.255805 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4917964578ff4ec598fb3f4a4494f466" } new_table_name: "default.Table_dd7d9967fbc34ca8bcb7afd287593396" modify_external_catalogs: true
I20260503 07:52:54.257071 1171 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:54.257292 1171 ts_tablet_manager.cc:1403] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260503 07:52:54.258369 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1e38efcdb18e448da420a2bac887722e" } new_table_name: "default.Table_d52a967c6b2743c0bdea087b3f771295" modify_external_catalogs: true
I20260503 07:52:54.260179 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e5f99c7855a4485b3523b68b0ea24c1 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.260509 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e7c83fe022a34a8e810f1de1bb5e5523"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.261020 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7c83fe022a34a8e810f1de1bb5e5523 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.262156 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_51e23ef11221401880db30766699f50b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.262657 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51e23ef11221401880db30766699f50b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.264143 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1b897d165d7c42a79a3da9e23142bd98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.264648 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b897d165d7c42a79a3da9e23142bd98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.267530 1564 raft_consensus.cc:493] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.268723 1166 tablet_bootstrap.cc:492] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.268869 1166 ts_tablet_manager.cc:1403] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.000s
I20260503 07:52:54.267752 1564 raft_consensus.cc:515] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.269953 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:54.270776 988 leader_election.cc:343] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.270983 1564 leader_election.cc:290] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:54.272147 1171 raft_consensus.cc:359] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.272413 1171 raft_consensus.cc:385] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.272385 1166 raft_consensus.cc:359] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.272563 1166 raft_consensus.cc:385] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.272579 1171 raft_consensus.cc:740] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.272652 1166 raft_consensus.cc:740] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.272871 1166 consensus_queue.cc:260] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.272927 1171 consensus_queue.cc:260] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.281921 1166 ts_tablet_manager.cc:1434] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20260503 07:52:54.282919 1166 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:54.286347 593 master_service.cc:954] ReplaceTablet: received request to replace tablet 4674c22562f744f5bce13d97ad8a52b2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.286986 1171 ts_tablet_manager.cc:1434] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260503 07:52:54.288158 1171 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:54.293694 1171 tablet_bootstrap.cc:654] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.293972 1166 tablet_bootstrap.cc:654] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:54.297051 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a08da2052f5482792c8b3294e9b7332 has no consensus state
I20260503 07:52:54.302000 897 tablet_service.cc:1511] Processing CreateTablet for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (DEFAULT_TABLE table=default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.302191 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (DEFAULT_TABLE table=default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.302381 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4674c22562f744f5bce13d97ad8a52b2 consensus state has no leader
I20260503 07:52:54.302603 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a845e02bdb54952806f90d3f7cd9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.302801 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a845e02bdb54952806f90d3f7cd9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.303078 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 (DEFAULT_TABLE table=default.Table_1eff757e8b944d1d8167207905bce9a1 [id=c5d1c3d4bc32495a9966899ba145e3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.303470 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae4a39d4e3a42db816e592123a6a2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.303500 885 tablet_service.cc:1511] Processing CreateTablet for tablet c2f31cff599248dd994a7bcee38ef2ab (DEFAULT_TABLE table=default.Table_94e12289320e4776af30df060a853a04 [id=3de278df6c8b4e58b061f0fa90cf28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.303859 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f31cff599248dd994a7bcee38ef2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.270656 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:54.304538 780 raft_consensus.cc:2468] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:54.305176 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 (DEFAULT_TABLE table=default.Table_1eff757e8b944d1d8167207905bce9a1 [id=c5d1c3d4bc32495a9966899ba145e3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.305522 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae4a39d4e3a42db816e592123a6a2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.307331 1165 ts_tablet_manager.cc:1434] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.105s user 0.002s sys 0.000s
I20260503 07:52:54.307699 1165 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:54.307619 898 tablet_service.cc:1511] Processing CreateTablet for tablet 29fe06a56f70487ea7c479b107d83d8b (DEFAULT_TABLE table=default.Table_87eaff35bf554a20a9dbff384c14205b [id=bb994ffd4e35451e9cd661bf4bc3217a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.308013 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fe06a56f70487ea7c479b107d83d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.308872 986 leader_election.cc:304] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.309468 1500 raft_consensus.cc:2804] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:54.309576 1500 raft_consensus.cc:493] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:54.309667 1165 tablet_bootstrap.cc:654] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.309674 1500 raft_consensus.cc:3060] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:54.312489 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 202) took 2631 ms. Trace:
I20260503 07:52:54.312690 1173 rpcz_store.cc:276] 0503 07:52:51.681422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.681471 (+ 49us) service_pool.cc:224] Handling call
0503 07:52:54.131624 (+2450153us) ts_tablet_manager.cc:1151] Deleting tablet 1609d01e6cdc440085a6ebdb652d54f1
0503 07:52:54.131632 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.192540 (+ 60908us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.195470 (+ 2930us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.312441 (+116971us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2449958}
I20260503 07:52:54.313253 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 1609d01e6cdc440085a6ebdb652d54f1 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:54.315035 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 203) took 2602 ms. Trace:
I20260503 07:52:54.315210 1173 rpcz_store.cc:276] 0503 07:52:51.712117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.712168 (+ 51us) service_pool.cc:224] Handling call
0503 07:52:54.314841 (+2602673us) ts_tablet_manager.cc:1151] Deleting tablet 5e2c6d9dd87646ed9d1f86761f13f628
0503 07:52:54.314850 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.314993 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2602443}
I20260503 07:52:54.315971 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 204) took 2601 ms. Trace:
I20260503 07:52:54.316150 1173 rpcz_store.cc:276] 0503 07:52:51.714414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.714460 (+ 46us) service_pool.cc:224] Handling call
0503 07:52:54.315796 (+2601336us) ts_tablet_manager.cc:1151] Deleting tablet 65fbd09bd319440cadcc84f1d55e7bde
0503 07:52:54.315803 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.315923 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2601184}
W20260503 07:52:54.316622 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 65fbd09bd319440cadcc84f1d55e7bde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65fbd09bd319440cadcc84f1d55e7bde already in progress: creating tablet
I20260503 07:52:54.316828 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c2f31cff599248dd994a7bcee38ef2ab (DEFAULT_TABLE table=default.Table_94e12289320e4776af30df060a853a04 [id=3de278df6c8b4e58b061f0fa90cf28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.317180 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f31cff599248dd994a7bcee38ef2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.317214 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 205) took 2590 ms. Trace:
I20260503 07:52:54.317414 1173 rpcz_store.cc:276] 0503 07:52:51.727039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.727083 (+ 44us) service_pool.cc:224] Handling call
0503 07:52:54.317064 (+2589981us) ts_tablet_manager.cc:1151] Deleting tablet c00976f3444c43618af30259f0567d17
0503 07:52:54.317072 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.317176 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589784}
W20260503 07:52:54.317866 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c00976f3444c43618af30259f0567d17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00976f3444c43618af30259f0567d17 already in progress: creating tablet
I20260503 07:52:54.318495 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 206) took 2556 ms. Trace:
I20260503 07:52:54.318642 1173 rpcz_store.cc:276] 0503 07:52:51.762219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.762274 (+ 55us) service_pool.cc:224] Handling call
0503 07:52:54.318374 (+2556100us) ts_tablet_manager.cc:1151] Deleting tablet c46873d43e1b4495a92996e07f93f918
0503 07:52:54.318380 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.318455 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2555882}
W20260503 07:52:54.319114 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c46873d43e1b4495a92996e07f93f918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c46873d43e1b4495a92996e07f93f918 already in progress: creating tablet
I20260503 07:52:54.319521 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 207) took 2539 ms. Trace:
I20260503 07:52:54.319708 1173 rpcz_store.cc:276] 0503 07:52:51.780524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.780578 (+ 54us) service_pool.cc:224] Handling call
0503 07:52:54.319391 (+2538813us) ts_tablet_manager.cc:1151] Deleting tablet 388c63dc20da408ca3e141ada0200be6
0503 07:52:54.319400 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.319485 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2538598}
W20260503 07:52:54.320212 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 388c63dc20da408ca3e141ada0200be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 388c63dc20da408ca3e141ada0200be6 already in progress: creating tablet
I20260503 07:52:54.320412 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 29fe06a56f70487ea7c479b107d83d8b (DEFAULT_TABLE table=default.Table_87eaff35bf554a20a9dbff384c14205b [id=bb994ffd4e35451e9cd661bf4bc3217a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.320766 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fe06a56f70487ea7c479b107d83d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.320756 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 208) took 2523 ms. Trace:
I20260503 07:52:54.320858 1173 rpcz_store.cc:276] 0503 07:52:51.797089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.798942 (+ 1853us) service_pool.cc:224] Handling call
0503 07:52:54.320600 (+2521658us) ts_tablet_manager.cc:1151] Deleting tablet f291c68785bb4b6fb522386089fb2af3
0503 07:52:54.320609 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.320715 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2521381}
W20260503 07:52:54.321218 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f291c68785bb4b6fb522386089fb2af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f291c68785bb4b6fb522386089fb2af3 already in progress: creating tablet
I20260503 07:52:54.321570 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 209) took 2513 ms. Trace:
I20260503 07:52:54.321676 1173 rpcz_store.cc:276] 0503 07:52:51.808050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.808271 (+ 221us) service_pool.cc:224] Handling call
0503 07:52:54.321423 (+2513152us) ts_tablet_manager.cc:1151] Deleting tablet 9336e5b80c644ebcb75455770eb45d70
0503 07:52:54.321432 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.321529 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2512900}
W20260503 07:52:54.323879 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9336e5b80c644ebcb75455770eb45d70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9336e5b80c644ebcb75455770eb45d70 already in progress: creating tablet
I20260503 07:52:54.329121 1591 consensus_queue.cc:1048] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:54.329741 917 raft_consensus.cc:3060] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:54.329805 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (DEFAULT_TABLE table=default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.330210 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a845e02bdb54952806f90d3f7cd9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.330309 744 tablet_service.cc:1511] Processing CreateTablet for tablet c2f31cff599248dd994a7bcee38ef2ab (DEFAULT_TABLE table=default.Table_94e12289320e4776af30df060a853a04 [id=3de278df6c8b4e58b061f0fa90cf28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.331718 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f31cff599248dd994a7bcee38ef2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.332243 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08672a5853854c39b2aae8d52960f924" } modify_external_catalogs: true
I20260503 07:52:54.332437 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08672a5853854c39b2aae8d52960f924" } modify_external_catalogs: true
I20260503 07:52:54.332664 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f368c0422d5446f1862454c59366d214"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.333182 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f368c0422d5446f1862454c59366d214 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.333573 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_799c81c9b8814c84917b60f5a486306b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.334081 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_799c81c9b8814c84917b60f5a486306b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.334686 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_506c091a2d2e43bd85e86b720a60cf1d" } modify_external_catalogs: true
I20260503 07:52:54.334863 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_506c091a2d2e43bd85e86b720a60cf1d" } modify_external_catalogs: true
I20260503 07:52:54.337117 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6fb564bf16234e23874093b62f3961c0" } modify_external_catalogs: true
I20260503 07:52:54.337282 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6fb564bf16234e23874093b62f3961c0" } modify_external_catalogs: true
I20260503 07:52:54.339380 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_ac70726e72bf4ef090f638e4ebaa7558 [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 1 got 0
I20260503 07:52:54.340909 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4674c22562f744f5bce13d97ad8a52b2
I20260503 07:52:54.341486 593 catalog_manager.cc:6741] ReplaceTablet: tablet 4674c22562f744f5bce13d97ad8a52b2 deleted and replaced by tablet f4fd9524157c4225885a1f1831982faa
I20260503 07:52:54.341707 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.341729 601 catalog_manager.cc:5671] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:54.342146 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]). Expected version 1 got 0
W20260503 07:52:54.342571 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 4674c22562f744f5bce13d97ad8a52b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4674c22562f744f5bce13d97ad8a52b2 already in progress: creating tablet
I20260503 07:52:54.343555 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.343930 742 tablet_service.cc:1511] Processing CreateTablet for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (DEFAULT_TABLE table=default.Table_b7c37b4b149a4e189caa1362c3fcbea7 [id=ec636e2291634547aa977f3ab2a26ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.344333 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ea5f9f9964fbdb8eb92e6059e2531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.346424 745 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 (DEFAULT_TABLE table=default.Table_1eff757e8b944d1d8167207905bce9a1 [id=c5d1c3d4bc32495a9966899ba145e3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.347072 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae4a39d4e3a42db816e592123a6a2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.347471 743 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.348141 1174 tablet_replica.cc:333] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:54.348345 1174 raft_consensus.cc:2243] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.348770 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:52:54.349421 1500 raft_consensus.cc:515] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.350498 1500 leader_election.cc:290] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:54.350765 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.350786 1500 raft_consensus.cc:493] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.351024 1500 raft_consensus.cc:515] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.351188 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.351686 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:54.351766 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet aef746161e6b446ab0d299d37e2151ea
I20260503 07:52:54.352072 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:54.352363 988 leader_election.cc:343] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:54.352706 888 tablet_service.cc:1511] Processing CreateTablet for tablet c1c631d3da8f4ec29690c548097a454b (DEFAULT_TABLE table=default.Table_560c3883f23a4519a1bd97a75c34eb29 [id=95fc3e91893c440e8498f12f6dfd56d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.352787 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.352854 1017 tablet_service.cc:1511] Processing CreateTablet for tablet c1c631d3da8f4ec29690c548097a454b (DEFAULT_TABLE table=default.Table_560c3883f23a4519a1bd97a75c34eb29 [id=95fc3e91893c440e8498f12f6dfd56d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.353165 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c631d3da8f4ec29690c548097a454b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.353390 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c631d3da8f4ec29690c548097a454b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.353454 1500 leader_election.cc:290] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:54.354506 988 leader_election.cc:343] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:54.354781 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 296541e4c2fc4bc193d6f4cee8e65da0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296541e4c2fc4bc193d6f4cee8e65da0 already in progress: creating tablet
W20260503 07:52:54.355021 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet aef746161e6b446ab0d299d37e2151ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aef746161e6b446ab0d299d37e2151ea already in progress: creating tablet
I20260503 07:52:54.359529 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 4674c22562f744f5bce13d97ad8a52b2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.360296 898 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.361723 1174 raft_consensus.cc:2272] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.361840 759 tablet_service.cc:1511] Processing CreateTablet for tablet 29fe06a56f70487ea7c479b107d83d8b (DEFAULT_TABLE table=default.Table_87eaff35bf554a20a9dbff384c14205b [id=bb994ffd4e35451e9cd661bf4bc3217a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.362176 898 tablet_service.cc:1511] Processing CreateTablet for tablet bf51c959093d4579a5916c49e1790737 (DEFAULT_TABLE table=default.Table_e2e252c6379540cbba82d81b7a4418e6 [id=c3ebb0451cd043b3881233a5cc019e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.362494 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf51c959093d4579a5916c49e1790737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.369096 1017 tablet_service.cc:1511] Processing CreateTablet for tablet bf51c959093d4579a5916c49e1790737 (DEFAULT_TABLE table=default.Table_e2e252c6379540cbba82d81b7a4418e6 [id=c3ebb0451cd043b3881233a5cc019e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.369558 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf51c959093d4579a5916c49e1790737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.371464 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0b9ff03fba3d4a1794a8a5b94caa9731
I20260503 07:52:54.372326 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.372862 1175 tablet_replica.cc:333] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:54.373104 1175 raft_consensus.cc:2243] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:54.373368 1175 pending_rounds.cc:70] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:54.373425 1175 pending_rounds.cc:77] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847393738199040 op_type: NO_OP noop_request { }
I20260503 07:52:54.373534 1175 raft_consensus.cc:2889] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:54.373668 1175 raft_consensus.cc:2272] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.374495 1175 ts_tablet_manager.cc:1916] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.376447 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.379098 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 210) took 2465 ms. Trace:
I20260503 07:52:54.379449 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_44421a5083b5445b90c4daedbcd54e3a" } modify_external_catalogs: true
I20260503 07:52:54.379694 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_44421a5083b5445b90c4daedbcd54e3a" } modify_external_catalogs: true
I20260503 07:52:54.380301 1173 rpcz_store.cc:276] 0503 07:52:51.913821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:51.914192 (+ 371us) service_pool.cc:224] Handling call
0503 07:52:54.378952 (+2464760us) ts_tablet_manager.cc:1151] Deleting tablet 8a45012e871b4c14a3fafb4443e1e92b
0503 07:52:54.378963 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.379065 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2429594}
W20260503 07:52:54.383183 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8a45012e871b4c14a3fafb4443e1e92b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a45012e871b4c14a3fafb4443e1e92b already in progress: creating tablet
I20260503 07:52:54.384317 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 227) took 2239 ms. Trace:
I20260503 07:52:54.385210 1173 rpcz_store.cc:276] 0503 07:52:52.145186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.145242 (+ 56us) service_pool.cc:224] Handling call
0503 07:52:54.384152 (+2238910us) ts_tablet_manager.cc:1151] Deleting tablet 656dfeb5247e4cdfaacd29690353da83
0503 07:52:54.384184 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.384286 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2233741}
I20260503 07:52:54.385751 1175 ts_tablet_manager.cc:1929] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:54.385908 1175 log.cc:1199] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/0b9ff03fba3d4a1794a8a5b94caa9731
W20260503 07:52:54.386152 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 656dfeb5247e4cdfaacd29690353da83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 656dfeb5247e4cdfaacd29690353da83 already in progress: creating tablet
I20260503 07:52:54.386324 1175 ts_tablet_manager.cc:1950] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:54.386701 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 228) took 2230 ms. Trace:
I20260503 07:52:54.387377 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]) successfully deleted
I20260503 07:52:54.387579 1173 rpcz_store.cc:276] 0503 07:52:52.156040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.156320 (+ 280us) service_pool.cc:224] Handling call
0503 07:52:54.386579 (+2230259us) ts_tablet_manager.cc:1151] Deleting tablet 2f0489d86704462ab237e5226df1251f
0503 07:52:54.386587 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.386671 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2229054}
W20260503 07:52:54.388464 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2f0489d86704462ab237e5226df1251f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0489d86704462ab237e5226df1251f already in progress: creating tablet
I20260503 07:52:54.389493 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 229) took 2175 ms. Trace:
I20260503 07:52:54.389848 1173 rpcz_store.cc:276] 0503 07:52:52.213649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.213769 (+ 120us) service_pool.cc:224] Handling call
0503 07:52:54.388823 (+2175054us) ts_tablet_manager.cc:1151] Deleting tablet e16d225dde3247d1b61a03cf14b21d63
0503 07:52:54.388832 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.388936 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139187}
W20260503 07:52:54.390766 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e16d225dde3247d1b61a03cf14b21d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e16d225dde3247d1b61a03cf14b21d63 already in progress: creating tablet
I20260503 07:52:54.391481 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 230) took 2167 ms. Trace:
I20260503 07:52:54.392235 1173 rpcz_store.cc:276] 0503 07:52:52.224246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.224324 (+ 78us) service_pool.cc:224] Handling call
0503 07:52:54.391312 (+2166988us) ts_tablet_manager.cc:1151] Deleting tablet 75dfcff75f90434caf7dc26408958a16
0503 07:52:54.391321 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.391440 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2046445}
I20260503 07:52:54.392472 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_417aebd794cf47178e1eb3faf7d6b585" } modify_external_catalogs: true
I20260503 07:52:54.392498 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 17b547a24cfa4478a90d3035a59a3381 (DEFAULT_TABLE table=default.Table_4a3b06105ee840a190bc1378c02837cb [id=c7971e2f537a41a599b1f9d07135641d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.392637 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_417aebd794cf47178e1eb3faf7d6b585" } modify_external_catalogs: true
I20260503 07:52:54.392971 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b547a24cfa4478a90d3035a59a3381. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.393138 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 75dfcff75f90434caf7dc26408958a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75dfcff75f90434caf7dc26408958a16 already in progress: creating tablet
I20260503 07:52:54.393486 1173 tablet_replica.cc:333] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:54.393700 1173 raft_consensus.cc:2243] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.393844 1173 raft_consensus.cc:2272] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.391691 897 tablet_service.cc:1511] Processing CreateTablet for tablet 17b547a24cfa4478a90d3035a59a3381 (DEFAULT_TABLE table=default.Table_4a3b06105ee840a190bc1378c02837cb [id=c7971e2f537a41a599b1f9d07135641d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.398720 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b547a24cfa4478a90d3035a59a3381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.399292 1173 ts_tablet_manager.cc:1916] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.405833 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d8b0329a61dd4476bc0a65e90404efb4
I20260503 07:52:54.409277 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:52:54.409904 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.409938 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:54.410166 777 raft_consensus.cc:2468] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:54.410271 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b9ff03fba3d4a1794a8a5b94caa9731 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.410307 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:54.410513 779 raft_consensus.cc:3060] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:54.410765 754 tablet_service.cc:1511] Processing CreateTablet for tablet 17b547a24cfa4478a90d3035a59a3381 (DEFAULT_TABLE table=default.Table_4a3b06105ee840a190bc1378c02837cb [id=c7971e2f537a41a599b1f9d07135641d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.411247 761 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.411664 758 tablet_service.cc:1511] Processing CreateTablet for tablet c1c631d3da8f4ec29690c548097a454b (DEFAULT_TABLE table=default.Table_560c3883f23a4519a1bd97a75c34eb29 [id=95fc3e91893c440e8498f12f6dfd56d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.412243 741 tablet_service.cc:1511] Processing CreateTablet for tablet bf51c959093d4579a5916c49e1790737 (DEFAULT_TABLE table=default.Table_e2e252c6379540cbba82d81b7a4418e6 [id=c3ebb0451cd043b3881233a5cc019e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.412788 747 tablet_service.cc:1511] Processing CreateTablet for tablet 4de65c754b47440a914f3f2bdb86059c (DEFAULT_TABLE table=default.Table_c2d55c4df0b54958ba726afe40ebaa0b [id=b1a0841eeeab4df58c436f38252a4725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.413153 746 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.413371 779 raft_consensus.cc:2468] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:54.413482 752 tablet_service.cc:1511] Processing CreateTablet for tablet df60413555764bcab464b18c6a3370ce (DEFAULT_TABLE table=default.Table_e481f5f62cba4f8b86b738ae055ce474 [id=80c5584e658b4237a6580fd0d0a05a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.414001 748 tablet_service.cc:1511] Processing CreateTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.415508 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.415832 1174 ts_tablet_manager.cc:1916] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.416527 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.420506 743 tablet_service.cc:1511] Processing CreateTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a (DEFAULT_TABLE table=default.Table_d8ce6874d4994d94a17c0514a7528886 [id=6c1e82bcfdc24844a1061e916c0ecca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.421329 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3152281bf44946a4ae806f253ecd85 (DEFAULT_TABLE table=default.Table_af7472be34b44089a4f151c3a1324479 [id=dbdd7a759dc44fffb0dc1211d97713ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.422070 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fe06a56f70487ea7c479b107d83d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.423496 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b547a24cfa4478a90d3035a59a3381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.426347 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df60413555764bcab464b18c6a3370ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.429670 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b269ee59036d4c2f866b6b2bf45c35cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.434058 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c631d3da8f4ec29690c548097a454b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.435492 1165 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:54.436527 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 (DEFAULT_TABLE table=default.Table_2b316333c1ba4f2fb97307e35ceff30b [id=d03d86f3d47b407fbd9ac6887dd8ef80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.438378 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de65c754b47440a914f3f2bdb86059c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.439158 1165 ts_tablet_manager.cc:1403] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.128s user 0.008s sys 0.013s
I20260503 07:52:54.440521 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad24ddc82bd401fb5427e7415af3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.441156 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7336c1df59754cd58c0c290b84fc0d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.442348 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf51c959093d4579a5916c49e1790737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.444983 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1aa14272946747ea8c83fed888ea0962"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.445550 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aa14272946747ea8c83fed888ea0962 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.448307 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5b457831e14149a9ab86fc749ae60c29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.448812 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b457831e14149a9ab86fc749ae60c29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.450055 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_371c2f73361d47ac88caf3061820323f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.450484 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_371c2f73361d47ac88caf3061820323f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.451584 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0968db2680314f3bbce927d083943ec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.451982 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0968db2680314f3bbce927d083943ec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.454310 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c09bafa7c9e4f9784dfdb48a31685db" } new_table_name: "default.Table_55ddaf4943804438b0a7ca4c13f24874" modify_external_catalogs: true
I20260503 07:52:54.455096 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3152281bf44946a4ae806f253ecd85. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.462198 1590 log.cc:927] Time spent T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260503 07:52:54.462509 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.465451 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 4de65c754b47440a914f3f2bdb86059c (DEFAULT_TABLE table=default.Table_c2d55c4df0b54958ba726afe40ebaa0b [id=b1a0841eeeab4df58c436f38252a4725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.465867 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de65c754b47440a914f3f2bdb86059c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.467018 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac8d392c3bb94f03819fae08fc009fbc consensus state has no leader
I20260503 07:52:54.468000 1021 tablet_service.cc:1511] Processing CreateTablet for tablet df60413555764bcab464b18c6a3370ce (DEFAULT_TABLE table=default.Table_e481f5f62cba4f8b86b738ae055ce474 [id=80c5584e658b4237a6580fd0d0a05a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.468351 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df60413555764bcab464b18c6a3370ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.470273 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1eff757e8b944d1d8167207905bce9a1" } new_table_name: "default.Table_e55353e7b6e34de4aa897a63b55dd09b" modify_external_catalogs: true
I20260503 07:52:54.476609 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a (DEFAULT_TABLE table=default.Table_d8ce6874d4994d94a17c0514a7528886 [id=6c1e82bcfdc24844a1061e916c0ecca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.477619 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7336c1df59754cd58c0c290b84fc0d7a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.478122 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ae4a39d4e3a42db816e592123a6a2e7 consensus state has no leader
I20260503 07:52:54.479041 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 (DEFAULT_TABLE table=default.Table_2b316333c1ba4f2fb97307e35ceff30b [id=d03d86f3d47b407fbd9ac6887dd8ef80]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.479627 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d8b0329a61dd4476bc0a65e90404efb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b0329a61dd4476bc0a65e90404efb4 already in progress: creating tablet
I20260503 07:52:54.480978 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3152281bf44946a4ae806f253ecd85 (DEFAULT_TABLE table=default.Table_af7472be34b44089a4f151c3a1324479 [id=dbdd7a759dc44fffb0dc1211d97713ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.481410 1020 tablet_service.cc:1511] Processing CreateTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.481824 1019 tablet_service.cc:1511] Processing CreateTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 (DEFAULT_TABLE table=default.Table_51e23ef11221401880db30766699f50b [id=d50c9bf0f6634d9da120d9ca7265b9b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.482751 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.483316 742 tablet_service.cc:1511] Processing CreateTablet for tablet 2be28ad252ff47879caa1021fdf5db66 (DEFAULT_TABLE table=default.Table_799c81c9b8814c84917b60f5a486306b [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.483084 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.483681 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be28ad252ff47879caa1021fdf5db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.485530 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad24ddc82bd401fb5427e7415af3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.486316 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db13f91ef1d740c387bacbb689ddf1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.486912 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3152281bf44946a4ae806f253ecd85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.491065 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8d47da511422d9665326520d35601 (DEFAULT_TABLE table=default.Table_f368c0422d5446f1862454c59366d214 [id=50bda4f74f7c44f2a7fd66663fcdfa53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.491452 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 54bf46b34b1043e2ab6c9f8b2c871227 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bf46b34b1043e2ab6c9f8b2c871227 already in progress: creating tablet
I20260503 07:52:54.492038 755 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08da2052f5482792c8b3294e9b7332 (DEFAULT_TABLE table=default.Table_ef8abe51f2574f0fb195e588e808102e [id=a8e0e85f02244d0b845242b0d59eedce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.492444 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08da2052f5482792c8b3294e9b7332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.492601 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 2be28ad252ff47879caa1021fdf5db66 (DEFAULT_TABLE table=default.Table_799c81c9b8814c84917b60f5a486306b [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.493216 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dcbb5010e346fca99dffdbdbb337f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.493498 1165 raft_consensus.cc:359] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.493705 1165 raft_consensus.cc:385] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.493773 1165 raft_consensus.cc:740] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.494022 1165 consensus_queue.cc:260] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.494539 753 tablet_service.cc:1511] Processing CreateTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.493094 757 tablet_service.cc:1511] Processing CreateTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 (DEFAULT_TABLE table=default.Table_51e23ef11221401880db30766699f50b [id=d50c9bf0f6634d9da120d9ca7265b9b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.495524 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dcbb5010e346fca99dffdbdbb337f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.496460 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8d47da511422d9665326520d35601 (DEFAULT_TABLE table=default.Table_f368c0422d5446f1862454c59366d214 [id=50bda4f74f7c44f2a7fd66663fcdfa53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.498809 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be28ad252ff47879caa1021fdf5db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.500011 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba5f770a448465491160fc72f66a830 (DEFAULT_TABLE table=default.Table_ed54f32e26104932829e79bdf8b2f30f [id=690d003e59fc4a3f8da82e986e048616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.500221 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (DEFAULT_TABLE table=default.Table_e1a4953c942149fd9a76143ba3632364 [id=511c8a1028b1401c91f3c164e4b70683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.501904 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8d47da511422d9665326520d35601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.506609 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08da2052f5482792c8b3294e9b7332 (DEFAULT_TABLE table=default.Table_ef8abe51f2574f0fb195e588e808102e [id=a8e0e85f02244d0b845242b0d59eedce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.507092 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 (DEFAULT_TABLE table=default.Table_c1eba299413e4b178556b5158d1b473c [id=24fd4589eb1145eaaef226bb18346edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.507233 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba5f770a448465491160fc72f66a830 (DEFAULT_TABLE table=default.Table_ed54f32e26104932829e79bdf8b2f30f [id=690d003e59fc4a3f8da82e986e048616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.508131 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ba5e9cfe6b4f24a8f91c571416dae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.508215 1025 tablet_service.cc:1511] Processing CreateTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 (DEFAULT_TABLE table=default.Table_4735ea34fadb44c6bccac28390513b6e [id=3e2082596479404195cc918c09dfbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.508809 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba5f770a448465491160fc72f66a830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.509034 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7af140ce144bc8b2e147dad98ac201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.509164 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db13f91ef1d740c387bacbb689ddf1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.509186 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f376fbfbfd804ffcad30dcd55b7afc6a (DEFAULT_TABLE table=default.Table_2c1d486cfb2e4e21a2467ea56437fe6c [id=c2c77249afa8458db3ea69471dc58a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.509639 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376fbfbfd804ffcad30dcd55b7afc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.510082 750 tablet_service.cc:1511] Processing CreateTablet for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (DEFAULT_TABLE table=default.Table_e1a4953c942149fd9a76143ba3632364 [id=511c8a1028b1401c91f3c164e4b70683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.511103 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bb85190cd94e8282eec9a1bc0efab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.512900 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 (DEFAULT_TABLE table=default.Table_c1eba299413e4b178556b5158d1b473c [id=24fd4589eb1145eaaef226bb18346edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.513255 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba5f770a448465491160fc72f66a830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.513947 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7af140ce144bc8b2e147dad98ac201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.515426 1165 ts_tablet_manager.cc:1434] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.070s user 0.002s sys 0.000s
I20260503 07:52:54.516273 1015 tablet_service.cc:1511] Processing CreateTablet for tablet b4df94a7071f472c8962206d51c44429 (DEFAULT_TABLE table=default.Table_bd9bb4ec203641f392c86ef3291c86fd [id=39698664b2a2421da9d4faa3ee991c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.516938 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ba5e9cfe6b4f24a8f91c571416dae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.522449 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b269ee59036d4c2f866b6b2bf45c35cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.523486 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8d47da511422d9665326520d35601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.527098 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ac70726e72bf4ef090f638e4ebaa7558" } new_table_name: "default.Table_4e725c831ebf41f09d1bfa49fa3570be" modify_external_catalogs: true
I20260503 07:52:54.527613 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_08f0028f534e4a9aa24c1791f1a15a1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.527926 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b7c37b4b149a4e189caa1362c3fcbea7" } new_table_name: "default.Table_1bbaa09393684afab1b6a6fc08e6f378" modify_external_catalogs: true
I20260503 07:52:54.524525 1014 tablet_service.cc:1511] Processing CreateTablet for tablet cf24705f7d004254bf8456c063634d65 (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.528155 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08f0028f534e4a9aa24c1791f1a15a1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.527098 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2e252c6379540cbba82d81b7a4418e6" } new_table_name: "default.Table_a740af6e2f844b129450e16ac9bd0a46" modify_external_catalogs: true
I20260503 07:52:54.535343 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0f637b1e87f94fe1a8603d336fcb9487"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.535846 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f637b1e87f94fe1a8603d336fcb9487 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.537681 1619 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:54.545096 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_36cf7c4b44ca4d05946703a4cfa350f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.545680 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36cf7c4b44ca4d05946703a4cfa350f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.547039 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_afd273127f664810a60c73fd24617fd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.547119 1165 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:54.547485 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afd273127f664810a60c73fd24617fd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:54.549226 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf51c959093d4579a5916c49e1790737 consensus state has no leader
W20260503 07:52:54.550010 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538ea5f9f9964fbdb8eb92e6059e2531 consensus state has no leader
I20260503 07:52:54.556506 894 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3152281bf44946a4ae806f253ecd85 (DEFAULT_TABLE table=default.Table_af7472be34b44089a4f151c3a1324479 [id=dbdd7a759dc44fffb0dc1211d97713ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.559728 886 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8d47da511422d9665326520d35601 (DEFAULT_TABLE table=default.Table_f368c0422d5446f1862454c59366d214 [id=50bda4f74f7c44f2a7fd66663fcdfa53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.560386 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba5f770a448465491160fc72f66a830 (DEFAULT_TABLE table=default.Table_ed54f32e26104932829e79bdf8b2f30f [id=690d003e59fc4a3f8da82e986e048616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.560758 881 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 (DEFAULT_TABLE table=default.Table_c1eba299413e4b178556b5158d1b473c [id=24fd4589eb1145eaaef226bb18346edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.561143 880 tablet_service.cc:1511] Processing CreateTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 (DEFAULT_TABLE table=default.Table_4735ea34fadb44c6bccac28390513b6e [id=3e2082596479404195cc918c09dfbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.562981 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b2bec64a51294f3b898105acb1e15225"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.563462 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2bec64a51294f3b898105acb1e15225 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.564883 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50b3d54db78b4a0fa4c0735349d51cad" } modify_external_catalogs: true
I20260503 07:52:54.565074 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50b3d54db78b4a0fa4c0735349d51cad" } modify_external_catalogs: true
I20260503 07:52:54.566421 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c8d970f11c484c07994854adfe178e80" } modify_external_catalogs: true
I20260503 07:52:54.566591 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c8d970f11c484c07994854adfe178e80" } modify_external_catalogs: true
I20260503 07:52:54.567756 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0b72eae732be40028547d86f3928b0e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.570222 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b72eae732be40028547d86f3928b0e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.571272 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.573450 888 tablet_service.cc:1511] Processing CreateTablet for tablet df60413555764bcab464b18c6a3370ce (DEFAULT_TABLE table=default.Table_e481f5f62cba4f8b86b738ae055ce474 [id=80c5584e658b4237a6580fd0d0a05a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.574496 747 tablet_service.cc:1511] Processing CreateTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 (DEFAULT_TABLE table=default.Table_4735ea34fadb44c6bccac28390513b6e [id=3e2082596479404195cc918c09dfbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.575047 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ef660e5b1231415e99e9d960d17d0ff3" } modify_external_catalogs: true
I20260503 07:52:54.575131 757 tablet_service.cc:1511] Processing CreateTablet for tablet f376fbfbfd804ffcad30dcd55b7afc6a (DEFAULT_TABLE table=default.Table_2c1d486cfb2e4e21a2467ea56437fe6c [id=c2c77249afa8458db3ea69471dc58a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.575228 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ef660e5b1231415e99e9d960d17d0ff3" } modify_external_catalogs: true
I20260503 07:52:54.577395 891 tablet_service.cc:1511] Processing CreateTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.577622 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.577836 883 tablet_service.cc:1511] Processing CreateTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a (DEFAULT_TABLE table=default.Table_d8ce6874d4994d94a17c0514a7528886 [id=6c1e82bcfdc24844a1061e916c0ecca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.577886 884 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 (DEFAULT_TABLE table=default.Table_2b316333c1ba4f2fb97307e35ceff30b [id=d03d86f3d47b407fbd9ac6887dd8ef80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.578178 759 tablet_service.cc:1511] Processing CreateTablet for tablet cf24705f7d004254bf8456c063634d65 (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.578408 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 773fca453dac452abc723e49b70111b9
I20260503 07:52:54.580335 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3650ec1de28c4f1bafd979257dd2b778
I20260503 07:52:54.581110 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bb85190cd94e8282eec9a1bc0efab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.581532 1166 tablet_bootstrap.cc:492] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:54.582700 744 tablet_service.cc:1511] Processing CreateTablet for tablet fc130dcd067f43f08748360a692eb048 (DEFAULT_TABLE table=default.Table_87c6f90a432448319533430626fb7662 [id=c08288249590438bbcacc49fb2e3ee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.584295 882 tablet_service.cc:1511] Processing CreateTablet for tablet cf24705f7d004254bf8456c063634d65 (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.588330 755 tablet_service.cc:1511] Processing CreateTablet for tablet b4df94a7071f472c8962206d51c44429 (DEFAULT_TABLE table=default.Table_bd9bb4ec203641f392c86ef3291c86fd [id=39698664b2a2421da9d4faa3ee991c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.592588 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08da2052f5482792c8b3294e9b7332 (DEFAULT_TABLE table=default.Table_ef8abe51f2574f0fb195e588e808102e [id=a8e0e85f02244d0b845242b0d59eedce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.592830 892 tablet_service.cc:1511] Processing CreateTablet for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (DEFAULT_TABLE table=default.Table_e1a4953c942149fd9a76143ba3632364 [id=511c8a1028b1401c91f3c164e4b70683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.587647 898 tablet_service.cc:1511] Processing CreateTablet for tablet fc130dcd067f43f08748360a692eb048 (DEFAULT_TABLE table=default.Table_87c6f90a432448319533430626fb7662 [id=c08288249590438bbcacc49fb2e3ee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.594836 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc130dcd067f43f08748360a692eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.597635 893 tablet_service.cc:1511] Processing CreateTablet for tablet 2be28ad252ff47879caa1021fdf5db66 (DEFAULT_TABLE table=default.Table_799c81c9b8814c84917b60f5a486306b [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.597838 887 tablet_service.cc:1511] Processing CreateTablet for tablet f376fbfbfd804ffcad30dcd55b7afc6a (DEFAULT_TABLE table=default.Table_2c1d486cfb2e4e21a2467ea56437fe6c [id=c2c77249afa8458db3ea69471dc58a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.598206 879 tablet_service.cc:1511] Processing CreateTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 (DEFAULT_TABLE table=default.Table_51e23ef11221401880db30766699f50b [id=d50c9bf0f6634d9da120d9ca7265b9b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.598539 890 tablet_service.cc:1511] Processing CreateTablet for tablet b4df94a7071f472c8962206d51c44429 (DEFAULT_TABLE table=default.Table_bd9bb4ec203641f392c86ef3291c86fd [id=39698664b2a2421da9d4faa3ee991c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.598942 885 tablet_service.cc:1511] Processing CreateTablet for tablet 4de65c754b47440a914f3f2bdb86059c (DEFAULT_TABLE table=default.Table_c2d55c4df0b54958ba726afe40ebaa0b [id=b1a0841eeeab4df58c436f38252a4725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.599411 889 tablet_service.cc:1511] Processing CreateTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.601099 1166 ts_tablet_manager.cc:1403] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.299s user 0.002s sys 0.002s
I20260503 07:52:54.601953 1166 raft_consensus.cc:359] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.602741 1166 raft_consensus.cc:385] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.602845 1166 raft_consensus.cc:740] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.603221 1166 consensus_queue.cc:260] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.604329 1584 raft_consensus.cc:493] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.604436 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf24705f7d004254bf8456c063634d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.604485 1584 raft_consensus.cc:515] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.605434 1584 leader_election.cc:290] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:54.608124 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3152281bf44946a4ae806f253ecd85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.608383 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad24ddc82bd401fb5427e7415af3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.608561 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376fbfbfd804ffcad30dcd55b7afc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.608748 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7336c1df59754cd58c0c290b84fc0d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.610564 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08da2052f5482792c8b3294e9b7332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.611454 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8d47da511422d9665326520d35601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.611891 753 tablet_service.cc:1511] Processing CreateTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 (DEFAULT_TABLE table=default.Table_8e75811b18d54faaa637076e44702c7b [id=11e56b3f688947aaaffb8ed42805c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.612071 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bb85190cd94e8282eec9a1bc0efab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.612406 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b269ee59036d4c2f866b6b2bf45c35cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.612623 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ba5e9cfe6b4f24a8f91c571416dae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.612797 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df60413555764bcab464b18c6a3370ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.613390 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc130dcd067f43f08748360a692eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.614365 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf24705f7d004254bf8456c063634d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.617026 742 tablet_service.cc:1511] Processing CreateTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 (DEFAULT_TABLE table=default.Table_67b0255f537f478181bd75c8c5561b78 [id=fc76a5abf5674e2580813d1563626b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.618522 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be28ad252ff47879caa1021fdf5db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.619457 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df94a7071f472c8962206d51c44429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.623773 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dcbb5010e346fca99dffdbdbb337f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.623795 851 leader_election.cc:343] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:54.624738 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db13f91ef1d740c387bacbb689ddf1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.626392 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7af140ce144bc8b2e147dad98ac201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.627624 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba5f770a448465491160fc72f66a830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.636284 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4b4c47d9f77147ee8df6ed83f184ea80" } modify_external_catalogs: true
I20260503 07:52:54.636766 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f42b9c55cc4943d18c8b37b7e1a42002" } modify_external_catalogs: true
I20260503 07:52:54.648108 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 2 got 0
I20260503 07:52:54.649960 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 3 got 0
I20260503 07:52:54.650451 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5ce16dd96cf04ae293601108381a2a47
I20260503 07:52:54.652730 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4b4c47d9f77147ee8df6ed83f184ea80" } modify_external_catalogs: true
I20260503 07:52:54.653602 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f42b9c55cc4943d18c8b37b7e1a42002" } modify_external_catalogs: true
I20260503 07:52:54.660358 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0600b284147e49f7b72b73b9f21e7632"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.660943 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0600b284147e49f7b72b73b9f21e7632 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.663060 1017 tablet_service.cc:1511] Processing CreateTablet for tablet fc130dcd067f43f08748360a692eb048 (DEFAULT_TABLE table=default.Table_87c6f90a432448319533430626fb7662 [id=c08288249590438bbcacc49fb2e3ee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.617655 754 tablet_service.cc:1511] Processing CreateTablet for tablet 956600f557b84dac98be63ffe14f4e19 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.624006 752 tablet_service.cc:1511] Processing CreateTablet for tablet d7e4ba72b51a4343be56d56f93693939 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.629707 750 tablet_service.cc:1511] Processing CreateTablet for tablet 18523493ee4841cb8949826239e2e458 (DEFAULT_TABLE table=default.Table_d86e37b23cee4cec9605969951db1bd3 [id=781a43f54aab4e48ba6c66322d204f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.635723 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0752eb4fa49a48cf521f9a072689a (DEFAULT_TABLE table=default.Table_eca13fd90a5d4612bf83442d4bc8e4f9 [id=c5ff12b9cdb742e4956843dd88285d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.637784 756 tablet_service.cc:1511] Processing CreateTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 (DEFAULT_TABLE table=default.Table_770b887c7e33491ea821bf8d8a86448a [id=fb064ff3d350482aba7d72c9f634820e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.638970 760 tablet_service.cc:1511] Processing CreateTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 (DEFAULT_TABLE table=default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.651364 743 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e (DEFAULT_TABLE table=default.Table_f42b9c55cc4943d18c8b37b7e1a42002 [id=f80b688eb70244bca8da3d591ddf3c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.652667 758 tablet_service.cc:1511] Processing CreateTablet for tablet f4fd9524157c4225885a1f1831982faa (DEFAULT_TABLE table=default.Table_d52a967c6b2743c0bdea087b3f771295 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.655818 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 (DEFAULT_TABLE table=default.Table_371c2f73361d47ac88caf3061820323f [id=3283681bb0bd4a83903cc189d90c0b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.671000 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2683448c3f4df3bb0b14683d8b5222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.672351 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57261ae6531348d7bdd8deb5dfd980b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.673585 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df94a7071f472c8962206d51c44429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.674728 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376fbfbfd804ffcad30dcd55b7afc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.676088 1174 ts_tablet_manager.cc:1929] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.676282 1174 log.cc:1199] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c46873d43e1b4495a92996e07f93f918
I20260503 07:52:54.678037 1174 ts_tablet_manager.cc:1950] T c46873d43e1b4495a92996e07f93f918 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:54.678274 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 (DEFAULT_TABLE table=default.Table_67b0255f537f478181bd75c8c5561b78 [id=fc76a5abf5674e2580813d1563626b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.678958 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956600f557b84dac98be63ffe14f4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.682329 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fedc936702dc4dfa92e62db580accb77" } new_table_name: "default.Table_9872574717e846d9a7ef117ac6a2b8b7" modify_external_catalogs: true
I20260503 07:52:54.682361 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8853624ee831417c9dbc9a87aef34f3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.683043 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e481f5f62cba4f8b86b738ae055ce474" } new_table_name: "default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a" modify_external_catalogs: true
I20260503 07:52:54.684526 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_579d94072b504815930a2235c75efb86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.685355 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ce77bf363e044ba3b130aa84bcdb5694"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.688051 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8853624ee831417c9dbc9a87aef34f3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:54.689883 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_579d94072b504815930a2235c75efb86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:54.693214 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f4446badf064ecabc01b330f3babde2 consensus state has no leader
W20260503 07:52:54.694809 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df60413555764bcab464b18c6a3370ce consensus state has no leader
W20260503 07:52:54.696698 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce77bf363e044ba3b130aa84bcdb5694 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.698268 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f522dc5e8b12409eb9ed1a763d0db741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.700452 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df94a7071f472c8962206d51c44429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.700616 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0752eb4fa49a48cf521f9a072689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.701408 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4fd9524157c4225885a1f1831982faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.702207 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf72d49cfd24083abee07e0d2190e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.704005 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de65c754b47440a914f3f2bdb86059c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.704309 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18523493ee4841cb8949826239e2e458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.705128 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3759511d942bfbc6e50ea2e2f2777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.706468 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a7ad2250a3414aa5167d54c2c90941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.708297 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 (DEFAULT_TABLE table=default.Table_770b887c7e33491ea821bf8d8a86448a [id=fb064ff3d350482aba7d72c9f634820e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.710600 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 956600f557b84dac98be63ffe14f4e19 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.713467 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08da2052f5482792c8b3294e9b7332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.722389 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e4ba72b51a4343be56d56f93693939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.723949 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf24705f7d004254bf8456c063634d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.725189 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d7e4ba72b51a4343be56d56f93693939 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.731149 1165 tablet_bootstrap.cc:654] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:54.740624 1584 raft_consensus.cc:493] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.743643 1584 raft_consensus.cc:515] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.744483 1584 leader_election.cc:290] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:54.745277 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3dd5aa971d3b4a8fb492904c36f285ce" } new_table_name: "default.Table_be722fc4ce8f434d88dff4dc553a1205" modify_external_catalogs: true
I20260503 07:52:54.750828 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_51e23ef11221401880db30766699f50b" } new_table_name: "default.Table_9ae6c84f1a8340a9858fbed22de8d5bf" modify_external_catalogs: true
I20260503 07:52:54.751372 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956600f557b84dac98be63ffe14f4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.752369 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0ebc08471c1142c6809ceb1ded79d2f1" } new_table_name: "default.Table_8ce2b0ef0031470695ebd84edbc7a458" modify_external_catalogs: true
I20260503 07:52:54.752516 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 3 got 2
I20260503 07:52:54.754261 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 568ccdf187eb4cae9688ff4929f3e95e
W20260503 07:52:54.754319 988 consensus_peers.cc:597] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:54.755307 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_663547df39b940328f0864f79b3f481d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.755860 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_663547df39b940328f0864f79b3f481d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.756034 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7f8c14a439a6480c8d3e6d940f811f4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.756539 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f8c14a439a6480c8d3e6d940f811f4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:54.759399 988 consensus_peers.cc:597] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:54.759516 745 tablet_service.cc:1511] Processing CreateTablet for tablet f54aaadc3d22437286303caac65c7cb4 (DEFAULT_TABLE table=default.Table_1aa14272946747ea8c83fed888ea0962 [id=7d8418468e054e5aa3fba50d66896441]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.759618 988 consensus_peers.cc:597] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:54.761413 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54aaadc3d22437286303caac65c7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.766083 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.766348 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.766712 761 tablet_service.cc:1511] Processing CreateTablet for tablet b5f31f37e97345bb9187865e38ee1d61 (DEFAULT_TABLE table=default.Table_5b457831e14149a9ab86fc749ae60c29 [id=9ea7f1b5db1a43d9b63c50bf55f704bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.767050 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f31f37e97345bb9187865e38ee1d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.758109 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 18523493ee4841cb8949826239e2e458 (DEFAULT_TABLE table=default.Table_d86e37b23cee4cec9605969951db1bd3 [id=781a43f54aab4e48ba6c66322d204f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.768589 917 raft_consensus.cc:3060] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:54.769481 851 leader_election.cc:343] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:54.771783 1584 raft_consensus.cc:493] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.771908 1584 raft_consensus.cc:515] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.773361 1584 leader_election.cc:290] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:54.775089 851 leader_election.cc:343] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 295cfe6e7a7043b2905a6e90dd520002
W20260503 07:52:54.777546 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2dcbb5010e346fca99dffdbdbb337f4 consensus state has no leader
I20260503 07:52:54.777616 1173 ts_tablet_manager.cc:1929] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.777750 1173 log.cc:1199] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/51494da361814bf1917182ed2952e28d
I20260503 07:52:54.778120 1173 ts_tablet_manager.cc:1950] T 51494da361814bf1917182ed2952e28d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:54.778815 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ed9c3e79bc39467aa5ab8d80c7783faa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.779384 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed9c3e79bc39467aa5ab8d80c7783faa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.781317 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b2bec64a51294f3b898105acb1e15225" } modify_external_catalogs: true
I20260503 07:52:54.781488 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b2bec64a51294f3b898105acb1e15225" } modify_external_catalogs: true
I20260503 07:52:54.782938 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_49b37ac0c82347efae878d0fc6198faa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.783430 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49b37ac0c82347efae878d0fc6198faa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.783821 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3cf72d49cfd24083abee07e0d2190e3e
I20260503 07:52:54.784932 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b1952c00ba4d4ae5915968d5b34ec0a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:54.785411 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1952c00ba4d4ae5915968d5b34ec0a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.787544 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c2d55c4df0b54958ba726afe40ebaa0b" } modify_external_catalogs: true
I20260503 07:52:54.677373 741 tablet_service.cc:1511] Processing CreateTablet for tablet ae3862d990f14c3f8a084d234d941bfa (DEFAULT_TABLE table=default.Table_0968db2680314f3bbce927d083943ec1 [id=e136d740cb374200bcdf141bc530aa28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.788450 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3862d990f14c3f8a084d234d941bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.793162 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a7ad2250a3414aa5167d54c2c90941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.794118 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.794764 1174 tablet_replica.cc:333] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:54.795105 1174 raft_consensus.cc:2243] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.795461 1174 raft_consensus.cc:2272] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.796612 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 (DEFAULT_TABLE table=default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.796677 1174 ts_tablet_manager.cc:1916] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.803442 1019 tablet_service.cc:1511] Processing CreateTablet for tablet f4fd9524157c4225885a1f1831982faa (DEFAULT_TABLE table=default.Table_d52a967c6b2743c0bdea087b3f771295 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.804757 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f522dc5e8b12409eb9ed1a763d0db741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.812759 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4fd9524157c4225885a1f1831982faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.814520 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e4ba72b51a4343be56d56f93693939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.819725 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18523493ee4841cb8949826239e2e458. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:54.823637 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f11c020bd0484adfa6d7dae67818f7e5 consensus state has no leader
I20260503 07:52:54.824218 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c2d55c4df0b54958ba726afe40ebaa0b" } modify_external_catalogs: true
I20260503 07:52:54.824858 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc130dcd067f43f08748360a692eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.827766 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0752eb4fa49a48cf521f9a072689a (DEFAULT_TABLE table=default.Table_eca13fd90a5d4612bf83442d4bc8e4f9 [id=c5ff12b9cdb742e4956843dd88285d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.833256 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e (DEFAULT_TABLE table=default.Table_f42b9c55cc4943d18c8b37b7e1a42002 [id=f80b688eb70244bca8da3d591ddf3c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.836403 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c46873d43e1b4495a92996e07f93f918 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
W20260503 07:52:54.836823 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 296541e4c2fc4bc193d6f4cee8e65da0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296541e4c2fc4bc193d6f4cee8e65da0 already in progress: creating tablet
I20260503 07:52:54.839359 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0752eb4fa49a48cf521f9a072689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.791991 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 (DEFAULT_TABLE table=default.Table_8e75811b18d54faaa637076e44702c7b [id=11e56b3f688947aaaffb8ed42805c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.841138 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57261ae6531348d7bdd8deb5dfd980b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.847638 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.853672 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2683448c3f4df3bb0b14683d8b5222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.855700 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e75811b18d54faaa637076e44702c7b" } modify_external_catalogs: true
I20260503 07:52:54.855777 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d6ef064db41c4038af67e0d8bc00e797"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.855954 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e75811b18d54faaa637076e44702c7b" } modify_external_catalogs: true
W20260503 07:52:54.856355 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ef064db41c4038af67e0d8bc00e797 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.785087 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 240) took 2356 ms. Trace:
I20260503 07:52:54.859151 1173 rpcz_store.cc:276] 0503 07:52:52.428556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.609154 (+180598us) service_pool.cc:224] Handling call
0503 07:52:54.393422 (+1784268us) ts_tablet_manager.cc:1151] Deleting tablet 51494da361814bf1917182ed2952e28d
0503 07:52:54.393430 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.604020 (+210590us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.777553 (+173533us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.785042 (+ 7489us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3648,"tablet-delete.queue_time_us":1784063}
I20260503 07:52:54.860118 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 244) took 2430 ms. Trace:
I20260503 07:52:54.860240 1173 rpcz_store.cc:276] 0503 07:52:52.428946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.655500 (+226554us) service_pool.cc:224] Handling call
0503 07:52:54.859468 (+2203968us) ts_tablet_manager.cc:1151] Deleting tablet 55eb2ad7619a4a9aabe8b8d062455390
0503 07:52:54.859477 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.859567 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2191003}
I20260503 07:52:54.860590 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 246) took 2275 ms. Trace:
I20260503 07:52:54.860666 1173 rpcz_store.cc:276] 0503 07:52:52.585562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.667260 (+ 81698us) service_pool.cc:224] Handling call
0503 07:52:54.860443 (+2193183us) ts_tablet_manager.cc:1151] Deleting tablet 89572734813f4d28846ffe38868a15c3
0503 07:52:54.860453 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.860547 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178904}
I20260503 07:52:54.861009 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 247) took 2271 ms. Trace:
I20260503 07:52:54.861078 1173 rpcz_store.cc:276] 0503 07:52:52.589126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.669927 (+ 80801us) service_pool.cc:224] Handling call
0503 07:52:54.860873 (+2190946us) ts_tablet_manager.cc:1151] Deleting tablet f407467a0c9c406faaa657ce70a1028b
0503 07:52:54.860893 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.860969 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2176933}
I20260503 07:52:54.861348 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 245) took 2330 ms. Trace:
I20260503 07:52:54.861413 1173 rpcz_store.cc:276] 0503 07:52:52.531297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.662624 (+131327us) service_pool.cc:224] Handling call
0503 07:52:54.861236 (+2198612us) ts_tablet_manager.cc:1151] Deleting tablet e6d4cfb8426c485eb7ff408e04f69141
0503 07:52:54.861243 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.861310 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2176063}
I20260503 07:52:54.861745 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 248) took 2271 ms. Trace:
I20260503 07:52:54.861810 1173 rpcz_store.cc:276] 0503 07:52:52.590722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.681146 (+ 90424us) service_pool.cc:224] Handling call
0503 07:52:54.861621 (+2180475us) ts_tablet_manager.cc:1151] Deleting tablet 7eb362fee7bc4f948d3a5b660e9cbd1a
0503 07:52:54.861631 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.861704 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2167620}
I20260503 07:52:54.862087 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 259) took 1961 ms. Trace:
I20260503 07:52:54.862154 1173 rpcz_store.cc:276] 0503 07:52:52.900524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.900671 (+ 147us) service_pool.cc:224] Handling call
0503 07:52:54.861975 (+1961304us) ts_tablet_manager.cc:1151] Deleting tablet 1498486dd3db414c8062cba2d54037bb
0503 07:52:54.861982 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.862045 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1952370}
I20260503 07:52:54.862442 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 263) took 1951 ms. Trace:
I20260503 07:52:54.862506 1173 rpcz_store.cc:276] 0503 07:52:52.910849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.911018 (+ 169us) service_pool.cc:224] Handling call
0503 07:52:54.862331 (+1951313us) ts_tablet_manager.cc:1151] Deleting tablet aaaeda1a5d6d436292cd1688f8a4d467
0503 07:52:54.862337 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.862403 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1951133}
I20260503 07:52:54.862795 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 261) took 1954 ms. Trace:
I20260503 07:52:54.862864 1173 rpcz_store.cc:276] 0503 07:52:52.908142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.909194 (+ 1052us) service_pool.cc:224] Handling call
0503 07:52:54.862673 (+1953479us) ts_tablet_manager.cc:1151] Deleting tablet eea048c5820349d481ac54a570b57649
0503 07:52:54.862680 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.862750 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1917611}
I20260503 07:52:54.863214 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 260) took 1956 ms. Trace:
I20260503 07:52:54.863289 1173 rpcz_store.cc:276] 0503 07:52:52.906773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.915074 (+ 8301us) service_pool.cc:224] Handling call
0503 07:52:54.863075 (+1948001us) ts_tablet_manager.cc:1151] Deleting tablet 8b84d41bdf374871a096d1dc30dd3543
0503 07:52:54.863083 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.863165 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1898737}
I20260503 07:52:54.863586 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 262) took 1954 ms. Trace:
I20260503 07:52:54.863660 1173 rpcz_store.cc:276] 0503 07:52:52.908738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.912819 (+ 4081us) service_pool.cc:224] Handling call
0503 07:52:54.863474 (+1950655us) ts_tablet_manager.cc:1151] Deleting tablet 6ce0e09526eb4c9ba4b47c36e741702d
0503 07:52:54.863481 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:54.863543 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1898982}
I20260503 07:52:54.863925 1173 tablet_replica.cc:333] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:54.865515 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 51494da361814bf1917182ed2952e28d (table default.Table_9aac441308aa450a8796690b388843e7 [id=32f2a84ddb3f4ba5a563ab1da8877d4a]) successfully deleted
W20260503 07:52:54.865768 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 55eb2ad7619a4a9aabe8b8d062455390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55eb2ad7619a4a9aabe8b8d062455390 already in progress: creating tablet
W20260503 07:52:54.865947 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 89572734813f4d28846ffe38868a15c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89572734813f4d28846ffe38868a15c3 already in progress: creating tablet
W20260503 07:52:54.866139 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f407467a0c9c406faaa657ce70a1028b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f407467a0c9c406faaa657ce70a1028b already in progress: creating tablet
W20260503 07:52:54.866283 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e6d4cfb8426c485eb7ff408e04f69141 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6d4cfb8426c485eb7ff408e04f69141 already in progress: creating tablet
W20260503 07:52:54.866436 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eb362fee7bc4f948d3a5b660e9cbd1a already in progress: creating tablet
W20260503 07:52:54.866602 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1498486dd3db414c8062cba2d54037bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1498486dd3db414c8062cba2d54037bb already in progress: creating tablet
W20260503 07:52:54.866783 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet aaaeda1a5d6d436292cd1688f8a4d467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeda1a5d6d436292cd1688f8a4d467 already in progress: creating tablet
W20260503 07:52:54.866938 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet eea048c5820349d481ac54a570b57649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eea048c5820349d481ac54a570b57649 already in progress: creating tablet
W20260503 07:52:54.867143 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8b84d41bdf374871a096d1dc30dd3543 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b84d41bdf374871a096d1dc30dd3543 already in progress: creating tablet
W20260503 07:52:54.867389 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6ce0e09526eb4c9ba4b47c36e741702d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ce0e09526eb4c9ba4b47c36e741702d already in progress: creating tablet
I20260503 07:52:54.868538 892 tablet_service.cc:1511] Processing CreateTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 (DEFAULT_TABLE table=default.Table_67b0255f537f478181bd75c8c5561b78 [id=fc76a5abf5674e2580813d1563626b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.869572 880 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e (DEFAULT_TABLE table=default.Table_f42b9c55cc4943d18c8b37b7e1a42002 [id=f80b688eb70244bca8da3d591ddf3c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.870628 888 tablet_service.cc:1511] Processing CreateTablet for tablet ae3862d990f14c3f8a084d234d941bfa (DEFAULT_TABLE table=default.Table_0968db2680314f3bbce927d083943ec1 [id=e136d740cb374200bcdf141bc530aa28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.874253 885 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 (DEFAULT_TABLE table=default.Table_371c2f73361d47ac88caf3061820323f [id=3283681bb0bd4a83903cc189d90c0b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.875268 897 tablet_service.cc:1511] Processing CreateTablet for tablet f54aaadc3d22437286303caac65c7cb4 (DEFAULT_TABLE table=default.Table_1aa14272946747ea8c83fed888ea0962 [id=7d8418468e054e5aa3fba50d66896441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.876091 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.876277 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.876535 891 tablet_service.cc:1511] Processing CreateTablet for tablet b5f31f37e97345bb9187865e38ee1d61 (DEFAULT_TABLE table=default.Table_5b457831e14149a9ab86fc749ae60c29 [id=9ea7f1b5db1a43d9b63c50bf55f704bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.877336 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.877441 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ae3862d990f14c3f8a084d234d941bfa (DEFAULT_TABLE table=default.Table_0968db2680314f3bbce927d083943ec1 [id=e136d740cb374200bcdf141bc530aa28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.877632 886 tablet_service.cc:1511] Processing CreateTablet for tablet baa7721278d14e71aeba005d2bd40ecd (DEFAULT_TABLE table=default.Table_36cf7c4b44ca4d05946703a4cfa350f3 [id=4c5ebd90d9b6488089f4c3eff4f5a027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.878346 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f54aaadc3d22437286303caac65c7cb4 (DEFAULT_TABLE table=default.Table_1aa14272946747ea8c83fed888ea0962 [id=7d8418468e054e5aa3fba50d66896441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.878666 893 tablet_service.cc:1511] Processing CreateTablet for tablet 722411278ae148d5b3d082d95683d12a (DEFAULT_TABLE table=default.Table_b2bec64a51294f3b898105acb1e15225 [id=df91a26f2947416f9bd81b5652824cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.880273 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf72d49cfd24083abee07e0d2190e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.795951 889 tablet_service.cc:1511] Processing CreateTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 (DEFAULT_TABLE table=default.Table_8e75811b18d54faaa637076e44702c7b [id=11e56b3f688947aaaffb8ed42805c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.809410 898 tablet_service.cc:1511] Processing CreateTablet for tablet 956600f557b84dac98be63ffe14f4e19 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.818426 887 tablet_service.cc:1511] Processing CreateTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 (DEFAULT_TABLE table=default.Table_770b887c7e33491ea821bf8d8a86448a [id=fb064ff3d350482aba7d72c9f634820e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.825414 884 tablet_service.cc:1511] Processing CreateTablet for tablet d7e4ba72b51a4343be56d56f93693939 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.825476 1584 raft_consensus.cc:493] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.882889 1584 raft_consensus.cc:515] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:54.883201 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e3c1abd9ad204dfa8660122ba6b1a119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.883461 1584 leader_election.cc:290] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:54.883762 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3c1abd9ad204dfa8660122ba6b1a119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.883936 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.827797 882 tablet_service.cc:1511] Processing CreateTablet for tablet 18523493ee4841cb8949826239e2e458 (DEFAULT_TABLE table=default.Table_d86e37b23cee4cec9605969951db1bd3 [id=781a43f54aab4e48ba6c66322d204f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.840595 896 tablet_service.cc:1511] Processing CreateTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 (DEFAULT_TABLE table=default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.885185 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 773fca453dac452abc723e49b70111b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 773fca453dac452abc723e49b70111b9 already in progress: creating tablet
I20260503 07:52:54.845777 894 tablet_service.cc:1511] Processing CreateTablet for tablet f4fd9524157c4225885a1f1831982faa (DEFAULT_TABLE table=default.Table_d52a967c6b2743c0bdea087b3f771295 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:54.885740 851 leader_election.cc:343] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:54.885929 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54aaadc3d22437286303caac65c7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.847910 890 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0752eb4fa49a48cf521f9a072689a (DEFAULT_TABLE table=default.Table_eca13fd90a5d4612bf83442d4bc8e4f9 [id=c5ff12b9cdb742e4956843dd88285d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.886296 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3862d990f14c3f8a084d234d941bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.888809 883 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 (DEFAULT_TABLE table=default.Table_afd273127f664810a60c73fd24617fd6 [id=3cfe9d08d6a44ae988bd657d4956a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.894888 895 tablet_service.cc:1511] Processing CreateTablet for tablet c0ceddd751644d20bcbda15a462d5342 (DEFAULT_TABLE table=default.Table_08f0028f534e4a9aa24c1791f1a15a1d [id=36a30c4e7a864127b873fc19a9b9cfd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.895061 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:54.895370 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_36cf7c4b44ca4d05946703a4cfa350f3" } new_table_name: "default.Table_0f465ee67c38409ea945ead7c9f84eae" modify_external_catalogs: true
I20260503 07:52:54.895646 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 295cfe6e7a7043b2905a6e90dd520002 with delete_type TABLET_DATA_DELETED (replaced by tablet 75dfcff75f90434caf7dc26408958a16) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.895824 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:54.896090 881 tablet_service.cc:1511] Processing CreateTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 (DEFAULT_TABLE table=default.Table_0f637b1e87f94fe1a8603d336fcb9487 [id=5e159b01c9a04578a7a7e6fee6373325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.896875 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:54.899155 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3650ec1de28c4f1bafd979257dd2b778 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3650ec1de28c4f1bafd979257dd2b778 already in progress: creating tablet
I20260503 07:52:54.900508 751 tablet_service.cc:1511] Processing CreateTablet for tablet 722411278ae148d5b3d082d95683d12a (DEFAULT_TABLE table=default.Table_b2bec64a51294f3b898105acb1e15225 [id=df91a26f2947416f9bd81b5652824cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.900914 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722411278ae148d5b3d082d95683d12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.902724 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 (DEFAULT_TABLE table=default.Table_371c2f73361d47ac88caf3061820323f [id=3283681bb0bd4a83903cc189d90c0b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.904764 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:54.905809 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5ce16dd96cf04ae293601108381a2a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce16dd96cf04ae293601108381a2a47 already in progress: creating tablet
I20260503 07:52:54.909772 1165 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:54.910013 1165 ts_tablet_manager.cc:1403] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.394s user 0.003s sys 0.004s
I20260503 07:52:54.910948 1165 raft_consensus.cc:359] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.911238 1165 raft_consensus.cc:385] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:54.911369 1165 raft_consensus.cc:740] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:54.911669 1165 consensus_queue.cc:260] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.916308 1165 ts_tablet_manager.cc:1434] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:54.916678 1165 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:54.917062 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3759511d942bfbc6e50ea2e2f2777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.924335 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c0ceddd751644d20bcbda15a462d5342 (DEFAULT_TABLE table=default.Table_08f0028f534e4a9aa24c1791f1a15a1d [id=36a30c4e7a864127b873fc19a9b9cfd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.924574 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a7ad2250a3414aa5167d54c2c90941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.925880 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4fd9524157c4225885a1f1831982faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.927181 1174 ts_tablet_manager.cc:1929] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:54.931684 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e4ba72b51a4343be56d56f93693939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.935627 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f522dc5e8b12409eb9ed1a763d0db741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.940287 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3862d990f14c3f8a084d234d941bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.945982 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:54.947520 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 568ccdf187eb4cae9688ff4929f3e95e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ccdf187eb4cae9688ff4929f3e95e already in progress: creating tablet
I20260503 07:52:54.952319 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18523493ee4841cb8949826239e2e458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.956338 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0752eb4fa49a48cf521f9a072689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.960368 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ef0e849f4d4eb299726b2b094a1dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.962790 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956600f557b84dac98be63ffe14f4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.965756 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_55ddaf4943804438b0a7ca4c13f24874" } new_table_name: "default.Table_f325744f54204131b4a076e2a2712261" modify_external_catalogs: true
I20260503 07:52:54.965823 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ee7f38f496474becb6a59ba8be7e5ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.966285 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_89860f4b2acb4f3b845ca047709f84af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.965832 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 722411278ae148d5b3d082d95683d12a
W20260503 07:52:54.968381 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee7f38f496474becb6a59ba8be7e5ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.971405 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ea2683448c3f4df3bb0b14683d8b5222
W20260503 07:52:54.972203 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet baa7721278d14e71aeba005d2bd40ecd consensus state has no leader
I20260503 07:52:54.972332 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7a4fc080fdcc4332aade3874b1685db1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:54.972505 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a32643442a2541d585cec3f44840509c" } modify_external_catalogs: true
I20260503 07:52:54.972635 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a32643442a2541d585cec3f44840509c" } modify_external_catalogs: true
W20260503 07:52:54.972779 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a4fc080fdcc4332aade3874b1685db1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.973397 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0600b284147e49f7b72b73b9f21e7632" } new_table_name: "default.Table_16adf807c53c4ed09bdfadfd1d27511e" modify_external_catalogs: true
W20260503 07:52:54.974543 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89860f4b2acb4f3b845ca047709f84af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.976454 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 5deea77f36d540bb8f721657b7e3500e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:54.978744 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4de65c754b47440a914f3f2bdb86059c
I20260503 07:52:54.979838 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bdbdd2e346404637b28164b4a3a71312" } new_table_name: "default.Table_b052f67527974a2baf9cedbcd25453a9" modify_external_catalogs: true
I20260503 07:52:54.982013 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54aaadc3d22437286303caac65c7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.864118 1173 raft_consensus.cc:2243] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:54.990207 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b5f31f37e97345bb9187865e38ee1d61 (DEFAULT_TABLE table=default.Table_5b457831e14149a9ab86fc749ae60c29 [id=9ea7f1b5db1a43d9b63c50bf55f704bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.990470 1024 tablet_service.cc:1511] Processing CreateTablet for tablet baa7721278d14e71aeba005d2bd40ecd (DEFAULT_TABLE table=default.Table_36cf7c4b44ca4d05946703a4cfa350f3 [id=4c5ebd90d9b6488089f4c3eff4f5a027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.992271 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 (DEFAULT_TABLE table=default.Table_afd273127f664810a60c73fd24617fd6 [id=3cfe9d08d6a44ae988bd657d4956a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.992532 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 722411278ae148d5b3d082d95683d12a (DEFAULT_TABLE table=default.Table_b2bec64a51294f3b898105acb1e15225 [id=df91a26f2947416f9bd81b5652824cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.992751 986 leader_election.cc:304] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.992882 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ceddd751644d20bcbda15a462d5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.931705 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 (DEFAULT_TABLE table=default.Table_afd273127f664810a60c73fd24617fd6 [id=3cfe9d08d6a44ae988bd657d4956a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.994033 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.993994 1173 raft_consensus.cc:2272] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:54.994566 1173 ts_tablet_manager.cc:1916] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:54.994714 1622 raft_consensus.cc:493] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:54.994856 1622 raft_consensus.cc:515] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:54.995646 1622 leader_election.cc:290] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:54.996227 1171 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:54.932535 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.933303 759 tablet_service.cc:1511] Processing CreateTablet for tablet c0ceddd751644d20bcbda15a462d5342 (DEFAULT_TABLE table=default.Table_08f0028f534e4a9aa24c1791f1a15a1d [id=36a30c4e7a864127b873fc19a9b9cfd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.996991 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ceddd751644d20bcbda15a462d5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.999297 1171 ts_tablet_manager.cc:1403] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.709s user 0.004s sys 0.020s
I20260503 07:52:54.999684 1564 raft_consensus.cc:2804] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:54.999786 1564 raft_consensus.cc:493] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:54.998327 986 leader_election.cc:304] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:54.936215 746 tablet_service.cc:1511] Processing CreateTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 (DEFAULT_TABLE table=default.Table_0f637b1e87f94fe1a8603d336fcb9487 [id=5e159b01c9a04578a7a7e6fee6373325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.003957 780 raft_consensus.cc:1275] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:55.004477 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ef0e849f4d4eb299726b2b094a1dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:54.939544 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.944942 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.005203 779 raft_consensus.cc:1275] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:52:55.009887 1500 raft_consensus.cc:2804] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:55.021667 1166 ts_tablet_manager.cc:1434] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.384s user 0.006s sys 0.023s
I20260503 07:52:55.023718 1166 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:55.024003 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa7721278d14e71aeba005d2bd40ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.025374 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_799c81c9b8814c84917b60f5a486306b" } new_table_name: "default.Table_e73cb801493e4ec7a2c8914854e5d9f7" modify_external_catalogs: true
I20260503 07:52:55.026925 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 722411278ae148d5b3d082d95683d12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.028621 1457 raft_consensus.cc:493] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.028808 1457 raft_consensus.cc:515] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.029325 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ffded03505a4436c8598eb62fc41c377"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.029858 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffded03505a4436c8598eb62fc41c377 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:54.848065 744 tablet_service.cc:1511] Processing CreateTablet for tablet baa7721278d14e71aeba005d2bd40ecd (DEFAULT_TABLE table=default.Table_36cf7c4b44ca4d05946703a4cfa350f3 [id=4c5ebd90d9b6488089f4c3eff4f5a027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:54.985692 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.985883 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 722411278ae148d5b3d082d95683d12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.990074 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de65c754b47440a914f3f2bdb86059c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.990211 741 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:54.993551 1165 tablet_bootstrap.cc:654] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.047734 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3759511d942bfbc6e50ea2e2f2777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.048847 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac84e88ebe478fb6200bb5052a8f84" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:55.054371 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2683448c3f4df3bb0b14683d8b5222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.060940 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de65c754b47440a914f3f2bdb86059c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.064946 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57261ae6531348d7bdd8deb5dfd980b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.066176 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf72d49cfd24083abee07e0d2190e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.067241 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722411278ae148d5b3d082d95683d12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.074550 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f31f37e97345bb9187865e38ee1d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.074651 1564 raft_consensus.cc:3060] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.075067 1166 tablet_bootstrap.cc:654] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.076558 1500 raft_consensus.cc:697] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:55.076860 1500 consensus_queue.cc:237] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.077679 1619 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:55.081583 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 (DEFAULT_TABLE table=default.Table_0f637b1e87f94fe1a8603d336fcb9487 [id=5e159b01c9a04578a7a7e6fee6373325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.084463 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.085260 1620 raft_consensus.cc:493] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.085407 1620 raft_consensus.cc:515] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.086264 1620 leader_election.cc:290] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:55.087750 715 leader_election.cc:343] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.088250 1457 leader_election.cc:290] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:55.101173 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ceddd751644d20bcbda15a462d5342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.102947 1174 log.cc:1199] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/0b9ff03fba3d4a1794a8a5b94caa9731
W20260503 07:52:55.103459 851 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: a19065f28ee44933a0522bfa28696058
I20260503 07:52:55.106510 894 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.107815 1457 raft_consensus.cc:493] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.107875 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa7721278d14e71aeba005d2bd40ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.112082 1457 raft_consensus.cc:515] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.112444 1174 ts_tablet_manager.cc:1950] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:55.112758 1457 leader_election.cc:290] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:55.125741 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:55.128408 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00976f3444c43618af30259f0567d17" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:55.139230 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac8d392c3bb94f03819fae08fc009fbc consensus state has no leader
W20260503 07:52:55.140249 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet ac8d392c3bb94f03819fae08fc009fbc (table default.Table_f325744f54204131b4a076e2a2712261 [id=a95805f323654a5a9355c882cda4d708], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ac8d392c3bb94f03819fae08fc009fbc consensus state has no leader
I20260503 07:52:55.140581 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 2 got 0
I20260503 07:52:55.142277 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]). Expected version 3 got 2
I20260503 07:52:55.145745 593 master_service.cc:954] ReplaceTablet: received request to replace tablet feb88812c6b0459d86bd441926f57ecf from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.150082 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1c5b17831e3840c39a9fd9555ff84a2e" } modify_external_catalogs: true
I20260503 07:52:55.150403 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1c5b17831e3840c39a9fd9555ff84a2e" } modify_external_catalogs: true
I20260503 07:52:55.152457 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]) successfully deleted
W20260503 07:52:55.161787 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet aef746161e6b446ab0d299d37e2151ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aef746161e6b446ab0d299d37e2151ea already in progress: creating tablet
W20260503 07:52:55.162299 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d8b0329a61dd4476bc0a65e90404efb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b0329a61dd4476bc0a65e90404efb4 already in progress: creating tablet
W20260503 07:52:55.162907 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 54bf46b34b1043e2ab6c9f8b2c871227 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bf46b34b1043e2ab6c9f8b2c871227 already in progress: creating tablet
W20260503 07:52:55.163154 715 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:55.165560 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 4674c22562f744f5bce13d97ad8a52b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4674c22562f744f5bce13d97ad8a52b2 already in progress: creating tablet
W20260503 07:52:55.165802 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 773fca453dac452abc723e49b70111b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 773fca453dac452abc723e49b70111b9 already in progress: creating tablet
W20260503 07:52:55.166018 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3650ec1de28c4f1bafd979257dd2b778 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3650ec1de28c4f1bafd979257dd2b778 already in progress: creating tablet
W20260503 07:52:55.166523 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5ce16dd96cf04ae293601108381a2a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce16dd96cf04ae293601108381a2a47 already in progress: creating tablet
W20260503 07:52:55.166736 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 568ccdf187eb4cae9688ff4929f3e95e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ccdf187eb4cae9688ff4929f3e95e already in progress: creating tablet
W20260503 07:52:55.166970 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3cf72d49cfd24083abee07e0d2190e3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cf72d49cfd24083abee07e0d2190e3e already in progress: creating tablet
I20260503 07:52:55.167559 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_932de977bb484428abefdbabc42ac8ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.168157 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_932de977bb484428abefdbabc42ac8ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.170130 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_783704b9e4a140a79ff78cb95c84d553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.170357 1174 tablet_replica.cc:333] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:52:55.170698 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_783704b9e4a140a79ff78cb95c84d553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.171639 1174 raft_consensus.cc:2243] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.174165 1174 raft_consensus.cc:2272] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.182114 1174 ts_tablet_manager.cc:1916] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.183159 1165 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:55.183282 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bf0f650d2efd4a5d9308952b32fa7d63
I20260503 07:52:55.185478 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cef8f8c699d84b3bb95bf3ab889d29f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.186098 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cef8f8c699d84b3bb95bf3ab889d29f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:55.188328 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 855100ffa19d4fe7a92ae13ca5171adb has no consensus state
I20260503 07:52:55.188727 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_87c6f90a432448319533430626fb7662" } new_table_name: "default.Table_3b237288873a43c9a5f6c65306a1218f" modify_external_catalogs: true
I20260503 07:52:55.188733 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_dfc5adf554ea4cfba8121383b6e3e2ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.190606 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfc5adf554ea4cfba8121383b6e3e2ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.191267 752 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.194558 1165 ts_tablet_manager.cc:1403] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.267s user 0.018s sys 0.008s
I20260503 07:52:55.212667 882 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.215621 1171 raft_consensus.cc:359] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.215845 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 722411278ae148d5b3d082d95683d12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.215945 1171 raft_consensus.cc:385] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.216039 1171 raft_consensus.cc:740] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.216284 1171 consensus_queue.cc:260] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:55.216348 988 leader_election.cc:343] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:55.216495 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 86026.3us
I20260503 07:52:55.216743 1171 ts_tablet_manager.cc:1434] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.217s user 0.002s sys 0.000s
I20260503 07:52:55.217517 1171 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.217650 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.217828 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de65c754b47440a914f3f2bdb86059c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.218449 988 consensus_peers.cc:597] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:55.219084 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 722411278ae148d5b3d082d95683d12a because the tablet was not found. No further retry: Not found: Tablet not found: 722411278ae148d5b3d082d95683d12a
I20260503 07:52:55.219240 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.219357 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ea2683448c3f4df3bb0b14683d8b5222 because the tablet was not found. No further retry: Not found: Tablet not found: ea2683448c3f4df3bb0b14683d8b5222
W20260503 07:52:55.219573 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 4de65c754b47440a914f3f2bdb86059c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de65c754b47440a914f3f2bdb86059c already in progress: creating tablet
I20260503 07:52:55.219820 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.220605 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3cf72d49cfd24083abee07e0d2190e3e because the tablet was not found. No further retry: Not found: Tablet not found: 3cf72d49cfd24083abee07e0d2190e3e
W20260503 07:52:55.220887 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bf0f650d2efd4a5d9308952b32fa7d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0f650d2efd4a5d9308952b32fa7d63 already in progress: creating tablet
I20260503 07:52:55.223201 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ef0e849f4d4eb299726b2b094a1dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.225939 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f31f37e97345bb9187865e38ee1d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.228297 1619 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:55.229373 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa7721278d14e71aeba005d2bd40ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.224453 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00976f3444c43618af30259f0567d17" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:55.230779 716 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.230942 716 leader_election.cc:304] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:55.231220 716 raft_consensus.cc:2686] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:55.224231 1621 consensus_queue.cc:1048] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.189s
I20260503 07:52:55.237676 1564 raft_consensus.cc:515] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.243467 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722411278ae148d5b3d082d95683d12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.215655 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac84e88ebe478fb6200bb5052a8f84" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:55.250062 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.253387 1048 raft_consensus.cc:2468] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:55.254033 716 leader_election.cc:304] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.254632 1457 raft_consensus.cc:2804] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:55.254765 1457 raft_consensus.cc:493] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:55.254895 1457 raft_consensus.cc:3060] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.258076 1457 raft_consensus.cc:515] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.260226 1457 leader_election.cc:290] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:55.253293 1564 leader_election.cc:290] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.270224 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac84e88ebe478fb6200bb5052a8f84" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:55.270447 1048 raft_consensus.cc:3060] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.271801 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac84e88ebe478fb6200bb5052a8f84" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:55.272449 715 leader_election.cc:343] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.273159 1634 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:55.273379 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:55.275975 988 leader_election.cc:343] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.288808 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5deea77f36d540bb8f721657b7e3500e
I20260503 07:52:55.289317 595 catalog_manager.cc:6741] ReplaceTablet: tablet 5deea77f36d540bb8f721657b7e3500e deleted and replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6
I20260503 07:52:55.290508 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 2 got 1
I20260503 07:52:55.291391 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1aa14272946747ea8c83fed888ea0962" } modify_external_catalogs: true
I20260503 07:52:55.291553 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1aa14272946747ea8c83fed888ea0962" } modify_external_catalogs: true
I20260503 07:52:55.293511 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.295877 1173 ts_tablet_manager.cc:1929] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:55.296108 1173 log.cc:1199] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8b2b1956063b4f5e8bbef9f3d0eba359
I20260503 07:52:55.298672 1173 ts_tablet_manager.cc:1950] T 8b2b1956063b4f5e8bbef9f3d0eba359 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:55.299136 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 264) took 2329 ms. Trace:
I20260503 07:52:55.303829 1173 rpcz_store.cc:276] 0503 07:52:52.969282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.969787 (+ 505us) service_pool.cc:224] Handling call
0503 07:52:54.863858 (+1894071us) ts_tablet_manager.cc:1151] Deleting tablet 8b2b1956063b4f5e8bbef9f3d0eba359
0503 07:52:54.863866 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.242578 (+378712us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.295701 (+ 53123us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.299098 (+ 3397us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1893252}
I20260503 07:52:55.304771 1173 tablet_replica.cc:333] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:55.305140 1173 raft_consensus.cc:2243] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.305471 1173 raft_consensus.cc:2272] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.306208 1173 ts_tablet_manager.cc:1916] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.306363 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.311833 1166 tablet_bootstrap.cc:492] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:55.312055 1166 ts_tablet_manager.cc:1403] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.290s user 0.005s sys 0.006s
W20260503 07:52:55.315569 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56749914e1a349f0876f52157affdf69 consensus state has no leader
I20260503 07:52:55.318702 1165 raft_consensus.cc:359] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.320691 1165 raft_consensus.cc:385] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.320791 1165 raft_consensus.cc:740] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.321080 1165 consensus_queue.cc:260] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.321506 1165 ts_tablet_manager.cc:1434] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.127s user 0.002s sys 0.000s
I20260503 07:52:55.321857 1165 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:55.325850 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2be28ad252ff47879caa1021fdf5db66 consensus state has no leader
I20260503 07:52:55.326234 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3f0440daf4a4fe89f92e6c20afef7e5" } modify_external_catalogs: true
I20260503 07:52:55.326449 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3f0440daf4a4fe89f92e6c20afef7e5" } modify_external_catalogs: true
I20260503 07:52:55.339165 1171 tablet_bootstrap.cc:654] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:55.339497 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 232470us
W20260503 07:52:55.340363 854 leader_election.cc:343] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:55.340517 854 leader_election.cc:304] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:55.340996 854 leader_election.cc:343] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:55.341102 854 leader_election.cc:304] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:55.341439 854 leader_election.cc:343] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 7ce867777c0e46d1af4785e667e7a18e
I20260503 07:52:55.341531 854 leader_election.cc:304] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:55.340082 1591 consensus_queue.cc:1048] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260503 07:52:55.308751 1645 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:55.344293 1622 raft_consensus.cc:2749] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.344530 1622 raft_consensus.cc:2749] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.344692 1622 raft_consensus.cc:2749] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.348482 1619 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:55.357618 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:55.358165 779 raft_consensus.cc:2468] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:55.359928 1165 tablet_bootstrap.cc:654] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:55.360770 854 leader_election.cc:343] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:55.361179 854 leader_election.cc:304] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:55.361662 1584 raft_consensus.cc:2749] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:55.361941 854 leader_election.cc:343] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: a19065f28ee44933a0522bfa28696058
I20260503 07:52:55.362193 854 leader_election.cc:304] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:55.362574 1584 raft_consensus.cc:2749] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.366880 1174 ts_tablet_manager.cc:1929] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:55.367240 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.368402 1174 log.cc:1199] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c00976f3444c43618af30259f0567d17
W20260503 07:52:55.369107 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5deea77f36d540bb8f721657b7e3500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5deea77f36d540bb8f721657b7e3500e already in progress: creating tablet
I20260503 07:52:55.370803 1048 raft_consensus.cc:2468] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:55.373963 716 leader_election.cc:304] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.373931 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f7b07d945c4726a77578987c22415d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:55.374622 986 leader_election.cc:304] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.375460 1636 raft_consensus.cc:2804] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:55.375571 1636 raft_consensus.cc:493] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:55.375931 1636 raft_consensus.cc:3060] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.376252 1591 consensus_queue.cc:1048] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:52:55.376996 781 raft_consensus.cc:3060] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.379906 1636 raft_consensus.cc:515] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.380838 1636 leader_election.cc:290] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.381697 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:55.382445 988 leader_election.cc:343] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.387811 1166 raft_consensus.cc:359] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.388770 1166 raft_consensus.cc:385] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.389187 1166 raft_consensus.cc:740] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.399202 1645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 345) took 1100 ms. Trace:
I20260503 07:52:55.399415 1645 rpcz_store.cc:276] 0503 07:52:54.298501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.298653 (+ 152us) service_pool.cc:224] Handling call
0503 07:52:55.399110 (+1100457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:54.525977 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:52:54.526103 (+ 126us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:52:54.526111 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0503 07:52:54.526117 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:52:54.526165 (+ 48us) alter_schema_op.cc:128] START. Timestamp: 1777794774526139
0503 07:52:54.526168 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:52:54.527210 (+ 1042us) log.cc:844] Serialized 173 byte log entry
0503 07:52:55.027091 (+499881us) op_driver.cc:464] REPLICATION: finished
0503 07:52:55.276996 (+249905us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:52:55.344605 (+ 67609us) log.cc:844] Serialized 5 byte log entry
0503 07:52:55.398765 (+ 54160us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.399031 (+ 266us) log.cc:844] Serialized 14 byte log entry
0503 07:52:55.399072 (+ 41us) alter_schema_op.cc:73] Released schema lock
0503 07:52:55.399076 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":237604,"mutex_wait_us":1948,"prepare.queue_time_us":227025,"prepare.run_cpu_time_us":33659,"prepare.run_wall_time_us":474080,"raft.queue_time_us":1136,"raft.run_cpu_time_us":18582,"raft.run_wall_time_us":321505,"replication_time_us":500899,"thread_start_us":976536,"threads_started":3,"wal-append.queue_time_us":490263}]]}
I20260503 07:52:55.408691 1457 raft_consensus.cc:2804] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:55.409384 1166 consensus_queue.cc:260] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.410359 1166 ts_tablet_manager.cc:1434] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.098s user 0.001s sys 0.001s
I20260503 07:52:55.410778 1166 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:55.417230 1174 ts_tablet_manager.cc:1950] T c00976f3444c43618af30259f0567d17 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:55.425807 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]). Expected version 3 got 0
I20260503 07:52:55.427709 594 catalog_manager.cc:5671] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:55.429687 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:52:55.429988 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]). Expected version 2 got 1
I20260503 07:52:55.433620 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c00976f3444c43618af30259f0567d17 (table default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]) successfully deleted
I20260503 07:52:55.434666 1174 tablet_replica.cc:333] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:55.434957 1174 raft_consensus.cc:2243] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.435215 1174 raft_consensus.cc:2272] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.435833 1174 ts_tablet_manager.cc:1916] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.432207 1171 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:55.437438 1171 ts_tablet_manager.cc:1403] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.220s user 0.007s sys 0.005s
I20260503 07:52:55.438376 1171 raft_consensus.cc:359] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.438588 1171 raft_consensus.cc:385] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.438673 1171 raft_consensus.cc:740] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.438941 1171 consensus_queue.cc:260] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.439502 1171 ts_tablet_manager.cc:1434] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:55.441506 781 raft_consensus.cc:2468] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:55.434500 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0ad3ee6d1445b28ffc55ba93d57901" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:55.441964 775 raft_consensus.cc:3060] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.444943 775 raft_consensus.cc:2468] T ef0ad3ee6d1445b28ffc55ba93d57901 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:55.448457 986 leader_election.cc:304] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.448752 1500 raft_consensus.cc:2804] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:55.448894 1500 raft_consensus.cc:697] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:55.449120 986 leader_election.cc:304] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.449173 1500 consensus_queue.cc:237] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.449555 1591 raft_consensus.cc:2804] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:55.449743 1591 raft_consensus.cc:697] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:55.449981 1591 consensus_queue.cc:237] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.450492 1171 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.455883 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 62ac84e88ebe478fb6200bb5052a8f84
I20260503 07:52:55.456718 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.456696 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_014c7be2e3314cbd9bd3ca3d74c74621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.457254 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_014c7be2e3314cbd9bd3ca3d74c74621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.459892 1175 tablet_replica.cc:333] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:55.460094 1175 raft_consensus.cc:2243] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.460561 1175 raft_consensus.cc:2272] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.461123 1175 ts_tablet_manager.cc:1916] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.470034 1175 ts_tablet_manager.cc:1929] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:55.470253 1175 log.cc:1199] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/62ac84e88ebe478fb6200bb5052a8f84
I20260503 07:52:55.470695 1175 ts_tablet_manager.cc:1950] T 62ac84e88ebe478fb6200bb5052a8f84 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:55.471231 1165 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:55.471393 1165 ts_tablet_manager.cc:1403] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.150s user 0.007s sys 0.002s
I20260503 07:52:55.472038 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]) successfully deleted
I20260503 07:52:55.496263 1171 tablet_bootstrap.cc:654] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.500124 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5927563641d44bc28addfeb760ee7280" } modify_external_catalogs: true
I20260503 07:52:55.500219 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_de043fa894ce46f18865ea92043ad965"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.500365 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5927563641d44bc28addfeb760ee7280" } modify_external_catalogs: true
W20260503 07:52:55.500813 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de043fa894ce46f18865ea92043ad965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.503732 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.504084 1657 tablet.cc:1724] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:55.503160 1165 raft_consensus.cc:359] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.506428 1165 raft_consensus.cc:385] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.510171 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac84e88ebe478fb6200bb5052a8f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.517982 1636 raft_consensus.cc:493] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.518160 1636 raft_consensus.cc:515] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.518795 1636 leader_election.cc:290] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.520113 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0481b55721854d70a670a79ff2f42dd6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:55.520753 988 leader_election.cc:343] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:55.533795 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.62:44841, user_credentials={real_user=slave}} blocked reactor thread for 49344.9us
I20260503 07:52:55.539525 1645 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:55.547806 1645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 342) took 1281 ms. Trace:
I20260503 07:52:55.548074 1645 rpcz_store.cc:276] 0503 07:52:54.265954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.271359 (+ 5405us) service_pool.cc:224] Handling call
0503 07:52:55.547740 (+1276381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:54.292098 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:52:54.292225 (+ 127us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:52:54.292234 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0503 07:52:54.292241 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:52:54.292283 (+ 42us) alter_schema_op.cc:128] START. Timestamp: 1777794774292226
0503 07:52:54.292286 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:52:54.292861 (+ 575us) log.cc:844] Serialized 173 byte log entry
0503 07:52:54.494752 (+201891us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x60f000019388. stack: 00007fe1a7f78086 00007fe1a7f77e40 00007fe1a6f313ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fe1b0f6b704 00007fe1b0f6ac21 00007fe1b0f6aa2a 00007fe1b3efb8a8 00007fe1b3efbe4c 00007fe1b3dc6cff 00007fe1b3d93c3b 00007fe1b3d9ebd1 00007fe1b3d9e8bd 0000000000aa4cac
0503 07:52:55.531767 (+1037015us) op_driver.cc:464] REPLICATION: finished
0503 07:52:55.539479 (+ 7712us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:52:55.540146 (+ 667us) log.cc:844] Serialized 5 byte log entry
0503 07:52:55.543453 (+ 3307us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.547443 (+ 3990us) log.cc:844] Serialized 14 byte log entry
0503 07:52:55.547690 (+ 247us) alter_schema_op.cc:73] Released schema lock
0503 07:52:55.547698 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7636,"mutex_wait_us":225981,"prepare.queue_time_us":20350,"prepare.run_cpu_time_us":915,"prepare.run_wall_time_us":109340,"raft.queue_time_us":497,"raft.run_cpu_time_us":1067,"raft.run_wall_time_us":153786,"replication_time_us":1239445,"spinlock_wait_cycles":3721984,"thread_start_us":473464,"threads_started":1}]]}
I20260503 07:52:55.550805 1165 raft_consensus.cc:740] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:52:55.553692 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc130dcd067f43f08748360a692eb048 consensus state has no leader
I20260503 07:52:55.553977 601 master_service.cc:954] ReplaceTablet: received request to replace tablet d3fda3bba9234622b2c391a31c55dc3a from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.555279 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 92c1709a2a49475daaa2372360610b1e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.556396 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f54aaadc3d22437286303caac65c7cb4
I20260503 07:52:55.556974 595 master_service.cc:954] ReplaceTablet: received request to replace tablet feb88812c6b0459d86bd441926f57ecf from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.558177 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.558908 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f54aaadc3d22437286303caac65c7cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54aaadc3d22437286303caac65c7cb4 already in progress: creating tablet
I20260503 07:52:55.559265 885 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.560233 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6] alter complete (version 2)
I20260503 07:52:55.561555 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fb821b329d284643a889b07f9a4f287e
I20260503 07:52:55.564603 1166 tablet_bootstrap.cc:654] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.568397 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_69265862c32c4f5b872353b7e124f649"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.568964 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69265862c32c4f5b872353b7e124f649 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.570856 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_51087a0beaaa4072b4342bcee0bd985f" } new_table_name: "default.Table_b95b4ad8129048a49f4d0991dc8b50be" modify_external_catalogs: true
I20260503 07:52:55.572192 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_663547df39b940328f0864f79b3f481d" } modify_external_catalogs: true
I20260503 07:52:55.572275 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_081556a5987448feab60316c1b536d0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.572363 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_663547df39b940328f0864f79b3f481d" } modify_external_catalogs: true
W20260503 07:52:55.572773 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_081556a5987448feab60316c1b536d0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.573094 1647 raft_consensus.cc:493] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.573239 1647 raft_consensus.cc:515] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.574075 1647 leader_election.cc:290] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:55.574908 854 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:55.575196 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.575305 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ef63c1684f794aa696a7cb6077e06031" } new_table_name: "default.Table_ea3cc36f50214961844fbc9f28877922" modify_external_catalogs: true
W20260503 07:52:55.575855 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fb821b329d284643a889b07f9a4f287e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb821b329d284643a889b07f9a4f287e already in progress: creating tablet
I20260503 07:52:55.576572 885 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.579068 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3c54a91d67d2444a902e026221ecd8f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.579527 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c54a91d67d2444a902e026221ecd8f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:55.588260 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 consensus state has no leader
I20260503 07:52:55.588866 593 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 87d46e909edd463c962aa3bc28eeb600
W20260503 07:52:55.589907 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cac435b09639484ca1ae82f3d4990d48 consensus state has no leader
I20260503 07:52:55.592268 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]). Expected version 3 got 0
I20260503 07:52:55.592543 885 tablet_service.cc:1511] Processing CreateTablet for tablet d08b5135cb77444bb5ff35c5f9d68129 (DEFAULT_TABLE table=default.Table_579d94072b504815930a2235c75efb86 [id=fb0d1da177a747329c3e8ad69aaf88d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.592623 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_f397484bea66470d840ab901d70b6e51 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 2 got 0
I20260503 07:52:55.592981 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b5135cb77444bb5ff35c5f9d68129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.595722 595 catalog_manager.cc:5671] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:55.596611 595 catalog_manager.cc:5671] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:55.598542 1165 consensus_queue.cc:260] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.599085 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.599328 744 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.599753 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0481b55721854d70a670a79ff2f42dd6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:55.599865 1016 tablet_service.cc:1511] Processing CreateTablet for tablet d08b5135cb77444bb5ff35c5f9d68129 (DEFAULT_TABLE table=default.Table_579d94072b504815930a2235c75efb86 [id=fb0d1da177a747329c3e8ad69aaf88d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.600315 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b5135cb77444bb5ff35c5f9d68129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.601742 1165 ts_tablet_manager.cc:1434] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.129s user 0.000s sys 0.003s
I20260503 07:52:55.602027 1165 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:55.604225 1165 tablet_bootstrap.cc:654] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:55.605863 851 leader_election.cc:343] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:55.606004 851 leader_election.cc:304] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:55.606419 1647 raft_consensus.cc:2749] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.607081 779 raft_consensus.cc:2468] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:55.610205 883 tablet_service.cc:1511] Processing CreateTablet for tablet c11304c2f96f4518bedc07c23af81f50 (DEFAULT_TABLE table=default.Table_0b72eae732be40028547d86f3928b0e8 [id=38a1a5ca47cf4c8caef06bdf33eb4e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.611416 986 leader_election.cc:304] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.611891 1500 raft_consensus.cc:2804] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:55.612011 1500 raft_consensus.cc:493] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:55.612099 1500 raft_consensus.cc:3060] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.612036 1016 tablet_service.cc:1511] Processing CreateTablet for tablet c11304c2f96f4518bedc07c23af81f50 (DEFAULT_TABLE table=default.Table_0b72eae732be40028547d86f3928b0e8 [id=38a1a5ca47cf4c8caef06bdf33eb4e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.612439 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11304c2f96f4518bedc07c23af81f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.615350 1500 raft_consensus.cc:515] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.616349 1500 leader_election.cc:290] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.617197 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0481b55721854d70a670a79ff2f42dd6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:55.617661 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11304c2f96f4518bedc07c23af81f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.618598 885 tablet_service.cc:1511] Processing CreateTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 (DEFAULT_TABLE table=default.Table_8853624ee831417c9dbc9a87aef34f3e [id=8f3067e1e91a4b9d8eb9bf78222fe322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.620200 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd71a81efd3b40c6b96bb77f74e8a4c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:55.620707 988 leader_election.cc:343] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.621117 1014 tablet_service.cc:1511] Processing CreateTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 (DEFAULT_TABLE table=default.Table_8853624ee831417c9dbc9a87aef34f3e [id=8f3067e1e91a4b9d8eb9bf78222fe322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.621513 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd71a81efd3b40c6b96bb77f74e8a4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.624001 1171 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:55.623708 1173 ts_tablet_manager.cc:1929] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:55.624145 1171 ts_tablet_manager.cc:1403] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.174s user 0.003s sys 0.009s
I20260503 07:52:55.624673 895 tablet_service.cc:1511] Processing CreateTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.624557 1173 log.cc:1199] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b3168a0cf68f4838b82266d53ad00419
I20260503 07:52:55.625058 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855100ffa19d4fe7a92ae13ca5171adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.625077 1171 raft_consensus.cc:359] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.625270 1171 raft_consensus.cc:385] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.625360 1171 raft_consensus.cc:740] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.627220 886 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb33e9818334d4a8ea4e648c3dd7cac (DEFAULT_TABLE table=default.Table_ce77bf363e044ba3b130aa84bcdb5694 [id=d721c0ffbb424966b48963c677b7b2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.627559 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb33e9818334d4a8ea4e648c3dd7cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.627990 1173 ts_tablet_manager.cc:1950] T b3168a0cf68f4838b82266d53ad00419 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:55.629796 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.630137 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855100ffa19d4fe7a92ae13ca5171adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.632474 744 tablet_service.cc:1511] Processing CreateTablet for tablet d08b5135cb77444bb5ff35c5f9d68129 (DEFAULT_TABLE table=default.Table_579d94072b504815930a2235c75efb86 [id=fb0d1da177a747329c3e8ad69aaf88d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.632897 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b5135cb77444bb5ff35c5f9d68129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.634905 592 master_service.cc:954] ReplaceTablet: received request to replace tablet db13f91ef1d740c387bacbb689ddf1a8 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.644860 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb33e9818334d4a8ea4e648c3dd7cac (DEFAULT_TABLE table=default.Table_ce77bf363e044ba3b130aa84bcdb5694 [id=d721c0ffbb424966b48963c677b7b2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.645299 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb33e9818334d4a8ea4e648c3dd7cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.650005 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 265) took 2661 ms. Trace:
I20260503 07:52:55.650168 1173 rpcz_store.cc:276] 0503 07:52:52.969443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:52.970063 (+ 620us) service_pool.cc:224] Handling call
0503 07:52:55.304690 (+2334627us) ts_tablet_manager.cc:1151] Deleting tablet b3168a0cf68f4838b82266d53ad00419
0503 07:52:55.304702 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.407884 (+103182us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.623170 (+215286us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.631088 (+ 7918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2326180}
I20260503 07:52:55.650588 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b3168a0cf68f4838b82266d53ad00419 (table default.Table_6f2f843012924df9806f9ee50e38a5ac [id=52b6dfd50c6542c4b57a9be5612b8ddd]) successfully deleted
I20260503 07:52:55.650880 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 282) took 2471 ms. Trace:
I20260503 07:52:55.651007 1173 rpcz_store.cc:276] 0503 07:52:53.179666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.183700 (+ 4034us) service_pool.cc:224] Handling call
0503 07:52:55.650614 (+2466914us) ts_tablet_manager.cc:1151] Deleting tablet cda8280b97254d1aaf3803f6b5cd223c
0503 07:52:55.650625 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.650752 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2459265}
W20260503 07:52:55.651389 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cda8280b97254d1aaf3803f6b5cd223c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cda8280b97254d1aaf3803f6b5cd223c already in progress: creating tablet
I20260503 07:52:55.652568 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 284) took 2421 ms. Trace:
I20260503 07:52:55.652657 1173 rpcz_store.cc:276] 0503 07:52:53.230686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.230952 (+ 266us) service_pool.cc:224] Handling call
0503 07:52:55.651388 (+2420436us) ts_tablet_manager.cc:1151] Deleting tablet b5bdaa3dd3a844d8b57def2b9faa03d8
0503 07:52:55.651397 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.651880 (+ 483us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2413925}
W20260503 07:52:55.653082 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bdaa3dd3a844d8b57def2b9faa03d8 already in progress: creating tablet
I20260503 07:52:55.656699 1171 consensus_queue.cc:260] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.660579 1174 ts_tablet_manager.cc:1929] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:55.660670 1171 ts_tablet_manager.cc:1434] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260503 07:52:55.662868 1171 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.664465 745 tablet_service.cc:1511] Processing CreateTablet for tablet c11304c2f96f4518bedc07c23af81f50 (DEFAULT_TABLE table=default.Table_0b72eae732be40028547d86f3928b0e8 [id=38a1a5ca47cf4c8caef06bdf33eb4e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.666833 1173 tablet_replica.cc:333] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:55.668725 1173 raft_consensus.cc:2243] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.668929 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0481b55721854d70a670a79ff2f42dd6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:55.669359 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11304c2f96f4518bedc07c23af81f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.669466 1173 raft_consensus.cc:2272] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.671033 752 tablet_service.cc:1511] Processing CreateTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 (DEFAULT_TABLE table=default.Table_8853624ee831417c9dbc9a87aef34f3e [id=8f3067e1e91a4b9d8eb9bf78222fe322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.671417 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd71a81efd3b40c6b96bb77f74e8a4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.672209 1173 ts_tablet_manager.cc:1916] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.672327 746 tablet_service.cc:1511] Processing CreateTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.672680 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855100ffa19d4fe7a92ae13ca5171adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.674625 1166 tablet_bootstrap.cc:492] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:55.675443 1171 tablet_bootstrap.cc:654] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.675614 742 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb33e9818334d4a8ea4e648c3dd7cac (DEFAULT_TABLE table=default.Table_ce77bf363e044ba3b130aa84bcdb5694 [id=d721c0ffbb424966b48963c677b7b2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.675949 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb33e9818334d4a8ea4e648c3dd7cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.676625 1166 ts_tablet_manager.cc:1403] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.264s user 0.000s sys 0.012s
I20260503 07:52:55.677697 1166 raft_consensus.cc:359] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.681097 1166 raft_consensus.cc:385] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.681221 1166 raft_consensus.cc:740] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.682102 1166 consensus_queue.cc:260] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.683218 1166 ts_tablet_manager.cc:1434] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260503 07:52:55.684712 1166 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:55.692740 779 raft_consensus.cc:3060] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:55.694204 1166 tablet_bootstrap.cc:654] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.694694 1174 log.cc:1199] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1498486dd3db414c8062cba2d54037bb
I20260503 07:52:55.696587 1657 tablet.cc:1724] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:55.714745 1166 tablet_bootstrap.cc:492] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:55.714913 1166 ts_tablet_manager.cc:1403] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260503 07:52:55.715734 1166 raft_consensus.cc:359] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.715916 1166 raft_consensus.cc:385] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.716022 1166 raft_consensus.cc:740] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.716074 1174 ts_tablet_manager.cc:1950] T 1498486dd3db414c8062cba2d54037bb P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:55.716271 1166 consensus_queue.cc:260] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.716807 1166 ts_tablet_manager.cc:1434] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:55.717125 1166 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:55.717676 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1498486dd3db414c8062cba2d54037bb (table default.Table_880c06e846564e03a359ab40393e5fe2 [id=45fb2a411f3f45c4867a240018396066]) successfully deleted
I20260503 07:52:55.718835 1166 tablet_bootstrap.cc:654] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:55.720861 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 722411278ae148d5b3d082d95683d12a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 722411278ae148d5b3d082d95683d12a already in progress: creating tablet
W20260503 07:52:55.721550 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 4de65c754b47440a914f3f2bdb86059c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de65c754b47440a914f3f2bdb86059c already in progress: creating tablet
W20260503 07:52:55.722180 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ea2683448c3f4df3bb0b14683d8b5222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2683448c3f4df3bb0b14683d8b5222 already in progress: creating tablet
W20260503 07:52:55.723369 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bf0f650d2efd4a5d9308952b32fa7d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0f650d2efd4a5d9308952b32fa7d63 already in progress: creating tablet
W20260503 07:52:55.723977 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5deea77f36d540bb8f721657b7e3500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5deea77f36d540bb8f721657b7e3500e already in progress: creating tablet
I20260503 07:52:55.728009 1173 ts_tablet_manager.cc:1929] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:55.728899 1173 log.cc:1199] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/15714a97dd7749bb8e2ca20f795c760a
I20260503 07:52:55.732344 1173 ts_tablet_manager.cc:1950] T 15714a97dd7749bb8e2ca20f795c760a P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:55.734529 779 raft_consensus.cc:2468] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:55.735193 986 leader_election.cc:304] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.735914 1500 raft_consensus.cc:2804] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:55.736085 1500 raft_consensus.cc:697] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:55.736490 1500 consensus_queue.cc:237] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.738209 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 283) took 2510 ms. Trace:
I20260503 07:52:55.740387 1174 tablet_replica.cc:333] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:55.739142 1173 rpcz_store.cc:276] 0503 07:52:53.227934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.228144 (+ 210us) service_pool.cc:224] Handling call
0503 07:52:55.666506 (+2438362us) ts_tablet_manager.cc:1151] Deleting tablet 15714a97dd7749bb8e2ca20f795c760a
0503 07:52:55.666546 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.705075 (+ 38529us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.727466 (+ 22391us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:55.737950 (+ 10484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2417353}
I20260503 07:52:55.740847 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 15714a97dd7749bb8e2ca20f795c760a (table default.Table_1dd726d9860044f19095052ccdc18252 [id=0430785b327e401aa28af2b2a66e4163]) successfully deleted
I20260503 07:52:55.742482 1457 raft_consensus.cc:697] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:55.742556 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 285) took 2506 ms. Trace:
I20260503 07:52:55.743409 1457 consensus_queue.cc:237] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.743290 1173 rpcz_store.cc:276] 0503 07:52:53.235631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.237135 (+ 1504us) service_pool.cc:224] Handling call
0503 07:52:55.741282 (+2504147us) ts_tablet_manager.cc:1151] Deleting tablet d79067c0c8594d50aa458d47b31d99af
0503 07:52:55.741296 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.742294 (+ 998us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485899}
W20260503 07:52:55.745018 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d79067c0c8594d50aa458d47b31d99af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d79067c0c8594d50aa458d47b31d99af already in progress: creating tablet
I20260503 07:52:55.746378 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 289) took 2298 ms. Trace:
I20260503 07:52:55.747071 1173 rpcz_store.cc:276] 0503 07:52:53.447495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.447549 (+ 54us) service_pool.cc:224] Handling call
0503 07:52:55.745551 (+2298002us) ts_tablet_manager.cc:1151] Deleting tablet 67387c8aba1f4d728b3691c5da720e4d
0503 07:52:55.745565 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.746243 (+ 678us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297398}
W20260503 07:52:55.748267 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 67387c8aba1f4d728b3691c5da720e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67387c8aba1f4d728b3691c5da720e4d already in progress: creating tablet
I20260503 07:52:55.750365 1657 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:55.759769 1645 tablet.cc:1719] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:52:55.760583 1645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 343) took 1474 ms. Trace:
I20260503 07:52:55.760609 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f325744f54204131b4a076e2a2712261" } modify_external_catalogs: true
I20260503 07:52:55.760802 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f325744f54204131b4a076e2a2712261" } modify_external_catalogs: true
I20260503 07:52:55.760967 1657 tablet.cc:1719] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:52:55.760733 1645 rpcz_store.cc:276] 0503 07:52:54.285984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.286045 (+ 61us) service_pool.cc:224] Handling call
0503 07:52:55.760549 (+1474504us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:54.713298 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:52:54.720816 (+ 7518us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:52:55.549512 (+828696us) alter_schema_op.cc:66] Acquired schema lock
0503 07:52:55.549522 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:52:55.549571 (+ 49us) alter_schema_op.cc:128] START. Timestamp: 1777794775549543
0503 07:52:55.549574 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:52:55.549810 (+ 236us) log.cc:844] Serialized 173 byte log entry
0503 07:52:55.759557 (+209747us) op_driver.cc:464] REPLICATION: finished
0503 07:52:55.759694 (+ 137us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:52:55.760471 (+ 777us) log.cc:844] Serialized 94 byte log entry
0503 07:52:55.760511 (+ 40us) alter_schema_op.cc:73] Released schema lock
0503 07:52:55.760516 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":39,"prepare.queue_time_us":422525,"prepare.run_cpu_time_us":45019,"prepare.run_wall_time_us":836622,"raft.queue_time_us":381,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":9,"replication_time_us":209946}]]}
I20260503 07:52:55.749890 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 288) took 2302 ms. Trace:
I20260503 07:52:55.762351 1173 rpcz_store.cc:276] 0503 07:52:53.447340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.447870 (+ 530us) service_pool.cc:224] Handling call
0503 07:52:55.748812 (+2300942us) ts_tablet_manager.cc:1151] Deleting tablet a117f416c611418a96963db600da1d04
0503 07:52:55.748943 (+ 131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.749633 (+ 690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2300554}
I20260503 07:52:55.763885 1165 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:55.763854 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 291) took 2292 ms. Trace:
I20260503 07:52:55.764250 1165 ts_tablet_manager.cc:1403] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.162s user 0.005s sys 0.004s
I20260503 07:52:55.764271 1173 rpcz_store.cc:276] 0503 07:52:53.471541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.471838 (+ 297us) service_pool.cc:224] Handling call
0503 07:52:55.763288 (+2291450us) ts_tablet_manager.cc:1151] Deleting tablet 5a178957514e4f77afe8a1879b57a96b
0503 07:52:55.763385 (+ 97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.763654 (+ 269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2285600}
I20260503 07:52:55.766747 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_560c3883f23a4519a1bd97a75c34eb29" } new_table_name: "default.Table_82a4b1a149d1448588fbc0ce1e44754d" modify_external_catalogs: true
I20260503 07:52:55.767807 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 290) took 2302 ms. Trace:
W20260503 07:52:55.768512 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a117f416c611418a96963db600da1d04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a117f416c611418a96963db600da1d04 already in progress: creating tablet
W20260503 07:52:55.768761 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5a178957514e4f77afe8a1879b57a96b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a178957514e4f77afe8a1879b57a96b already in progress: creating tablet
I20260503 07:52:55.769366 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5b457831e14149a9ab86fc749ae60c29" } new_table_name: "default.Table_c67ae44b27fa46c4b568beb02732c1eb" modify_external_catalogs: true
I20260503 07:52:55.769174 1173 rpcz_store.cc:276] 0503 07:52:53.465090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.465418 (+ 328us) service_pool.cc:224] Handling call
0503 07:52:55.765336 (+2299918us) ts_tablet_manager.cc:1151] Deleting tablet 0e5f99c7855a4485b3523b68b0ea24c1
0503 07:52:55.766659 (+ 1323us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.766963 (+ 304us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2287518}
I20260503 07:52:55.770886 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 292) took 2245 ms. Trace:
I20260503 07:52:55.771317 1647 raft_consensus.cc:493] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:55.771647 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0e5f99c7855a4485b3523b68b0ea24c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e5f99c7855a4485b3523b68b0ea24c1 already in progress: creating tablet
I20260503 07:52:55.771525 1647 raft_consensus.cc:515] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.772281 1647 leader_election.cc:290] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.772979 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:55.771443 1173 rpcz_store.cc:276] 0503 07:52:53.525417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.530514 (+ 5097us) service_pool.cc:224] Handling call
0503 07:52:55.770333 (+2239819us) ts_tablet_manager.cc:1151] Deleting tablet 9c19ad357f7845fc8389cb5b923bc253
0503 07:52:55.770345 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:55.770752 (+ 407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2239267}
I20260503 07:52:55.773626 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.774297 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.774272 1173 tablet_replica.cc:333] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:55.774350 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4116cc31d640ac826520b41d7d3cf9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:55.775092 851 leader_election.cc:304] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:55.775427 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9c19ad357f7845fc8389cb5b923bc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c19ad357f7845fc8389cb5b923bc253 already in progress: creating tablet
I20260503 07:52:55.775518 1647 raft_consensus.cc:2749] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.779556 601 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334] alter complete (version 3)
I20260503 07:52:55.780233 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 3650ec1de28c4f1bafd979257dd2b778 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:55.780763 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d6c79b1104334de0b8cdd97f0a8f79ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.781262 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6c79b1104334de0b8cdd97f0a8f79ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.785012 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a45012e871b4c14a3fafb4443e1e92b with delete_type TABLET_DATA_DELETED (replaced by tablet fb821b329d284643a889b07f9a4f287e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.786139 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0b881a8a82a24c63acfd121516db44b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.786619 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b881a8a82a24c63acfd121516db44b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.792771 1174 raft_consensus.cc:2243] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:55.794639 1174 pending_rounds.cc:70] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:55.794711 1174 pending_rounds.cc:77] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847401453268992 op_type: NO_OP noop_request { }
I20260503 07:52:55.794826 1174 raft_consensus.cc:2889] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:55.794920 1174 raft_consensus.cc:2272] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.805080 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 92c1709a2a49475daaa2372360610b1e
I20260503 07:52:55.805547 596 catalog_manager.cc:6741] ReplaceTablet: tablet 92c1709a2a49475daaa2372360610b1e deleted and replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7
I20260503 07:52:55.805812 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8ffec630db9a430fa3006268b0e28fcd
I20260503 07:52:55.806290 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ac8d392c3bb94f03819fae08fc009fbc
I20260503 07:52:55.807585 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.807863 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.807888 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.808048 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.808102 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.808967 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 92c1709a2a49475daaa2372360610b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92c1709a2a49475daaa2372360610b1e already in progress: creating tablet
W20260503 07:52:55.809252 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8ffec630db9a430fa3006268b0e28fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffec630db9a430fa3006268b0e28fcd already in progress: creating tablet
I20260503 07:52:55.812743 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.813390 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ac8d392c3bb94f03819fae08fc009fbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac8d392c3bb94f03819fae08fc009fbc already in progress: creating tablet
I20260503 07:52:55.813485 1457 raft_consensus.cc:493] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.813628 1457 raft_consensus.cc:515] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:55.814112 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1c631d3da8f4ec29690c548097a454b consensus state has no leader
I20260503 07:52:55.814551 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b8ad59be3a314aa6add6938852b18b80" } new_table_name: "default.Table_6c6fb8982f384ff7ac013f3de178378a" modify_external_catalogs: true
I20260503 07:52:55.814682 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:55.815008 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:55.815207 716 leader_election.cc:343] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.815567 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet db13f91ef1d740c387bacbb689ddf1a8
W20260503 07:52:55.815586 715 leader_election.cc:343] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.815716 715 leader_election.cc:304] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:55.816043 1457 leader_election.cc:290] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:55.816078 592 catalog_manager.cc:6741] ReplaceTablet: tablet db13f91ef1d740c387bacbb689ddf1a8 deleted and replaced by tablet a7907a9cceaa443795275c9cbb62cb22
I20260503 07:52:55.816310 1661 raft_consensus.cc:2749] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.816392 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 0
I20260503 07:52:55.816584 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]). Expected version 1 got 0
I20260503 07:52:55.816608 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7b478d31097a4d9eb5bc3f46d259bbe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.817124 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b478d31097a4d9eb5bc3f46d259bbe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.817139 885 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.819190 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e7e6b24cd38d4dc7b542d2aa05a2523b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.819751 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7e6b24cd38d4dc7b542d2aa05a2523b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:55.820221 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5f31f37e97345bb9187865e38ee1d61 consensus state has no leader
I20260503 07:52:55.820523 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2b316333c1ba4f2fb97307e35ceff30b" } modify_external_catalogs: true
I20260503 07:52:55.820698 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2b316333c1ba4f2fb97307e35ceff30b" } modify_external_catalogs: true
I20260503 07:52:55.820953 1165 raft_consensus.cc:359] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.821242 1165 raft_consensus.cc:385] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.821364 1165 raft_consensus.cc:740] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.821677 1165 consensus_queue.cc:260] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.822216 1165 ts_tablet_manager.cc:1434] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260503 07:52:55.822223 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647]). Expected version 4 got 0
I20260503 07:52:55.822566 1165 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:55.823369 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c0ff43b4c5294513804c22176ddd5f82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.823740 1657 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:52:55.823936 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0ff43b4c5294513804c22176ddd5f82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.824551 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_003d62e0eb9b4711b3ac9683b00fd194" } modify_external_catalogs: true
I20260503 07:52:55.824694 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_003d62e0eb9b4711b3ac9683b00fd194" } modify_external_catalogs: true
I20260503 07:52:55.825330 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 741a28af9fe946db8c9305aa1dabe999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.834666 744 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.835819 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.836534 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet db13f91ef1d740c387bacbb689ddf1a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db13f91ef1d740c387bacbb689ddf1a8 already in progress: creating tablet
I20260503 07:52:55.837301 1174 ts_tablet_manager.cc:1916] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.850943 1171 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:55.851227 1171 ts_tablet_manager.cc:1403] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.188s user 0.014s sys 0.006s
I20260503 07:52:55.852130 1171 raft_consensus.cc:359] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:55.852452 1171 raft_consensus.cc:385] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.852567 1171 raft_consensus.cc:740] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.852905 1171 consensus_queue.cc:260] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:55.853742 1171 ts_tablet_manager.cc:1434] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:55.854136 1171 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.855445 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.857275 1171 tablet_bootstrap.cc:654] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.859978 742 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.862087 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.867422 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_f397484bea66470d840ab901d70b6e51 [id=0a3183eb2a7d4d9ebe87627bc031f95c] alter complete (version 2)
I20260503 07:52:55.867373 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_03280762d4884d6684c217c6ad942cb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:55.868021 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03280762d4884d6684c217c6ad942cb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.868228 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_de043fa894ce46f18865ea92043ad965" } new_table_name: "default.Table_2cc0c5fabbbd49bd83c20def809b855d" modify_external_catalogs: true
I20260503 07:52:55.869671 1174 ts_tablet_manager.cc:1929] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:55.869846 1174 log.cc:1199] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/62ac84e88ebe478fb6200bb5052a8f84
I20260503 07:52:55.870306 1174 ts_tablet_manager.cc:1950] T 62ac84e88ebe478fb6200bb5052a8f84 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:55.871649 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.871897 1175 tablet_replica.cc:333] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:55.872105 1175 raft_consensus.cc:2243] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:55.872356 1175 pending_rounds.cc:70] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:55.872442 1165 tablet_bootstrap.cc:654] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.872439 1175 pending_rounds.cc:77] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847401420128256 op_type: NO_OP noop_request { }
I20260503 07:52:55.872540 1175 raft_consensus.cc:2889] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:55.872643 1175 raft_consensus.cc:2272] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.875175 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.875908 1175 ts_tablet_manager.cc:1916] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:55.875984 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:55.877703 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]) successfully deleted
W20260503 07:52:55.877969 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f54aaadc3d22437286303caac65c7cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54aaadc3d22437286303caac65c7cb4 already in progress: creating tablet
W20260503 07:52:55.878222 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet fb821b329d284643a889b07f9a4f287e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb821b329d284643a889b07f9a4f287e already in progress: creating tablet
I20260503 07:52:55.878296 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_afd273127f664810a60c73fd24617fd6" } modify_external_catalogs: true
W20260503 07:52:55.878405 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet db13f91ef1d740c387bacbb689ddf1a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db13f91ef1d740c387bacbb689ddf1a8 already in progress: creating tablet
I20260503 07:52:55.878461 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_afd273127f664810a60c73fd24617fd6" } modify_external_catalogs: true
W20260503 07:52:55.878625 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8ffec630db9a430fa3006268b0e28fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffec630db9a430fa3006268b0e28fcd already in progress: creating tablet
W20260503 07:52:55.878796 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ac8d392c3bb94f03819fae08fc009fbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac8d392c3bb94f03819fae08fc009fbc already in progress: creating tablet
W20260503 07:52:55.878994 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 92c1709a2a49475daaa2372360610b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92c1709a2a49475daaa2372360610b1e already in progress: creating tablet
I20260503 07:52:55.883220 1175 ts_tablet_manager.cc:1929] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:55.883415 1175 log.cc:1199] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:55.883596 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 1
I20260503 07:52:55.883795 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]). Expected version 1 got 0
I20260503 07:52:55.884012 1175 ts_tablet_manager.cc:1950] T 0481b55721854d70a670a79ff2f42dd6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:55.885151 1175 tablet_replica.cc:333] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:55.885387 1175 raft_consensus.cc:2243] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:55.885629 1175 raft_consensus.cc:2272] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:55.886770 1166 tablet_bootstrap.cc:492] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:55.886946 1166 ts_tablet_manager.cc:1403] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.170s user 0.027s sys 0.039s
I20260503 07:52:55.887478 1171 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:55.887614 1171 ts_tablet_manager.cc:1403] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260503 07:52:55.887684 1166 raft_consensus.cc:359] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.887876 1166 raft_consensus.cc:385] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.887959 1166 raft_consensus.cc:740] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.888433 1171 raft_consensus.cc:359] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.888433 1166 consensus_queue.cc:260] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.888731 1171 raft_consensus.cc:385] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.888861 1171 raft_consensus.cc:740] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.889106 1166 ts_tablet_manager.cc:1434] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:52:55.889137 1171 consensus_queue.cc:260] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.889595 1166 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:55.889801 1171 ts_tablet_manager.cc:1434] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:55.891369 1166 tablet_bootstrap.cc:654] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.893071 1171 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.893626 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 0481b55721854d70a670a79ff2f42dd6 (table default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5 [id=0fbceb4c0fd74bb0a162136215a4a5c0]) successfully deleted
W20260503 07:52:55.894611 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36b6147bab7a44b19b4a22addf68961f consensus state has no leader
I20260503 07:52:55.894743 1171 tablet_bootstrap.cc:654] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.898979 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3205a7422449483486c7ec067fbcdfb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.902273 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b1952c00ba4d4ae5915968d5b34ec0a5" } new_table_name: "default.Table_2296ebfcda984fb7ab807952ca7e5991" modify_external_catalogs: true
I20260503 07:52:55.902952 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4d8dfc410a40ec825d8e45e07388f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:55.902853 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_08777a140b3c45e688c9b5113806f83d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:55.903713 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskCEB381/build/asan/bin/kudu pid 428
I20260503 07:52:55.904961 489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 07:52:55.905788 1175 ts_tablet_manager.cc:1916] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:55.905804 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3205a7422449483486c7ec067fbcdfb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.906303 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:55.907469 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08777a140b3c45e688c9b5113806f83d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:55.912714 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.913043 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:55.922931 1165 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:55.923202 1165 ts_tablet_manager.cc:1403] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.002s
I20260503 07:52:55.924077 1500 raft_consensus.cc:493] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.924362 1500 raft_consensus.cc:515] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.925599 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1498486dd3db414c8062cba2d54037bb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:55.926139 988 leader_election.cc:343] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.926620 1500 leader_election.cc:290] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.927060 885 tablet_service.cc:1511] Processing CreateTablet for tablet ab44832fbf224a069d958cf745d914f8 (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.927968 1165 raft_consensus.cc:359] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.928108 1014 tablet_service.cc:1511] Processing CreateTablet for tablet ab44832fbf224a069d958cf745d914f8 (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.928254 1165 raft_consensus.cc:385] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.928350 1165 raft_consensus.cc:740] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.928532 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44832fbf224a069d958cf745d914f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.928566 1165 consensus_queue.cc:260] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.931977 1165 ts_tablet_manager.cc:1434] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260503 07:52:55.932235 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44832fbf224a069d958cf745d914f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:55.932425 986 leader_election.cc:343] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 1498486dd3db414c8062cba2d54037bb
I20260503 07:52:55.932556 986 leader_election.cc:304] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:55.933018 1500 raft_consensus.cc:2749] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:55.933264 1500 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:55.933406 1500 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:55.934099 1500 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:55.934536 746 tablet_service.cc:1511] Processing CreateTablet for tablet 26032d89839340988fce30f458e785fa (DEFAULT_TABLE table=default.Table_783704b9e4a140a79ff78cb95c84d553 [id=11a2c74d8372450eadd5f5eb5e031241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.934955 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26032d89839340988fce30f458e785fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.936223 750 tablet_service.cc:1511] Processing CreateTablet for tablet c5a6b2fbf1ea4a109a63f0b3d224434a (DEFAULT_TABLE table=default.Table_932de977bb484428abefdbabc42ac8ad [id=c1b7f04f6a8d4bfa92eeff0205bd2a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.936589 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a6b2fbf1ea4a109a63f0b3d224434a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.941130 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:55.942900 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:52:55.943915 1171 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:55.944083 1171 ts_tablet_manager.cc:1403] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
W20260503 07:52:55.944151 988 leader_election.cc:343] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:55.944353 761 tablet_service.cc:1511] Processing CreateTablet for tablet ef666aa007504682bc044cbd0b56060d (DEFAULT_TABLE table=default.Table_7a4fc080fdcc4332aade3874b1685db1 [id=8e6e8a89691d40948e0dd8e65e7c63fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.944830 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef666aa007504682bc044cbd0b56060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.945062 1171 raft_consensus.cc:359] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:55.945278 1171 raft_consensus.cc:385] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:55.945362 1171 raft_consensus.cc:740] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:55.945657 1171 consensus_queue.cc:260] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:55.945921 1026 tablet_service.cc:1511] Processing CreateTablet for tablet cec0b36fdcf64042bc87446977b9dcca (DEFAULT_TABLE table=default.Table_de043fa894ce46f18865ea92043ad965 [id=1f6281a948e44d009924d010847812f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.946271 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec0b36fdcf64042bc87446977b9dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.946308 1171 ts_tablet_manager.cc:1434] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:55.946565 1171 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:55.948534 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.948992 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c1c1b04c89a64f8d9429203c46894d39 (DEFAULT_TABLE table=default.Table_cef8f8c699d84b3bb95bf3ab889d29f3 [id=9fe2e183ebe04cb8aa8a3b97ca11e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.949384 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 26032d89839340988fce30f458e785fa (DEFAULT_TABLE table=default.Table_783704b9e4a140a79ff78cb95c84d553 [id=11a2c74d8372450eadd5f5eb5e031241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.949774 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c5a6b2fbf1ea4a109a63f0b3d224434a (DEFAULT_TABLE table=default.Table_932de977bb484428abefdbabc42ac8ad [id=c1b7f04f6a8d4bfa92eeff0205bd2a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.950028 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bcb9ab72a482ca07447ff392ae49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.950165 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be (DEFAULT_TABLE table=default.Table_ffded03505a4436c8598eb62fc41c377 [id=59c5933dad96432a9c2617945db710d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.950554 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ef666aa007504682bc044cbd0b56060d (DEFAULT_TABLE table=default.Table_7a4fc080fdcc4332aade3874b1685db1 [id=8e6e8a89691d40948e0dd8e65e7c63fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.950888 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 1799fea5a17f4a1cbbcd955d3813167c (DEFAULT_TABLE table=default.Table_49b37ac0c82347efae878d0fc6198faa [id=b74130814629460882428c661bc22952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.951191 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 053b644e68e04a80966f374883170221 (DEFAULT_TABLE table=default.Table_b1952c00ba4d4ae5915968d5b34ec0a5 [id=899e2cc2520a48c9927e82a9ff1d6e6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.951539 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 (DEFAULT_TABLE table=default.Table_e3c1abd9ad204dfa8660122ba6b1a119 [id=ed801c0f275c42079d474438a0e0e1ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.951880 1171 tablet_bootstrap.cc:654] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:55.953064 896 tablet_service.cc:1511] Processing CreateTablet for tablet 26032d89839340988fce30f458e785fa (DEFAULT_TABLE table=default.Table_783704b9e4a140a79ff78cb95c84d553 [id=11a2c74d8372450eadd5f5eb5e031241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.953522 883 tablet_service.cc:1511] Processing CreateTablet for tablet c1c1b04c89a64f8d9429203c46894d39 (DEFAULT_TABLE table=default.Table_cef8f8c699d84b3bb95bf3ab889d29f3 [id=9fe2e183ebe04cb8aa8a3b97ca11e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.954098 893 tablet_service.cc:1511] Processing CreateTablet for tablet c5a6b2fbf1ea4a109a63f0b3d224434a (DEFAULT_TABLE table=default.Table_932de977bb484428abefdbabc42ac8ad [id=c1b7f04f6a8d4bfa92eeff0205bd2a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.954617 889 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be (DEFAULT_TABLE table=default.Table_ffded03505a4436c8598eb62fc41c377 [id=59c5933dad96432a9c2617945db710d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.955092 881 tablet_service.cc:1511] Processing CreateTablet for tablet ef666aa007504682bc044cbd0b56060d (DEFAULT_TABLE table=default.Table_7a4fc080fdcc4332aade3874b1685db1 [id=8e6e8a89691d40948e0dd8e65e7c63fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.955528 897 tablet_service.cc:1511] Processing CreateTablet for tablet 1799fea5a17f4a1cbbcd955d3813167c (DEFAULT_TABLE table=default.Table_49b37ac0c82347efae878d0fc6198faa [id=b74130814629460882428c661bc22952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.955984 892 tablet_service.cc:1511] Processing CreateTablet for tablet 053b644e68e04a80966f374883170221 (DEFAULT_TABLE table=default.Table_b1952c00ba4d4ae5915968d5b34ec0a5 [id=899e2cc2520a48c9927e82a9ff1d6e6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.956635 890 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 (DEFAULT_TABLE table=default.Table_e3c1abd9ad204dfa8660122ba6b1a119 [id=ed801c0f275c42079d474438a0e0e1ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.956946 895 tablet_service.cc:1511] Processing CreateTablet for tablet cec0b36fdcf64042bc87446977b9dcca (DEFAULT_TABLE table=default.Table_de043fa894ce46f18865ea92043ad965 [id=1f6281a948e44d009924d010847812f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.957201 891 tablet_service.cc:1511] Processing CreateTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.957794 886 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.958135 888 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd (DEFAULT_TABLE table=default.Table_7f8c14a439a6480c8d3e6d940f811f4e [id=081c0cd4bc7b430189955be6b04340a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.958249 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a6b2fbf1ea4a109a63f0b3d224434a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.964320 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90ec3eb3894c18825ebe5fb79fa5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.968664 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef666aa007504682bc044cbd0b56060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.969137 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1799fea5a17f4a1cbbcd955d3813167c (DEFAULT_TABLE table=default.Table_49b37ac0c82347efae878d0fc6198faa [id=b74130814629460882428c661bc22952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:55.969900 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1799fea5a17f4a1cbbcd955d3813167c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.953543 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26032d89839340988fce30f458e785fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.970561 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3fcb4d83f64f6182a78a1a02da39d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.971931 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1799fea5a17f4a1cbbcd955d3813167c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.972397 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef666aa007504682bc044cbd0b56060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.974488 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff4e3f16c1413c858ed955c77497c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.976317 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053b644e68e04a80966f374883170221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.980327 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb82179b8b845da88125aa9f32bb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.984366 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90ec3eb3894c18825ebe5fb79fa5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.988310 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a6b2fbf1ea4a109a63f0b3d224434a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.992378 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c1b04c89a64f8d9429203c46894d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.996363 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec0b36fdcf64042bc87446977b9dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.997648 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bcb9ab72a482ca07447ff392ae49d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:55.998592 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cec0b36fdcf64042bc87446977b9dcca consensus state has no leader
I20260503 07:52:56.001885 880 tablet_service.cc:1511] Processing CreateTablet for tablet 637462b45502433796daa7a9cd8586d3 (DEFAULT_TABLE table=default.Table_dfc5adf554ea4cfba8121383b6e3e2ee [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.002571 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 (DEFAULT_TABLE table=default.Table_ee7f38f496474becb6a59ba8be7e5ed5 [id=3f55a88165f34822a87ebf26b9a8bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.002916 894 tablet_service.cc:1511] Processing CreateTablet for tablet fa97597fa7a1435995f13e189db1f3fa (DEFAULT_TABLE table=default.Table_ed9c3e79bc39467aa5ab8d80c7783faa [id=1ecfe39a31fd4b9bb50826758274ec8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.003028 884 tablet_service.cc:1511] Processing CreateTablet for tablet e1efb53c5e184a618316a759b8e7d38e (DEFAULT_TABLE table=default.Table_89860f4b2acb4f3b845ca047709f84af [id=8ad35527884343eba6bd98297153f0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.003443 879 tablet_service.cc:1511] Processing CreateTablet for tablet 7346da7e4cf147528f16d9ecfdb86c33 (DEFAULT_TABLE table=default.Table_69265862c32c4f5b872353b7e124f649 [id=44dd86c1f2014274bfbc3f4fc65bb4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.002615 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5776840523f54e6bb18d674815d3b447 (DEFAULT_TABLE table=default.Table_d6ef064db41c4038af67e0d8bc00e797 [id=b8668e75b62d4bc1af22421a0cf33ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.011818 741 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 (DEFAULT_TABLE table=default.Table_e3c1abd9ad204dfa8660122ba6b1a119 [id=ed801c0f275c42079d474438a0e0e1ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.014221 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:52:56.011109 744 tablet_service.cc:1511] Processing CreateTablet for tablet c1c1b04c89a64f8d9429203c46894d39 (DEFAULT_TABLE table=default.Table_cef8f8c699d84b3bb95bf3ab889d29f3 [id=9fe2e183ebe04cb8aa8a3b97ca11e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.025838 752 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.026732 759 tablet_service.cc:1511] Processing CreateTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.027949 743 tablet_service.cc:1511] Processing CreateTablet for tablet 637462b45502433796daa7a9cd8586d3 (DEFAULT_TABLE table=default.Table_dfc5adf554ea4cfba8121383b6e3e2ee [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.028566 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd (DEFAULT_TABLE table=default.Table_7f8c14a439a6480c8d3e6d940f811f4e [id=081c0cd4bc7b430189955be6b04340a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.029789 758 tablet_service.cc:1511] Processing CreateTablet for tablet fa97597fa7a1435995f13e189db1f3fa (DEFAULT_TABLE table=default.Table_ed9c3e79bc39467aa5ab8d80c7783faa [id=1ecfe39a31fd4b9bb50826758274ec8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.030269 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_dfc5adf554ea4cfba8121383b6e3e2ee" } new_table_name: "default.Table_196b3df392d748dc9ff186860f3f2b98" modify_external_catalogs: true
I20260503 07:52:56.030453 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_157ae3f1f274402c9578a83a27a09e8a" } modify_external_catalogs: true
I20260503 07:52:56.030718 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c41e725530ce4d4f944b9d9d17ae0e44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:56.030774 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_157ae3f1f274402c9578a83a27a09e8a" } modify_external_catalogs: true
W20260503 07:52:56.031232 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c41e725530ce4d4f944b9d9d17ae0e44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.032387 747 tablet_service.cc:1511] Processing CreateTablet for tablet 5776840523f54e6bb18d674815d3b447 (DEFAULT_TABLE table=default.Table_d6ef064db41c4038af67e0d8bc00e797 [id=b8668e75b62d4bc1af22421a0cf33ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.032714 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c4e16481e61b48ea8c0ffb18d855f20f" } modify_external_catalogs: true
I20260503 07:52:56.032914 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c4e16481e61b48ea8c0ffb18d855f20f" } modify_external_catalogs: true
I20260503 07:52:56.033396 751 tablet_service.cc:1511] Processing CreateTablet for tablet 053b644e68e04a80966f374883170221 (DEFAULT_TABLE table=default.Table_b1952c00ba4d4ae5915968d5b34ec0a5 [id=899e2cc2520a48c9927e82a9ff1d6e6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.033756 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff4e3f16c1413c858ed955c77497c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.034005 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5776840523f54e6bb18d674815d3b447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.034091 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 (DEFAULT_TABLE table=default.Table_ee7f38f496474becb6a59ba8be7e5ed5 [id=3f55a88165f34822a87ebf26b9a8bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.034387 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6df58637e047ef9b696f22d7c43e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.036327 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053b644e68e04a80966f374883170221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.040307 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637462b45502433796daa7a9cd8586d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.044329 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa97597fa7a1435995f13e189db1f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.065058 1635 raft_consensus.cc:493] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.066491 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c1b04c89a64f8d9429203c46894d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.069897 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bcb9ab72a482ca07447ff392ae49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.074982 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053b644e68e04a80966f374883170221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.077826 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7346da7e4cf147528f16d9ecfdb86c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.078584 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb82179b8b845da88125aa9f32bb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.088912 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3fcb4d83f64f6182a78a1a02da39d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.093078 746 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be (DEFAULT_TABLE table=default.Table_ffded03505a4436c8598eb62fc41c377 [id=59c5933dad96432a9c2617945db710d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.093937 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90ec3eb3894c18825ebe5fb79fa5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.098943 1165 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:56.117848 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6df58637e047ef9b696f22d7c43e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:55.778194 1173 raft_consensus.cc:2243] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.125715 1173 raft_consensus.cc:2272] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.136008 761 tablet_service.cc:1511] Processing CreateTablet for tablet e1efb53c5e184a618316a759b8e7d38e (DEFAULT_TABLE table=default.Table_89860f4b2acb4f3b845ca047709f84af [id=8ad35527884343eba6bd98297153f0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.138682 1647 raft_consensus.cc:493] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.138875 1647 raft_consensus.cc:515] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.139837 1647 leader_election.cc:290] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.143937 1165 tablet_bootstrap.cc:654] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:56.143951 854 leader_election.cc:343] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 4d4d8dfc410a40ec825d8e45e07388f6
W20260503 07:52:56.146091 851 leader_election.cc:343] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:56.146227 851 leader_election.cc:304] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:56.146646 1647 raft_consensus.cc:2749] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.147248 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1799fea5a17f4a1cbbcd955d3813167c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.149025 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet c1c631d3da8f4ec29690c548097a454b (table default.Table_82a4b1a149d1448588fbc0ce1e44754d [id=95fc3e91893c440e8498f12f6dfd56d2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c1c631d3da8f4ec29690c548097a454b consensus state has no leader
I20260503 07:52:56.065327 1635 raft_consensus.cc:515] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.151083 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5776840523f54e6bb18d674815d3b447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.151783 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd (DEFAULT_TABLE table=default.Table_7f8c14a439a6480c8d3e6d940f811f4e [id=081c0cd4bc7b430189955be6b04340a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.152279 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb82179b8b845da88125aa9f32bb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.160188 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 637462b45502433796daa7a9cd8586d3 (DEFAULT_TABLE table=default.Table_dfc5adf554ea4cfba8121383b6e3e2ee [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.163609 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637462b45502433796daa7a9cd8586d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.180285 1635 leader_election.cc:290] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.186597 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 (DEFAULT_TABLE table=default.Table_ee7f38f496474becb6a59ba8be7e5ed5 [id=3f55a88165f34822a87ebf26b9a8bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.187767 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.188328 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6df58637e047ef9b696f22d7c43e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.198226 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa97597fa7a1435995f13e189db1f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.200347 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e1efb53c5e184a618316a759b8e7d38e (DEFAULT_TABLE table=default.Table_89860f4b2acb4f3b845ca047709f84af [id=8ad35527884343eba6bd98297153f0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.200795 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 5776840523f54e6bb18d674815d3b447 (DEFAULT_TABLE table=default.Table_d6ef064db41c4038af67e0d8bc00e797 [id=b8668e75b62d4bc1af22421a0cf33ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.203264 1028 tablet_service.cc:1511] Processing CreateTablet for tablet fa97597fa7a1435995f13e189db1f3fa (DEFAULT_TABLE table=default.Table_ed9c3e79bc39467aa5ab8d80c7783faa [id=1ecfe39a31fd4b9bb50826758274ec8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.203908 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 7346da7e4cf147528f16d9ecfdb86c33 (DEFAULT_TABLE table=default.Table_69265862c32c4f5b872353b7e124f649 [id=44dd86c1f2014274bfbc3f4fc65bb4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.208127 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3fcb4d83f64f6182a78a1a02da39d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.216217 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5776840523f54e6bb18d674815d3b447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.220973 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1efb53c5e184a618316a759b8e7d38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.221732 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa97597fa7a1435995f13e189db1f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.222775 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7346da7e4cf147528f16d9ecfdb86c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.229369 1647 raft_consensus.cc:493] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.229581 1647 raft_consensus.cc:515] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.236276 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1efb53c5e184a618316a759b8e7d38e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.238603 854 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:56.241832 1647 leader_election.cc:290] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.268458 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd0b6afae47432e9da300ba07e970e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:56.268482 917 raft_consensus.cc:3060] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:56.270867 1173 ts_tablet_manager.cc:1916] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.291277 1166 tablet_bootstrap.cc:492] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.291479 1166 ts_tablet_manager.cc:1403] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.402s user 0.036s sys 0.061s
I20260503 07:52:56.293563 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff4e3f16c1413c858ed955c77497c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.297305 1166 raft_consensus.cc:359] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.297552 1166 raft_consensus.cc:385] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.298079 1166 raft_consensus.cc:740] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.298395 1166 consensus_queue.cc:260] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.299961 1166 ts_tablet_manager.cc:1434] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:52:56.304409 1166 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.307713 1166 tablet_bootstrap.cc:654] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:56.312527 988 consensus_peers.cc:597] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:56.320072 988 leader_election.cc:343] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.358530 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26032d89839340988fce30f458e785fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.363742 1636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s user 0.007s sys 0.040s
W20260503 07:52:56.363849 1636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s user 0.007s sys 0.040s
I20260503 07:52:56.366060 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637462b45502433796daa7a9cd8586d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.371758 1171 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:56.371953 1171 ts_tablet_manager.cc:1403] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.425s user 0.100s sys 0.207s
I20260503 07:52:56.372948 1171 raft_consensus.cc:359] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.141230 745 tablet_service.cc:1511] Processing CreateTablet for tablet ab44832fbf224a069d958cf745d914f8 (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.378192 1457 raft_consensus.cc:493] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:56.378266 1499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.000s sys 0.008s
I20260503 07:52:56.378623 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1efb53c5e184a618316a759b8e7d38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.378969 1635 consensus_queue.cc:1048] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:52:56.380729 1171 raft_consensus.cc:385] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.380869 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c1b04c89a64f8d9429203c46894d39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.381721 988 consensus_peers.cc:597] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:56.382817 1174 tablet_replica.cc:333] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:56.383118 1457 raft_consensus.cc:515] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.383677 1457 leader_election.cc:290] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:56.383826 1457 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.383934 1457 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.384418 1457 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:56.386514 744 tablet_service.cc:1511] Processing CreateTablet for tablet 7346da7e4cf147528f16d9ecfdb86c33 (DEFAULT_TABLE table=default.Table_69265862c32c4f5b872353b7e124f649 [id=44dd86c1f2014274bfbc3f4fc65bb4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.384583 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:56.393646 742 tablet_service.cc:1511] Processing CreateTablet for tablet cec0b36fdcf64042bc87446977b9dcca (DEFAULT_TABLE table=default.Table_de043fa894ce46f18865ea92043ad965 [id=1f6281a948e44d009924d010847812f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.395910 1171 raft_consensus.cc:740] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.396229 1171 consensus_queue.cc:260] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.396492 1174 raft_consensus.cc:2243] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:56.398389 1499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s user 0.001s sys 0.008s
I20260503 07:52:56.398396 1174 raft_consensus.cc:2272] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.398933 1174 ts_tablet_manager.cc:1916] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.399192 776 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:56.404218 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f407467a0c9c406faaa657ce70a1028b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:56.404287 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:56.405086 716 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.406538 1171 ts_tablet_manager.cc:1434] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.025s user 0.000s sys 0.002s
I20260503 07:52:56.406803 1171 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:56.408135 1165 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
W20260503 07:52:56.408388 986 leader_election.cc:343] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:56.409472 1049 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:56.409777 986 leader_election.cc:304] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:56.410528 716 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:56.410977 1165 ts_tablet_manager.cc:1403] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.477s user 0.075s sys 0.124s
I20260503 07:52:56.411803 986 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:56.411978 1635 raft_consensus.cc:2749] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.412161 1635 consensus_queue.cc:1048] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:56.422772 1171 tablet_bootstrap.cc:654] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.423869 1636 raft_consensus.cc:2804] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:56.424069 1636 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:56.424295 1636 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:56.426359 1171 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:56.426807 1171 ts_tablet_manager.cc:1403] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.004s
I20260503 07:52:56.428720 1171 raft_consensus.cc:359] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.429188 1171 raft_consensus.cc:385] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.429451 1171 raft_consensus.cc:740] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.429973 1171 consensus_queue.cc:260] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.431097 1171 ts_tablet_manager.cc:1434] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260503 07:52:56.431870 1171 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:56.436546 1635 raft_consensus.cc:493] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.436622 1171 tablet_bootstrap.cc:654] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.436712 1635 raft_consensus.cc:515] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:56.437352 1635 leader_election.cc:290] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.438388 1173 ts_tablet_manager.cc:1929] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.440531 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44832fbf224a069d958cf745d914f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.441068 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7346da7e4cf147528f16d9ecfdb86c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.448017 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec0b36fdcf64042bc87446977b9dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.453079 1636 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.453716 1636 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.465824 1171 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:56.465972 1171 ts_tablet_manager.cc:1403] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20260503 07:52:56.473462 1174 ts_tablet_manager.cc:1929] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.473616 1174 log.cc:1199] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:56.474064 1174 ts_tablet_manager.cc:1950] T 0481b55721854d70a670a79ff2f42dd6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:56.475147 1174 tablet_replica.cc:333] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:56.475396 1174 raft_consensus.cc:2243] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.475585 1174 raft_consensus.cc:2272] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.477872 1457 raft_consensus.cc:2804] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:56.478381 1457 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:56.478500 1457 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:56.478703 1165 raft_consensus.cc:359] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:56.479184 1165 raft_consensus.cc:385] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.479287 1165 raft_consensus.cc:740] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.479259 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:56.479614 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 0481b55721854d70a670a79ff2f42dd6 (table default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5 [id=0fbceb4c0fd74bb0a162136215a4a5c0]) successfully deleted
I20260503 07:52:56.480563 1165 consensus_queue.cc:260] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:56.484822 986 leader_election.cc:343] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c46873d43e1b4495a92996e07f93f918
I20260503 07:52:56.489919 1173 log.cc:1199] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/a60a9ee2cc5a42efa1201e12622d4df1
I20260503 07:52:56.491218 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46873d43e1b4495a92996e07f93f918" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:56.492851 1647 raft_consensus.cc:493] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:52:56.493448 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:56.494637 1647 raft_consensus.cc:515] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:56.495352 1647 leader_election.cc:290] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:56.503660 1688 tablet.cc:1724] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:52:56.502652 1457 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.505987 778 raft_consensus.cc:2393] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c11eb9ffa7845269a6a8000e8ff248f in current term 1: Already voted for candidate 4a924c2134c54fa0bb164825da53bdd0 in this term.
W20260503 07:52:56.510253 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 053b644e68e04a80966f374883170221 consensus state has no leader
I20260503 07:52:56.516413 1457 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:52:56.516407 988 consensus_peers.cc:597] T ef0ad3ee6d1445b28ffc55ba93d57901 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:56.516680 988 leader_election.cc:343] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.518992 1174 ts_tablet_manager.cc:1916] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.525485 1173 ts_tablet_manager.cc:1950] T a60a9ee2cc5a42efa1201e12622d4df1 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:56.526048 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 293) took 2951 ms. Trace:
I20260503 07:52:56.526182 1173 rpcz_store.cc:276] 0503 07:52:53.574537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.578162 (+ 3625us) service_pool.cc:224] Handling call
0503 07:52:55.774028 (+2195866us) ts_tablet_manager.cc:1151] Deleting tablet a60a9ee2cc5a42efa1201e12622d4df1
0503 07:52:55.774037 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.303687 (+529650us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.385622 (+ 81935us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.525819 (+140197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195571}
I20260503 07:52:56.526741 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:52:56.527470 1173 tablet_replica.cc:333] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:56.527640 1173 raft_consensus.cc:2243] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.527652 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet a60a9ee2cc5a42efa1201e12622d4df1 (table default.Table_25b08e2755f24392a139c1de3502e83c [id=4472a4b7867c44208865a62e84f48baa]) successfully deleted
I20260503 07:52:56.528297 1173 raft_consensus.cc:2272] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.529300 745 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.529547 891 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.529703 988 leader_election.cc:304] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:56.530265 988 leader_election.cc:343] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.534417 1174 ts_tablet_manager.cc:1929] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.530717 1635 raft_consensus.cc:2749] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.536746 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:56.538543 1500 consensus_queue.cc:1048] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260503 07:52:56.538684 1173 ts_tablet_manager.cc:1916] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.536324 986 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:56.539759 854 leader_election.cc:343] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:56.540952 1175 ts_tablet_manager.cc:1929] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.541325 1049 raft_consensus.cc:2393] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a924c2134c54fa0bb164825da53bdd0 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:56.541821 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2ad24ddc82bd401fb5427e7415af3922
I20260503 07:52:56.541917 1500 raft_consensus.cc:2749] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.544454 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.545663 1166 tablet_bootstrap.cc:492] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.547730 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1cdca8ec33a144e2b44cd9a0c0d61d93
I20260503 07:52:56.548275 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.548658 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.550196 1175 log.cc:1199] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:56.550522 1171 raft_consensus.cc:359] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.550725 1171 raft_consensus.cc:385] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.544025 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.553969 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.555462 1174 log.cc:1199] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f407467a0c9c406faaa657ce70a1028b
I20260503 07:52:56.560331 1174 ts_tablet_manager.cc:1950] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:56.560395 1175 ts_tablet_manager.cc:1950] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:56.561913 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f407467a0c9c406faaa657ce70a1028b (table default.Table_98bf34009bfe4112bc02fc3b4688a1f6 [id=2d52f50c360c42b9a8e1d679998e3478]) successfully deleted
W20260503 07:52:56.565024 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cc7a0272fdc34044af78ba21b6ca31bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc7a0272fdc34044af78ba21b6ca31bc already in progress: creating tablet
I20260503 07:52:56.565038 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:56.566226 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2ad24ddc82bd401fb5427e7415af3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ad24ddc82bd401fb5427e7415af3922 already in progress: creating tablet
W20260503 07:52:56.567174 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 already in progress: creating tablet
I20260503 07:52:56.572708 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (table default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]) successfully deleted
I20260503 07:52:56.574209 1166 ts_tablet_manager.cc:1403] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.242s user 0.021s sys 0.031s
I20260503 07:52:56.574702 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.574924 1171 raft_consensus.cc:740] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.575237 1171 consensus_queue.cc:260] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.575925 1171 ts_tablet_manager.cc:1434] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.110s user 0.001s sys 0.001s
I20260503 07:52:56.576108 1166 raft_consensus.cc:359] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.576484 1166 raft_consensus.cc:385] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.576768 1166 raft_consensus.cc:740] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:52:56.581555 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 637462b45502433796daa7a9cd8586d3 consensus state has no leader
I20260503 07:52:56.576061 1692 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:56.584182 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:56.585389 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.585647 1174 tablet_replica.cc:333] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:56.576277 1175 tablet_replica.cc:333] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:56.586365 1175 raft_consensus.cc:2243] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.586608 1175 raft_consensus.cc:2272] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.586786 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.586783 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e634f8f2aaf4456a64ced5049bdfe21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.587520 1175 ts_tablet_manager.cc:1916] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.588245 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f7654a4a85b6441f9d36527ced775aa2
I20260503 07:52:56.589846 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.590801 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.592787 880 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.598986 1174 raft_consensus.cc:2243] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.599308 1174 pending_rounds.cc:70] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:56.599396 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647]). Expected version 4 got 0
I20260503 07:52:56.599367 1174 pending_rounds.cc:77] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7281847404805193728 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "0e634f8f2aaf4456a64ced5049bdfe21" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_157ae3f1f274402c9578a83a27a09e8a" dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" new_extra_config { } }
I20260503 07:52:56.599848 1174 raft_consensus.cc:2272] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.600545 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_77f41fa25df44f15b60c99adfe386121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:56.600670 1174 ts_tablet_manager.cc:1916] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.600744 1171 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:56.601094 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77f41fa25df44f15b60c99adfe386121 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.602917 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cfd8b5cb57ed4ed3970aa696413a0b46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:56.603240 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d52a967c6b2743c0bdea087b3f771295" } new_table_name: "default.Table_7f4e04b692cd401c8f8248d2b54732e3" modify_external_catalogs: true
W20260503 07:52:56.603468 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfd8b5cb57ed4ed3970aa696413a0b46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.602918 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_78caf320cd8d42a4b19d6ba70437b2fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.604641 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78caf320cd8d42a4b19d6ba70437b2fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.604691 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_704725dd7d6349ce9fa1159720280ae3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.605158 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_704725dd7d6349ce9fa1159720280ae3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.605887 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78cb9693e91b4dc390a8f393e78efe28" } new_table_name: "default.Table_5c0e01a35aaa44b399bf571a5ef9c2d8" modify_external_catalogs: true
I20260503 07:52:56.606420 1174 ts_tablet_manager.cc:1929] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:56.606523 1174 log.cc:1199] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:56.606884 1174 ts_tablet_manager.cc:1950] T 0e634f8f2aaf4456a64ced5049bdfe21 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:56.607398 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:56.607645 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_82fb22ed1c684680a97c28c1b3a4cc59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:56.607791 1171 tablet_bootstrap.cc:654] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:56.608075 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82fb22ed1c684680a97c28c1b3a4cc59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:56.609246 986 consensus_peers.cc:597] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e634f8f2aaf4456a64ced5049bdfe21. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:56.609632 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_94e59438b1a64a3892bd09823f11f804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.610059 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94e59438b1a64a3892bd09823f11f804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.611553 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_de299b56284b4d058540082977ad7f6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.611915 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de299b56284b4d058540082977ad7f6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.614001 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:56.616925 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f7654a4a85b6441f9d36527ced775aa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7654a4a85b6441f9d36527ced775aa2 already in progress: creating tablet
I20260503 07:52:56.619174 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_67b0255f537f478181bd75c8c5561b78" } new_table_name: "default.Table_3c3518b900d542d0bbaa3d961fe42977" modify_external_catalogs: true
I20260503 07:52:56.628341 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:56.628582 851 leader_election.cc:343] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:56.628805 851 leader_election.cc:304] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:56.629253 1647 raft_consensus.cc:2749] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.629508 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:56.629771 851 leader_election.cc:343] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:56.629900 851 leader_election.cc:304] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:56.630086 715 leader_election.cc:343] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.630244 1647 raft_consensus.cc:2749] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:56.629899 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:56.630733 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f407467a0c9c406faaa657ce70a1028b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:56.633432 1692 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 344) took 2344 ms. Trace:
I20260503 07:52:56.633598 1692 rpcz_store.cc:276] 0503 07:52:54.289355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.289401 (+ 46us) service_pool.cc:224] Handling call
0503 07:52:56.633389 (+2343988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:54.401498 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:52:54.401632 (+ 134us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:52:54.401641 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0503 07:52:54.401647 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:52:54.403153 (+ 1506us) alter_schema_op.cc:128] START. Timestamp: 1777794774402975
0503 07:52:54.403156 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:52:54.404559 (+ 1403us) log.cc:844] Serialized 173 byte log entry
0503 07:52:54.894104 (+489545us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x617000034ef0. stack: 00007fe1a7f78086 00007fe1a7f77e40 00007fe1a6f313ad 000000000099adb4 000000000099ad7d 00007fe1b73006bd 00007fe1b73007b3 00007fe1b3d94eb8 00007fe1b3d9ebd1 00007fe1b3d9e8bd 0000000000aa4cac 00007fe1a7fbdf6f 00007fe1a7fc128b 00007fe1a7fc1108 0000000000aa4cac 00007fe1a7f9d528
0503 07:52:56.398535 (+1504431us) op_driver.cc:464] REPLICATION: finished
0503 07:52:56.560061 (+161526us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:52:56.582334 (+ 22273us) log.cc:844] Serialized 5 byte log entry
0503 07:52:56.585612 (+ 3278us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.632639 (+ 47027us) log.cc:844] Serialized 14 byte log entry
0503 07:52:56.633350 (+ 711us) alter_schema_op.cc:73] Released schema lock
0503 07:52:56.633355 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":161459,"mutex_wait_us":130810,"prepare.queue_time_us":111800,"prepare.run_cpu_time_us":598,"prepare.run_wall_time_us":124411,"raft.queue_time_us":251993,"raft.run_cpu_time_us":3322,"raft.run_wall_time_us":237027,"replication_time_us":1995346,"spinlock_wait_cycles":75080576,"thread_start_us":229088,"threads_started":2}]]}
W20260503 07:52:56.635059 715 leader_election.cc:343] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.635214 715 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:56.635671 1166 consensus_queue.cc:260] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:56.637584 715 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.637719 715 leader_election.cc:304] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:56.637761 1689 raft_consensus.cc:2749] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260503 07:52:56.637923 715 raft_consensus.cc:2686] T f407467a0c9c406faaa657ce70a1028b P 4a924c2134c54fa0bb164825da53bdd0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:52:56.641961 1692 tablet.cc:1724] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:56.580226 1173 ts_tablet_manager.cc:1929] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.647668 1173 log.cc:1199] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f3e004ece846459c89f920fb5567f2ad
I20260503 07:52:56.648588 1173 ts_tablet_manager.cc:1950] T f3e004ece846459c89f920fb5567f2ad P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:56.650842 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 297) took 2893 ms. Trace:
I20260503 07:52:56.654122 1173 rpcz_store.cc:276] 0503 07:52:53.757691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.760232 (+ 2541us) service_pool.cc:224] Handling call
0503 07:52:56.526736 (+2766504us) ts_tablet_manager.cc:1151] Deleting tablet f3e004ece846459c89f920fb5567f2ad
0503 07:52:56.526744 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.561726 (+ 34982us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.580034 (+ 18308us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.650806 (+ 70772us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2766268}
I20260503 07:52:56.656864 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f3e004ece846459c89f920fb5567f2ad (table default.Table_9cc79885fac84a68b5c4c0472d6b7d64 [id=24c655c9ddd24b2d853b763208a566ca]) successfully deleted
I20260503 07:52:56.649700 1166 ts_tablet_manager.cc:1434] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.075s user 0.002s sys 0.000s
I20260503 07:52:56.657485 1166 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.659821 1166 tablet_bootstrap.cc:654] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.661674 1165 ts_tablet_manager.cc:1434] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.250s user 0.007s sys 0.006s
I20260503 07:52:56.662315 1165 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:56.665603 1165 tablet_bootstrap.cc:654] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.666101 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 0
I20260503 07:52:56.669184 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 0
I20260503 07:52:56.672070 761 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.672235 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 65fbd09bd319440cadcc84f1d55e7bde from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:56.672371 1174 tablet_replica.cc:333] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:56.672546 1174 raft_consensus.cc:2243] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.672683 1174 raft_consensus.cc:2272] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.673045 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 855100ffa19d4fe7a92ae13ca5171adb from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:56.673449 1174 ts_tablet_manager.cc:1916] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.674304 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 9336e5b80c644ebcb75455770eb45d70 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:56.679488 761 tablet_service.cc:1511] Processing CreateTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 (DEFAULT_TABLE table=default.Table_03280762d4884d6684c217c6ad942cb4 [id=b683cf9e7445430e91e2038b017c5336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.679914 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eacb83c81442d4b6bfc25717fe21e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.681387 745 tablet_service.cc:1511] Processing CreateTablet for tablet a21b0b39717f46f6be352c6361bd01c9 (DEFAULT_TABLE table=default.Table_e7e6b24cd38d4dc7b542d2aa05a2523b [id=d6f7cd80c79c4326a2337e86382fb627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.681787 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21b0b39717f46f6be352c6361bd01c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.683612 885 tablet_service.cc:1511] Processing CreateTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 (DEFAULT_TABLE table=default.Table_c0ff43b4c5294513804c22176ddd5f82 [id=055e6ecd2ba14952b43509d286d41628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.684056 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3724490a7ed4afc82e4f7ebc1190f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.657836 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 301) took 2832 ms. Trace:
I20260503 07:52:56.678483 880 tablet_service.cc:1511] Processing CreateTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 (DEFAULT_TABLE table=default.Table_03280762d4884d6684c217c6ad942cb4 [id=b683cf9e7445430e91e2038b017c5336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.680369 891 tablet_service.cc:1511] Processing CreateTablet for tablet a21b0b39717f46f6be352c6361bd01c9 (DEFAULT_TABLE table=default.Table_e7e6b24cd38d4dc7b542d2aa05a2523b [id=d6f7cd80c79c4326a2337e86382fb627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.684762 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21b0b39717f46f6be352c6361bd01c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.688768 489 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:48392 (request call id 34) took 784 ms (client timeout 1000 ms). Trace:
W20260503 07:52:56.689486 489 rpcz_store.cc:269] 0503 07:52:55.904659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.904712 (+ 53us) service_pool.cc:224] Handling call
0503 07:52:56.688681 (+783969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:52:56.691258 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eacb83c81442d4b6bfc25717fe21e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.691591 1174 ts_tablet_manager.cc:1929] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.693202 1174 log.cc:1199] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:56.693789 1174 ts_tablet_manager.cc:1950] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:56.695268 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (table default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]) successfully deleted
I20260503 07:52:56.700053 1173 rpcz_store.cc:276] 0503 07:52:53.825075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.825269 (+ 194us) service_pool.cc:224] Handling call
0503 07:52:56.657698 (+2832429us) ts_tablet_manager.cc:1151] Deleting tablet 75419ed8fabc4c36ae2d2b128ec4f5b5
0503 07:52:56.657706 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.657804 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2832224}
W20260503 07:52:56.700706 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 already in progress: creating tablet
I20260503 07:52:56.701149 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 303) took 2816 ms. Trace:
I20260503 07:52:56.701344 1173 rpcz_store.cc:276] 0503 07:52:53.885142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.885364 (+ 222us) service_pool.cc:224] Handling call
0503 07:52:56.701016 (+2815652us) ts_tablet_manager.cc:1151] Deleting tablet e662fd10883b401c8f0d4a45735e2639
0503 07:52:56.701025 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.701116 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2815444}
W20260503 07:52:56.701972 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e662fd10883b401c8f0d4a45735e2639 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e662fd10883b401c8f0d4a45735e2639 already in progress: creating tablet
I20260503 07:52:56.702443 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 304) took 2817 ms. Trace:
I20260503 07:52:56.702615 1173 rpcz_store.cc:276] 0503 07:52:53.885227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.885609 (+ 382us) service_pool.cc:224] Handling call
0503 07:52:56.702297 (+2816688us) ts_tablet_manager.cc:1151] Deleting tablet 376e9889ca584931ac1d91a9af2c0689
0503 07:52:56.702309 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.702408 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2816483}
W20260503 07:52:56.703122 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 376e9889ca584931ac1d91a9af2c0689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 376e9889ca584931ac1d91a9af2c0689 already in progress: creating tablet
I20260503 07:52:56.703608 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 305) took 2818 ms. Trace:
I20260503 07:52:56.708526 1697 raft_consensus.cc:493] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.710368 1697 raft_consensus.cc:515] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.710922 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 (DEFAULT_TABLE table=default.Table_c0ff43b4c5294513804c22176ddd5f82 [id=055e6ecd2ba14952b43509d286d41628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.711426 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3724490a7ed4afc82e4f7ebc1190f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.719947 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 (DEFAULT_TABLE table=default.Table_03280762d4884d6684c217c6ad942cb4 [id=b683cf9e7445430e91e2038b017c5336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.717938 1173 rpcz_store.cc:276] 0503 07:52:53.885318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.885839 (+ 521us) service_pool.cc:224] Handling call
0503 07:52:56.703436 (+2817597us) ts_tablet_manager.cc:1151] Deleting tablet ebec2b05025444ccaf0bf0bb4ab62dae
0503 07:52:56.703457 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.703575 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2817408}
W20260503 07:52:56.720534 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ebec2b05025444ccaf0bf0bb4ab62dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebec2b05025444ccaf0bf0bb4ab62dae already in progress: creating tablet
I20260503 07:52:56.721005 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eacb83c81442d4b6bfc25717fe21e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.720924 1711 raft_consensus.cc:493] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04ac6a9a921d4741bacf707b8f217874)
I20260503 07:52:56.721145 1711 raft_consensus.cc:515] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:52:56.722323 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 302) took 2837 ms. Trace:
I20260503 07:52:56.722343 611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65adddd546eb49779519c7f7378d0e60" candidate_term: 2 candidate_status { last_received { term: 1 index: 589 } } ignore_live_leader: false dest_uuid: "04ac6a9a921d4741bacf707b8f217874" is_pre_election: true
I20260503 07:52:56.722456 1173 rpcz_store.cc:276] 0503 07:52:53.885041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.886054 (+ 1013us) service_pool.cc:224] Handling call
0503 07:52:56.722193 (+2836139us) ts_tablet_manager.cc:1151] Deleting tablet feb88812c6b0459d86bd441926f57ecf
0503 07:52:56.722203 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.722293 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2835954}
W20260503 07:52:56.722952 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet feb88812c6b0459d86bd441926f57ecf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feb88812c6b0459d86bd441926f57ecf already in progress: creating tablet
I20260503 07:52:56.722951 1419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65adddd546eb49779519c7f7378d0e60" candidate_term: 2 candidate_status { last_received { term: 1 index: 589 } } ignore_live_leader: false dest_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" is_pre_election: true
I20260503 07:52:56.724308 444 leader_election.cc:304] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65adddd546eb49779519c7f7378d0e60; no voters: 04ac6a9a921d4741bacf707b8f217874, cd4eda3aaddc4d46a7e8b24b782a7e5c
I20260503 07:52:56.724244 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a21b0b39717f46f6be352c6361bd01c9 (DEFAULT_TABLE table=default.Table_e7e6b24cd38d4dc7b542d2aa05a2523b [id=d6f7cd80c79c4326a2337e86382fb627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.724937 880 tablet_service.cc:1511] Processing CreateTablet for tablet 405e2bbca5c54234a80f23d9399df765 (DEFAULT_TABLE table=default.Table_7b478d31097a4d9eb5bc3f46d259bbe1 [id=5ec15031bef7470eabf0f987264c1216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.725109 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21b0b39717f46f6be352c6361bd01c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.725313 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e2bbca5c54234a80f23d9399df765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.726387 1166 tablet_bootstrap.cc:492] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.719341 761 tablet_service.cc:1511] Processing CreateTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 (DEFAULT_TABLE table=default.Table_c0ff43b4c5294513804c22176ddd5f82 [id=055e6ecd2ba14952b43509d286d41628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.727578 1711 leader_election.cc:290] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759), 04ac6a9a921d4741bacf707b8f217874 (127.0.105.60:40873)
I20260503 07:52:56.727753 1711 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:56.727936 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3724490a7ed4afc82e4f7ebc1190f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.730727 745 tablet_service.cc:1511] Processing CreateTablet for tablet 405e2bbca5c54234a80f23d9399df765 (DEFAULT_TABLE table=default.Table_7b478d31097a4d9eb5bc3f46d259bbe1 [id=5ec15031bef7470eabf0f987264c1216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.731084 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e2bbca5c54234a80f23d9399df765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.732543 1166 ts_tablet_manager.cc:1403] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.000s
I20260503 07:52:56.733322 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 405e2bbca5c54234a80f23d9399df765 (DEFAULT_TABLE table=default.Table_7b478d31097a4d9eb5bc3f46d259bbe1 [id=5ec15031bef7470eabf0f987264c1216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.733551 1166 raft_consensus.cc:359] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.733752 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e2bbca5c54234a80f23d9399df765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.735214 1166 raft_consensus.cc:385] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.735364 1166 raft_consensus.cc:740] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.738027 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskCEB381/build/asan/bin/kudu with pid 428
I20260503 07:52:56.739614 1166 consensus_queue.cc:260] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.740690 1166 ts_tablet_manager.cc:1434] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260503 07:52:56.741149 1166 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.729182 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 310) took 2760 ms. Trace:
I20260503 07:52:56.742143 1173 rpcz_store.cc:276] 0503 07:52:53.968334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.968384 (+ 50us) service_pool.cc:224] Handling call
0503 07:52:56.729050 (+2760666us) ts_tablet_manager.cc:1151] Deleting tablet 16ea29e3b4a84735bb3723dd11449ec3
0503 07:52:56.729059 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.729151 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760342}
I20260503 07:52:56.742751 1173 tablet_replica.cc:333] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:52:56.742672 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 16ea29e3b4a84735bb3723dd11449ec3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ea29e3b4a84735bb3723dd11449ec3 already in progress: creating tablet
I20260503 07:52:56.743096 1173 raft_consensus.cc:2243] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.743302 1173 raft_consensus.cc:2272] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.745301 1173 ts_tablet_manager.cc:1916] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.745672 1175 ts_tablet_manager.cc:1929] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.745852 1175 log.cc:1199] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1498486dd3db414c8062cba2d54037bb
I20260503 07:52:56.746249 1175 ts_tablet_manager.cc:1950] T 1498486dd3db414c8062cba2d54037bb P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:56.749235 1166 tablet_bootstrap.cc:654] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.751551 1697 leader_election.cc:290] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:56.751979 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:56.752466 715 leader_election.cc:343] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.754966 885 tablet_service.cc:1511] Processing CreateTablet for tablet bce8073c9aa549f3b9ee0397984c350b (DEFAULT_TABLE table=default.Table_d6c79b1104334de0b8cdd97f0a8f79ed [id=d74cdc0b81e44123bda6cd765f814ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.755450 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce8073c9aa549f3b9ee0397984c350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.755637 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_435024514d32468b8d6241ec62521b54" } new_table_name: "default.Table_6c97b8139543495bb90b3b23194b8ad8" modify_external_catalogs: true
I20260503 07:52:56.760746 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_34a7397dcc2743f9bd22ca7aea4bf369"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.761374 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34a7397dcc2743f9bd22ca7aea4bf369 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.763412 1165 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:56.763592 1165 ts_tablet_manager.cc:1403] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.002s
I20260503 07:52:56.764496 1165 raft_consensus.cc:359] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:56.764544 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e3c1abd9ad204dfa8660122ba6b1a119" } modify_external_catalogs: true
I20260503 07:52:56.764685 1165 raft_consensus.cc:385] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.764753 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e3c1abd9ad204dfa8660122ba6b1a119" } modify_external_catalogs: true
I20260503 07:52:56.764788 1165 raft_consensus.cc:740] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.765043 1165 consensus_queue.cc:260] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:56.765558 1165 ts_tablet_manager.cc:1434] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:56.767612 1165 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:56.769286 1165 tablet_bootstrap.cc:654] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.770723 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ed9c3e79bc39467aa5ab8d80c7783faa" } modify_external_catalogs: true
I20260503 07:52:56.770902 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ed9c3e79bc39467aa5ab8d80c7783faa" } modify_external_catalogs: true
I20260503 07:52:56.775192 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cef8f8c699d84b3bb95bf3ab889d29f3" } modify_external_catalogs: true
I20260503 07:52:56.775339 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cef8f8c699d84b3bb95bf3ab889d29f3" } modify_external_catalogs: true
I20260503 07:52:56.779510 1647 raft_consensus.cc:493] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.779726 1647 raft_consensus.cc:515] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.780639 1647 leader_election.cc:290] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:56.781952 851 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 0b9ff03fba3d4a1794a8a5b94caa9731
I20260503 07:52:56.786803 891 tablet_service.cc:1511] Processing CreateTablet for tablet e1c68ca20b1548d99a5956c20b194964 (DEFAULT_TABLE table=default.Table_3c54a91d67d2444a902e026221ecd8f5 [id=3bf0d22137ba4a6191166b11d603c6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.787235 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c68ca20b1548d99a5956c20b194964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.791241 1024 tablet_service.cc:1511] Processing CreateTablet for tablet bce8073c9aa549f3b9ee0397984c350b (DEFAULT_TABLE table=default.Table_d6c79b1104334de0b8cdd97f0a8f79ed [id=d74cdc0b81e44123bda6cd765f814ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.791522 1173 ts_tablet_manager.cc:1929] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:56.791630 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce8073c9aa549f3b9ee0397984c350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.791671 1173 log.cc:1199] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/eb5ffb24577d4ba4bb7dd0c46cf482c1
I20260503 07:52:56.792130 1173 ts_tablet_manager.cc:1950] T eb5ffb24577d4ba4bb7dd0c46cf482c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:56.793094 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 313) took 2809 ms. Trace:
I20260503 07:52:56.793216 1173 rpcz_store.cc:276] 0503 07:52:53.984013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:53.984074 (+ 61us) service_pool.cc:224] Handling call
0503 07:52:56.742659 (+2758585us) ts_tablet_manager.cc:1151] Deleting tablet eb5ffb24577d4ba4bb7dd0c46cf482c1
0503 07:52:56.742670 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.751686 (+ 9016us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.791453 (+ 39767us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.793030 (+ 1577us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2758358}
I20260503 07:52:56.793692 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 314) took 2784 ms. Trace:
I20260503 07:52:56.793804 1173 rpcz_store.cc:276] 0503 07:52:54.009276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.018219 (+ 8943us) service_pool.cc:224] Handling call
0503 07:52:56.793499 (+2775280us) ts_tablet_manager.cc:1151] Deleting tablet be15f49b155746d1924868d9f91e9206
0503 07:52:56.793511 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.793634 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2767216}
I20260503 07:52:56.794191 1173 tablet_replica.cc:333] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:56.794384 1173 raft_consensus.cc:2243] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.794556 1173 raft_consensus.cc:2272] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.797472 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet eb5ffb24577d4ba4bb7dd0c46cf482c1 (table default.Table_f68056b470874a4f85a0acc623447fd0 [id=266be98fccd5403494a201a1d8e4bfa2]) successfully deleted
W20260503 07:52:56.797749 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet be15f49b155746d1924868d9f91e9206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be15f49b155746d1924868d9f91e9206 already in progress: creating tablet
I20260503 07:52:56.798765 1166 tablet_bootstrap.cc:492] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.798696 891 tablet_service.cc:1511] Processing CreateTablet for tablet a7907a9cceaa443795275c9cbb62cb22 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.798928 1166 ts_tablet_manager.cc:1403] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.004s
I20260503 07:52:56.799077 1175 tablet_replica.cc:333] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:56.799341 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7907a9cceaa443795275c9cbb62cb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.799860 1166 raft_consensus.cc:359] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.800124 1166 raft_consensus.cc:385] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.800226 1166 raft_consensus.cc:740] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.800474 1166 consensus_queue.cc:260] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.802610 1709 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:56.803800 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:56.804718 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1498486dd3db414c8062cba2d54037bb (table default.Table_880c06e846564e03a359ab40393e5fe2 [id=45fb2a411f3f45c4867a240018396066]) successfully deleted
I20260503 07:52:56.805709 1049 raft_consensus.cc:2468] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:56.806286 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.807113 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb49d5b35994fe9b383b72f77eaebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.813400 891 tablet_service.cc:1511] Processing CreateTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba (DEFAULT_TABLE table=default.Table_0b881a8a82a24c63acfd121516db44b8 [id=53df8f64b61a4e16b624accf7adade39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.812104 1015 tablet_service.cc:1511] Processing CreateTablet for tablet e1c68ca20b1548d99a5956c20b194964 (DEFAULT_TABLE table=default.Table_3c54a91d67d2444a902e026221ecd8f5 [id=3bf0d22137ba4a6191166b11d603c6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.814261 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14998ce78c64e58ac5b7f651b6b88ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.814637 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba (DEFAULT_TABLE table=default.Table_0b881a8a82a24c63acfd121516db44b8 [id=53df8f64b61a4e16b624accf7adade39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.815155 1014 tablet_service.cc:1511] Processing CreateTablet for tablet a7907a9cceaa443795275c9cbb62cb22 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.812000 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.818097 1166 ts_tablet_manager.cc:1434] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260503 07:52:56.819710 886 tablet_service.cc:1511] Processing CreateTablet for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.820081 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16bc543b2e84e8ca7df6c00f1acc0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.821614 1166 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.823113 1018 tablet_service.cc:1511] Processing CreateTablet for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.823908 1166 tablet_bootstrap.cc:654] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.837074 1647 raft_consensus.cc:493] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.837263 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c68ca20b1548d99a5956c20b194964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.837289 1647 raft_consensus.cc:515] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.838009 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14998ce78c64e58ac5b7f651b6b88ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.838088 1647 leader_election.cc:290] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.838428 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7907a9cceaa443795275c9cbb62cb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.838856 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb49d5b35994fe9b383b72f77eaebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.839270 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16bc543b2e84e8ca7df6c00f1acc0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.795085 1173 ts_tablet_manager.cc:1916] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:56.846243 851 leader_election.cc:343] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 3b8a6c13c0ab45f0ae784e1ab352a0bc
W20260503 07:52:56.851450 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4fd9524157c4225885a1f1831982faa consensus state has no leader
I20260503 07:52:56.852351 1166 tablet_bootstrap.cc:492] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.852603 1166 ts_tablet_manager.cc:1403] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
W20260503 07:52:56.852632 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bf42130a55744429d2c64ed55671507 consensus state has no leader
W20260503 07:52:56.853354 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7a7ad2250a3414aa5167d54c2c90941 consensus state has no leader
I20260503 07:52:56.854331 1166 raft_consensus.cc:359] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.854656 1166 raft_consensus.cc:385] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.854818 1166 raft_consensus.cc:740] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.855173 1166 consensus_queue.cc:260] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.799315 1175 raft_consensus.cc:2243] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.856235 1175 raft_consensus.cc:2272] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.857471 1166 ts_tablet_manager.cc:1434] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:56.857821 1166 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.866993 1175 ts_tablet_manager.cc:1916] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.871510 1171 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:56.879145 1166 tablet_bootstrap.cc:654] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.885574 1171 ts_tablet_manager.cc:1403] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.285s user 0.003s sys 0.007s
I20260503 07:52:56.886787 1171 raft_consensus.cc:359] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.887136 1171 raft_consensus.cc:385] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.887293 1171 raft_consensus.cc:740] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.887610 1171 consensus_queue.cc:260] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.888486 1171 ts_tablet_manager.cc:1434] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:56.888872 1171 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:56.871682 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 227169us
I20260503 07:52:56.894574 1166 tablet_bootstrap.cc:492] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:56.894759 1166 ts_tablet_manager.cc:1403] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260503 07:52:56.895704 1166 raft_consensus.cc:359] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.895946 1166 raft_consensus.cc:385] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.896018 1166 raft_consensus.cc:740] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.896283 1166 consensus_queue.cc:260] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.896814 1166 ts_tablet_manager.cc:1434] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:56.906883 1166 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:56.774263 761 tablet_service.cc:1511] Processing CreateTablet for tablet bce8073c9aa549f3b9ee0397984c350b (DEFAULT_TABLE table=default.Table_d6c79b1104334de0b8cdd97f0a8f79ed [id=d74cdc0b81e44123bda6cd765f814ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.778227 745 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.790197 742 tablet_service.cc:1511] Processing CreateTablet for tablet e1c68ca20b1548d99a5956c20b194964 (DEFAULT_TABLE table=default.Table_3c54a91d67d2444a902e026221ecd8f5 [id=3bf0d22137ba4a6191166b11d603c6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.795218 744 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.797662 746 tablet_service.cc:1511] Processing CreateTablet for tablet a7907a9cceaa443795275c9cbb62cb22 (DEFAULT_TABLE table=default.Table_e7c83fe022a34a8e810f1de1bb5e5523 [id=040b2bdef1584c959f5b5f1f2eaa8429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.806448 716 leader_election.cc:304] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:56.813846 759 tablet_service.cc:1511] Processing CreateTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba (DEFAULT_TABLE table=default.Table_0b881a8a82a24c63acfd121516db44b8 [id=53df8f64b61a4e16b624accf7adade39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.819799 750 tablet_service.cc:1511] Processing CreateTablet for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (DEFAULT_TABLE table=default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:56.908663 1697 raft_consensus.cc:2804] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:56.908776 1697 raft_consensus.cc:493] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:52:56.908741 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 102340us
I20260503 07:52:56.908855 1697 raft_consensus.cc:3060] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:56.909161 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce8073c9aa549f3b9ee0397984c350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.912477 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7907a9cceaa443795275c9cbb62cb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.915794 1174 tablet_replica.cc:333] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:56.915807 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 855100ffa19d4fe7a92ae13ca5171adb
I20260503 07:52:56.915966 1174 raft_consensus.cc:2243] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:56.916126 1174 raft_consensus.cc:2272] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:56.916350 596 catalog_manager.cc:6741] ReplaceTablet: tablet 855100ffa19d4fe7a92ae13ca5171adb deleted and replaced by tablet 822c15b68f61466584eec0702196a5c5
I20260503 07:52:56.916374 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c68ca20b1548d99a5956c20b194964. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:56.917384 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 399acb90cf124fcf8a75bf936e3e426f consensus state has no leader
I20260503 07:52:56.919441 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb with delete_type TABLET_DATA_DELETED (replaced by tablet 822c15b68f61466584eec0702196a5c5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.919828 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb49d5b35994fe9b383b72f77eaebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.919836 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb with delete_type TABLET_DATA_DELETED (replaced by tablet 822c15b68f61466584eec0702196a5c5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.920969 600 master_service.cc:954] ReplaceTablet: received request to replace tablet d58deacb99c643d89a6641ef09b026ba from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:56.922655 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 23ff4e3f16c1413c858ed955c77497c9
I20260503 07:52:56.923194 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14998ce78c64e58ac5b7f651b6b88ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.925268 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.925732 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.927008 1171 tablet_bootstrap.cc:654] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.927019 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16bc543b2e84e8ca7df6c00f1acc0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:56.937978 1717 raft_consensus.cc:493] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:56.938138 1717 raft_consensus.cc:515] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.938959 1717 leader_election.cc:290] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:56.906795 1709 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 403) took 2146 ms. Trace:
I20260503 07:52:56.940390 1709 rpcz_store.cc:276] 0503 07:52:54.759958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.946631 (+186673us) service_pool.cc:224] Handling call
0503 07:52:56.906757 (+1960126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:55.000103 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:52:55.000221 (+ 118us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:52:56.633408 (+1633187us) alter_schema_op.cc:66] Acquired schema lock
0503 07:52:56.633421 (+ 13us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:52:56.633464 (+ 43us) alter_schema_op.cc:128] START. Timestamp: 1777794776633427
0503 07:52:56.633466 (+ 2us) op_driver.cc:348] REPLICATION: starting
0503 07:52:56.633656 (+ 190us) log.cc:844] Serialized 173 byte log entry
0503 07:52:56.637927 (+ 4271us) op_driver.cc:464] REPLICATION: finished
0503 07:52:56.801274 (+163347us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:52:56.803020 (+ 1746us) log.cc:844] Serialized 5 byte log entry
0503 07:52:56.906461 (+103441us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.906685 (+ 224us) log.cc:844] Serialized 14 byte log entry
0503 07:52:56.906720 (+ 35us) alter_schema_op.cc:73] Released schema lock
0503 07:52:56.906724 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":162103,"prepare.queue_time_us":53127,"prepare.run_cpu_time_us":114831,"prepare.run_wall_time_us":1635402,"raft.queue_time_us":376,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":256,"replication_time_us":4430,"thread_start_us":511983,"threads_started":2}]]}
W20260503 07:52:56.944808 854 leader_election.cc:343] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 3b8a6c13c0ab45f0ae784e1ab352a0bc
I20260503 07:52:56.944963 854 leader_election.cc:304] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:56.945607 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6019e5691fa14fa1a2a8fe52489e3105"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.946221 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6019e5691fa14fa1a2a8fe52489e3105 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:56.946528 854 leader_election.cc:343] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 0b9ff03fba3d4a1794a8a5b94caa9731
I20260503 07:52:56.946653 854 leader_election.cc:304] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:56.947569 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b95b4ad8129048a49f4d0991dc8b50be" } new_table_name: "default.Table_7b98fead8af7440bb08aa42b8af00167" modify_external_catalogs: true
I20260503 07:52:56.947830 1174 ts_tablet_manager.cc:1916] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:56.949046 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb with delete_type TABLET_DATA_DELETED (replaced by tablet 822c15b68f61466584eec0702196a5c5) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.949267 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.949453 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fa97597fa7a1435995f13e189db1f3fa
I20260503 07:52:56.950209 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e2e01304cac44fcdaa548c6729df2050"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.950691 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2e01304cac44fcdaa548c6729df2050 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.951084 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a740af6e2f844b129450e16ac9bd0a46" } modify_external_catalogs: true
I20260503 07:52:56.951261 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a740af6e2f844b129450e16ac9bd0a46" } modify_external_catalogs: true
I20260503 07:52:56.951659 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c1c1b04c89a64f8d9429203c46894d39
I20260503 07:52:56.952387 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_336d7539481842f8a51b034d94471e83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:56.952667 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_99705f926f5747b9b2be64fbd6e1e16a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:56.952883 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_336d7539481842f8a51b034d94471e83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:56.953100 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99705f926f5747b9b2be64fbd6e1e16a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:56.953125 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:56.954263 1647 raft_consensus.cc:2749] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.954457 1647 raft_consensus.cc:2749] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:56.955627 1166 tablet_bootstrap.cc:654] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:56.956264 852 connection.cc:570] client connection to 127.0.105.62:44841 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:52:56.960561 586 connection.cc:570] client connection to 127.0.105.62:44841 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:52:56.960675 586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 8 similar messages]
W20260503 07:52:56.965859 988 leader_election.cc:343] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:56.966398 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet fa97597fa7a1435995f13e189db1f3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.968091 885 tablet_service.cc:1558] Processing DeleteTablet for tablet fa97597fa7a1435995f13e189db1f3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.968394 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c1b04c89a64f8d9429203c46894d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:56.968530 1171 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:56.968676 1171 ts_tablet_manager.cc:1403] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.003s
I20260503 07:52:56.969518 1171 raft_consensus.cc:359] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.969722 1171 raft_consensus.cc:385] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:56.969822 1171 raft_consensus.cc:740] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:56.970717 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 956600f557b84dac98be63ffe14f4e19 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:56.971415 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ea3cc36f50214961844fbc9f28877922" } modify_external_catalogs: true
I20260503 07:52:56.971675 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ea3cc36f50214961844fbc9f28877922" } modify_external_catalogs: true
I20260503 07:52:56.974962 1171 consensus_queue.cc:260] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:56.976469 714 connection.cc:570] client connection to 127.0.105.62:44841 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 07:52:56.979048 1171 ts_tablet_manager.cc:1434] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:52:56.979439 1171 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:56.981455 1171 tablet_bootstrap.cc:654] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:56.981485 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c1b04c89a64f8d9429203c46894d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:56.990851 745 tablet_service.cc:1558] Processing DeleteTablet for tablet fa97597fa7a1435995f13e189db1f3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.991081 752 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c1b04c89a64f8d9429203c46894d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:56.993506 1697 raft_consensus.cc:515] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:56.994272 1697 leader_election.cc:290] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:56.994458 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:56.994617 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:56.994840 1049 raft_consensus.cc:3060] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:56.990645 1730 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:57.012790 1717 raft_consensus.cc:493] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.013003 1717 raft_consensus.cc:515] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.013790 1717 leader_election.cc:290] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:57.014590 987 connection.cc:570] client connection to 127.0.105.62:44841 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:52:57.023336 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.62:44841, user_credentials={real_user=slave}} blocked reactor thread for 62630.5us
I20260503 07:52:57.034536 1173 ts_tablet_manager.cc:1929] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.035017 1165 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.035219 1165 ts_tablet_manager.cc:1403] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.268s user 0.012s sys 0.018s
I20260503 07:52:57.035854 1165 raft_consensus.cc:359] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.036053 1165 raft_consensus.cc:385] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.036154 1165 raft_consensus.cc:740] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.036485 1165 consensus_queue.cc:260] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.037204 1165 ts_tablet_manager.cc:1434] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.037604 1165 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.039034 1173 log.cc:1199] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/7ce867777c0e46d1af4785e667e7a18e
W20260503 07:52:57.039197 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841): Couldn't send request to peer 65adddd546eb49779519c7f7378d0e60. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.62:44841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:57.039564 1165 tablet_bootstrap.cc:654] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.041635 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 consensus state has no leader
I20260503 07:52:57.044857 1173 ts_tablet_manager.cc:1950] T 7ce867777c0e46d1af4785e667e7a18e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:57.044891 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_806f5406fbdd4481879937bfc675fd46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.045297 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 315) took 2992 ms. Trace:
W20260503 07:52:57.045662 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_806f5406fbdd4481879937bfc675fd46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.045533 1173 rpcz_store.cc:276] 0503 07:52:54.052813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.052878 (+ 65us) service_pool.cc:224] Handling call
0503 07:52:56.794079 (+2741201us) ts_tablet_manager.cc:1151] Deleting tablet 7ce867777c0e46d1af4785e667e7a18e
0503 07:52:56.794088 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:56.906233 (+112145us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:56.987901 (+ 81668us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.045257 (+ 57356us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2740875}
I20260503 07:52:57.046049 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 316) took 2977 ms. Trace:
I20260503 07:52:57.046669 1173 rpcz_store.cc:276] 0503 07:52:54.069027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.072215 (+ 3188us) service_pool.cc:224] Handling call
0503 07:52:57.045865 (+2973650us) ts_tablet_manager.cc:1151] Deleting tablet 5eb48844c2a04b5e8b6f73b9986127ee
0503 07:52:57.045875 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.046011 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2973431}
I20260503 07:52:57.047035 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 319) took 2942 ms. Trace:
I20260503 07:52:57.047156 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 7ce867777c0e46d1af4785e667e7a18e (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
I20260503 07:52:57.047196 1173 rpcz_store.cc:276] 0503 07:52:54.104312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.104915 (+ 603us) service_pool.cc:224] Handling call
0503 07:52:57.046900 (+2941985us) ts_tablet_manager.cc:1151] Deleting tablet bdd151f5e0d54bdab58423c24186b38d
0503 07:52:57.046909 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.046998 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941762}
W20260503 07:52:57.047435 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5eb48844c2a04b5e8b6f73b9986127ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb48844c2a04b5e8b6f73b9986127ee already in progress: creating tablet
I20260503 07:52:57.047660 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 318) took 2943 ms. Trace:
I20260503 07:52:57.047804 1173 rpcz_store.cc:276] 0503 07:52:54.104154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.105969 (+ 1815us) service_pool.cc:224] Handling call
0503 07:52:57.047391 (+2941422us) ts_tablet_manager.cc:1151] Deleting tablet 8fb4d150eadb479d9978f2450637bd3e
0503 07:52:57.047399 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.047629 (+ 230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941203}
I20260503 07:52:57.048043 1173 tablet_replica.cc:333] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:57.048633 1173 raft_consensus.cc:2243] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.048825 1173 raft_consensus.cc:2272] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.050004 1165 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.049947 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_f397484bea66470d840ab901d70b6e51 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 2 got 0
I20260503 07:52:57.050134 1173 ts_tablet_manager.cc:1916] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.050148 1165 ts_tablet_manager.cc:1403] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260503 07:52:57.051553 1165 raft_consensus.cc:359] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.051734 1165 raft_consensus.cc:385] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.051815 1165 raft_consensus.cc:740] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.051669 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_14830acecf2946778bf6c51d9120b70d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.052029 1165 consensus_queue.cc:260] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.052650 1165 ts_tablet_manager.cc:1434] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.052927 1165 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:57.053193 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bdd151f5e0d54bdab58423c24186b38d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdd151f5e0d54bdab58423c24186b38d already in progress: creating tablet
W20260503 07:52:57.053447 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8fb4d150eadb479d9978f2450637bd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fb4d150eadb479d9978f2450637bd3e already in progress: creating tablet
I20260503 07:52:57.054675 1165 tablet_bootstrap.cc:654] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.056504 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14830acecf2946778bf6c51d9120b70d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.058115 1165 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.058307 1165 ts_tablet_manager.cc:1403] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260503 07:52:57.059260 1165 raft_consensus.cc:359] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.059453 1165 raft_consensus.cc:385] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.059538 1165 raft_consensus.cc:740] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.059849 1165 consensus_queue.cc:260] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.060477 1165 ts_tablet_manager.cc:1434] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260503 07:52:57.060540 986 leader_election.cc:343] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.060693 986 leader_election.cc:304] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.060909 1165 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.061112 1716 raft_consensus.cc:2749] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.062239 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.062448 779 raft_consensus.cc:2468] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:57.062638 1165 tablet_bootstrap.cc:654] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.063325 986 leader_election.cc:304] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:57.063657 1716 raft_consensus.cc:2804] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:57.063807 1716 raft_consensus.cc:493] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:57.063985 1716 raft_consensus.cc:3060] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.064267 891 tablet_service.cc:1558] Processing DeleteTablet for tablet be381bee559841bfb90a4d2ce8c4fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.067457 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.074692 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b2dff38f4b794cd6a9f8449b7576447d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.075246 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2dff38f4b794cd6a9f8449b7576447d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.076685 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]). Expected version 3 got 0
I20260503 07:52:57.076732 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.076872 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:57.077091 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 1
W20260503 07:52:57.077203 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.077286 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:57.078681 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c0ff43b4c5294513804c22176ddd5f82" } new_table_name: "default.Table_fdab6b23ab974f80b664ca7e95850925" modify_external_catalogs: true
I20260503 07:52:57.078837 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cfd8b5cb57ed4ed3970aa696413a0b46" } new_table_name: "default.Table_90d9a9ab35a342249d6de77c4e08d223" modify_external_catalogs: true
I20260503 07:52:57.080086 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5c0e01a35aaa44b399bf571a5ef9c2d8" } new_table_name: "default.Table_b64bdadb494f4a1d891b00d815f6bd1f" modify_external_catalogs: true
I20260503 07:52:57.083751 742 tablet_service.cc:1511] Processing CreateTablet for tablet 05134e2081544b5fb7694d63265b047b (DEFAULT_TABLE table=default.Table_78caf320cd8d42a4b19d6ba70437b2fd [id=3f7f39c256124b9192d09f6ce86d6e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.084415 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.084836 744 tablet_service.cc:1511] Processing CreateTablet for tablet 6772fe0377b249be9e247ec93cf50719 (DEFAULT_TABLE table=default.Table_94e59438b1a64a3892bd09823f11f804 [id=e65cbdd56d644c6bb4226d2a59313149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.084918 759 tablet_service.cc:1511] Processing CreateTablet for tablet d7b31b3076214d37a744faa4fa8d585b (DEFAULT_TABLE table=default.Table_3205a7422449483486c7ec067fbcdfb3 [id=c92b3bc4731e4254b0c0ea4836119701]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:57.084959 988 leader_election.cc:343] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.085271 1171 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.085422 1171 ts_tablet_manager.cc:1403] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.106s user 0.001s sys 0.038s
I20260503 07:52:57.086277 1171 raft_consensus.cc:359] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.086483 1171 raft_consensus.cc:385] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.086557 1171 raft_consensus.cc:740] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.088557 1171 consensus_queue.cc:260] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.089035 1171 ts_tablet_manager.cc:1434] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:57.090152 1171 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.091506 1174 ts_tablet_manager.cc:1929] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.091606 1174 log.cc:1199] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/be15f49b155746d1924868d9f91e9206
I20260503 07:52:57.091761 1171 tablet_bootstrap.cc:654] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.091933 1174 ts_tablet_manager.cc:1950] T be15f49b155746d1924868d9f91e9206 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.092509 1014 tablet_service.cc:1511] Processing CreateTablet for tablet d7b31b3076214d37a744faa4fa8d585b (DEFAULT_TABLE table=default.Table_3205a7422449483486c7ec067fbcdfb3 [id=c92b3bc4731e4254b0c0ea4836119701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.093405 1049 raft_consensus.cc:2468] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:57.096696 1165 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.096909 1165 ts_tablet_manager.cc:1403] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.011s
I20260503 07:52:57.097121 716 leader_election.cc:304] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:57.097455 1697 raft_consensus.cc:2804] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:57.097569 1697 raft_consensus.cc:697] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:57.097853 1697 consensus_queue.cc:237] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.101120 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 05134e2081544b5fb7694d63265b047b (DEFAULT_TABLE table=default.Table_78caf320cd8d42a4b19d6ba70437b2fd [id=3f7f39c256124b9192d09f6ce86d6e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.101564 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 6772fe0377b249be9e247ec93cf50719 (DEFAULT_TABLE table=default.Table_94e59438b1a64a3892bd09823f11f804 [id=e65cbdd56d644c6bb4226d2a59313149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.101511 891 tablet_service.cc:1511] Processing CreateTablet for tablet 05134e2081544b5fb7694d63265b047b (DEFAULT_TABLE table=default.Table_78caf320cd8d42a4b19d6ba70437b2fd [id=3f7f39c256124b9192d09f6ce86d6e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.102160 886 tablet_service.cc:1511] Processing CreateTablet for tablet d7b31b3076214d37a744faa4fa8d585b (DEFAULT_TABLE table=default.Table_3205a7422449483486c7ec067fbcdfb3 [id=c92b3bc4731e4254b0c0ea4836119701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.102520 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6772fe0377b249be9e247ec93cf50719 (DEFAULT_TABLE table=default.Table_94e59438b1a64a3892bd09823f11f804 [id=e65cbdd56d644c6bb4226d2a59313149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.102761 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b31b3076214d37a744faa4fa8d585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.104079 1165 raft_consensus.cc:359] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.104305 1165 raft_consensus.cc:385] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.104390 1165 raft_consensus.cc:740] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.105526 1165 consensus_queue.cc:260] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.106182 1165 ts_tablet_manager.cc:1434] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260503 07:52:57.106495 1165 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:52:57.106666 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 155241us
I20260503 07:52:57.107390 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6772fe0377b249be9e247ec93cf50719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.107944 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26da686862f44940b13c7790e00ea3b1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:57.108295 1165 tablet_bootstrap.cc:654] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.108587 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05134e2081544b5fb7694d63265b047b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:57.108672 715 leader_election.cc:343] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.109151 1166 tablet_bootstrap.cc:492] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.109326 1166 ts_tablet_manager.cc:1403] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.207s user 0.008s sys 0.005s
I20260503 07:52:57.111171 1166 raft_consensus.cc:359] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.111388 1166 raft_consensus.cc:385] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.111546 1166 raft_consensus.cc:740] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.111817 1166 consensus_queue.cc:260] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.116521 1165 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.116698 1165 ts_tablet_manager.cc:1403] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260503 07:52:57.117578 1165 raft_consensus.cc:359] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.117794 1165 raft_consensus.cc:385] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.117869 1165 raft_consensus.cc:740] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.118132 1165 consensus_queue.cc:260] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.118768 1165 ts_tablet_manager.cc:1434] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:57.119076 1165 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.119529 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:57.121840 1165 tablet_bootstrap.cc:654] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.123209 1166 ts_tablet_manager.cc:1434] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260503 07:52:57.123564 1166 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.128150 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_563b0138e42c4e4e88a20822813ce1aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.128731 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_563b0138e42c4e4e88a20822813ce1aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.131285 1165 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.131417 1165 ts_tablet_manager.cc:1403] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260503 07:52:57.132154 1165 raft_consensus.cc:359] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.132357 1165 raft_consensus.cc:385] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.132473 1165 raft_consensus.cc:740] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.132666 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dce60ad6aea4465a4ce04ea62bceb13 with delete_type TABLET_DATA_DELETED (replaced by tablet c5765ff6b70046f6a46aab3f413d04f8) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.132695 1165 consensus_queue.cc:260] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.133324 1165 ts_tablet_manager.cc:1434] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:57.133601 1165 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.136124 1165 tablet_bootstrap.cc:654] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.138247 1165 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.138383 1165 ts_tablet_manager.cc:1403] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260503 07:52:57.139047 1165 raft_consensus.cc:359] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.139227 1165 raft_consensus.cc:385] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.139297 1165 raft_consensus.cc:740] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.139546 1165 consensus_queue.cc:260] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.140156 1165 ts_tablet_manager.cc:1434] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:57.140444 1165 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.141701 750 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.142959 1166 tablet_bootstrap.cc:654] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.150630 1165 tablet_bootstrap.cc:654] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.152408 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 031f91b3b3ca4bca856d3c3ee99e9e3a consensus state has no leader
I20260503 07:52:57.154606 596 catalog_manager.cc:5671] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
W20260503 07:52:57.157533 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet cec0b36fdcf64042bc87446977b9dcca (table default.Table_2cc0c5fabbbd49bd83c20def809b855d [id=1f6281a948e44d009924d010847812f5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cec0b36fdcf64042bc87446977b9dcca consensus state has no leader
I20260503 07:52:57.158465 750 tablet_service.cc:1511] Processing CreateTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 (DEFAULT_TABLE table=default.Table_08777a140b3c45e688c9b5113806f83d [id=000ff011e9164e4abdba701f5a1de7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.158815 880 tablet_service.cc:1511] Processing CreateTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 (DEFAULT_TABLE table=default.Table_08777a140b3c45e688c9b5113806f83d [id=000ff011e9164e4abdba701f5a1de7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.159703 1174 tablet_replica.cc:333] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.159930 1174 raft_consensus.cc:2243] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.160108 1174 raft_consensus.cc:2272] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.160123 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 (DEFAULT_TABLE table=default.Table_08777a140b3c45e688c9b5113806f83d [id=000ff011e9164e4abdba701f5a1de7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.161309 761 tablet_service.cc:1511] Processing CreateTablet for tablet acb2026ec07045f6b38c86f1d5d22462 (DEFAULT_TABLE table=default.Table_77f41fa25df44f15b60c99adfe386121 [id=440177aad7c44352b4a85e7a2453986d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.161774 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet be15f49b155746d1924868d9f91e9206 (table default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
W20260503 07:52:57.162027 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 855100ffa19d4fe7a92ae13ca5171adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 855100ffa19d4fe7a92ae13ca5171adb already in progress: creating tablet
I20260503 07:52:57.162199 1029 tablet_service.cc:1511] Processing CreateTablet for tablet acb2026ec07045f6b38c86f1d5d22462 (DEFAULT_TABLE table=default.Table_77f41fa25df44f15b60c99adfe386121 [id=440177aad7c44352b4a85e7a2453986d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:57.162416 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 23ff4e3f16c1413c858ed955c77497c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23ff4e3f16c1413c858ed955c77497c9 already in progress: creating tablet
W20260503 07:52:57.162629 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet fa97597fa7a1435995f13e189db1f3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa97597fa7a1435995f13e189db1f3fa already in progress: creating tablet
W20260503 07:52:57.162873 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c1c1b04c89a64f8d9429203c46894d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1c1b04c89a64f8d9429203c46894d39 already in progress: creating tablet
I20260503 07:52:57.163311 1173 ts_tablet_manager.cc:1929] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.163306 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05134e2081544b5fb7694d63265b047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.163467 1173 log.cc:1199] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/dfb47ec875ab44fbaa270a84224f5432
I20260503 07:52:57.163864 1173 ts_tablet_manager.cc:1950] T dfb47ec875ab44fbaa270a84224f5432 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:57.163967 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6772fe0377b249be9e247ec93cf50719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.164350 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f24fb277ff43f68dcb0d2ac5faa704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.164440 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b31b3076214d37a744faa4fa8d585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.164867 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f24fb277ff43f68dcb0d2ac5faa704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.164901 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05134e2081544b5fb7694d63265b047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.165400 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6772fe0377b249be9e247ec93cf50719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.165812 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b31b3076214d37a744faa4fa8d585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.166497 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb2026ec07045f6b38c86f1d5d22462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.172627 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 317) took 3072 ms. Trace:
I20260503 07:52:57.172734 1173 rpcz_store.cc:276] 0503 07:52:54.100310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.100360 (+ 50us) service_pool.cc:224] Handling call
0503 07:52:57.047992 (+2947632us) ts_tablet_manager.cc:1151] Deleting tablet dfb47ec875ab44fbaa270a84224f5432
0503 07:52:57.047999 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.092214 (+ 44215us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.163223 (+ 71009us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.172573 (+ 9350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941382}
I20260503 07:52:57.173123 1173 tablet_replica.cc:333] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:57.173316 1173 raft_consensus.cc:2243] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.173528 1173 raft_consensus.cc:2272] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.173466 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 52e5486a610142e0af6406d328ece5e5 (DEFAULT_TABLE table=default.Table_de299b56284b4d058540082977ad7f6d [id=2498a171881b42b2bef3ed57c753fcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.174088 1173 ts_tablet_manager.cc:1916] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.175357 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a (DEFAULT_TABLE table=default.Table_90d9a9ab35a342249d6de77c4e08d223 [id=fcaa462aa73a43eb843bca8d01848c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.178791 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet dfb47ec875ab44fbaa270a84224f5432 (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
I20260503 07:52:57.182315 892 tablet_service.cc:1511] Processing CreateTablet for tablet acb2026ec07045f6b38c86f1d5d22462 (DEFAULT_TABLE table=default.Table_77f41fa25df44f15b60c99adfe386121 [id=440177aad7c44352b4a85e7a2453986d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.182682 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb2026ec07045f6b38c86f1d5d22462. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:57.183982 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bf42130a55744429d2c64ed55671507 consensus state has no leader
I20260503 07:52:57.184257 1174 ts_tablet_manager.cc:1916] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.184600 759 tablet_service.cc:1511] Processing CreateTablet for tablet 52e5486a610142e0af6406d328ece5e5 (DEFAULT_TABLE table=default.Table_de299b56284b4d058540082977ad7f6d [id=2498a171881b42b2bef3ed57c753fcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.185032 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e5486a610142e0af6406d328ece5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.185804 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d58deacb99c643d89a6641ef09b026ba
I20260503 07:52:57.186311 600 catalog_manager.cc:6741] ReplaceTablet: tablet d58deacb99c643d89a6641ef09b026ba deleted and replaced by tablet 423d4178b5c040d5b12f0f225d112449
I20260503 07:52:57.187047 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cac435b09639484ca1ae82f3d4990d48
I20260503 07:52:57.187808 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bf51c959093d4579a5916c49e1790737
I20260503 07:52:57.184278 750 tablet_service.cc:1511] Processing CreateTablet for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a (DEFAULT_TABLE table=default.Table_90d9a9ab35a342249d6de77c4e08d223 [id=fcaa462aa73a43eb843bca8d01848c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.188370 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.188403 1175 ts_tablet_manager.cc:1929] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.188470 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 956600f557b84dac98be63ffe14f4e19
I20260503 07:52:57.188526 1175 log.cc:1199] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:57.188892 1175 ts_tablet_manager.cc:1950] T 8dd0b6afae47432e9da300ba07e970e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:57.188994 597 catalog_manager.cc:6741] ReplaceTablet: tablet 956600f557b84dac98be63ffe14f4e19 deleted and replaced by tablet 5cc695ff556240299788c02f416410c2
I20260503 07:52:57.189141 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e5486a610142e0af6406d328ece5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.189110 897 tablet_service.cc:1511] Processing CreateTablet for tablet 52e5486a610142e0af6406d328ece5e5 (DEFAULT_TABLE table=default.Table_de299b56284b4d058540082977ad7f6d [id=2498a171881b42b2bef3ed57c753fcf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.189246 597 master_service.cc:954] ReplaceTablet: received request to replace tablet c1c631d3da8f4ec29690c548097a454b from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:57.189499 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e5486a610142e0af6406d328ece5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.189643 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb2026ec07045f6b38c86f1d5d22462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.190070 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f24fb277ff43f68dcb0d2ac5faa704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.192468 879 tablet_service.cc:1511] Processing CreateTablet for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a (DEFAULT_TABLE table=default.Table_90d9a9ab35a342249d6de77c4e08d223 [id=fcaa462aa73a43eb843bca8d01848c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.192821 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.193117 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:52:57.193315 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:52:57.195402 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.196339 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.196655 1716 raft_consensus.cc:515] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.196875 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.197131 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 956600f557b84dac98be63ffe14f4e19 with delete_type TABLET_DATA_DELETED (replaced by tablet 5cc695ff556240299788c02f416410c2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.197187 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.197364 1716 leader_election.cc:290] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.197427 889 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.197605 896 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.197808 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 956600f557b84dac98be63ffe14f4e19 with delete_type TABLET_DATA_DELETED (replaced by tablet 5cc695ff556240299788c02f416410c2) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.197973 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:57.198158 775 raft_consensus.cc:3060] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.199046 744 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.206646 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f11c020bd0484adfa6d7dae67818f7e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:57.207365 761 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:57.208027 988 leader_election.cc:343] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.210554 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 956600f557b84dac98be63ffe14f4e19 with delete_type TABLET_DATA_DELETED (replaced by tablet 5cc695ff556240299788c02f416410c2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.211506 761 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.214169 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_42447cd849da46668ce923e765d2bf6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.214973 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42447cd849da46668ce923e765d2bf6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.215139 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_82a4b1a149d1448588fbc0ce1e44754d" } modify_external_catalogs: true
I20260503 07:52:57.217779 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ee7f38f496474becb6a59ba8be7e5ed5" } modify_external_catalogs: true
I20260503 07:52:57.218344 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3f09ff72f68949b1a25db5a6f3a3a3fe" } new_table_name: "default.Table_6d5297af28e8453cae39dae2ca4b7584" modify_external_catalogs: true
I20260503 07:52:57.219677 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_82a4b1a149d1448588fbc0ce1e44754d" } modify_external_catalogs: true
I20260503 07:52:57.220245 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ee7f38f496474becb6a59ba8be7e5ed5" } modify_external_catalogs: true
I20260503 07:52:57.221021 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:57.221875 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f637b1e87f94fe1a8603d336fcb9487" } modify_external_catalogs: true
I20260503 07:52:57.225925 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f637b1e87f94fe1a8603d336fcb9487" } modify_external_catalogs: true
W20260503 07:52:57.225744 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3724490a7ed4afc82e4f7ebc1190f76 consensus state has no leader
I20260503 07:52:57.231220 599 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe] alter complete (version 2)
I20260503 07:52:57.236156 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.238858 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0987f089de9f4175af34a86b61ad85c4 (DEFAULT_TABLE table=default.Table_c41e725530ce4d4f944b9d9d17ae0e44 [id=d79f623d6ac247609a851af4998e0cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.240027 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.243492 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 0987f089de9f4175af34a86b61ad85c4 (DEFAULT_TABLE table=default.Table_c41e725530ce4d4f944b9d9d17ae0e44 [id=d79f623d6ac247609a851af4998e0cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.243993 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0987f089de9f4175af34a86b61ad85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.244601 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0987f089de9f4175af34a86b61ad85c4 (DEFAULT_TABLE table=default.Table_c41e725530ce4d4f944b9d9d17ae0e44 [id=d79f623d6ac247609a851af4998e0cb4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:57.245812 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d0487d02934453fbb25104f3b8fe732 consensus state has no leader
I20260503 07:52:57.246189 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6019e5691fa14fa1a2a8fe52489e3105" } new_table_name: "default.Table_2e7941983e7c4c108534b667ccb9d335" modify_external_catalogs: true
I20260503 07:52:57.247665 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0987f089de9f4175af34a86b61ad85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.247830 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 429) took 1341 ms. Trace:
I20260503 07:52:57.247929 1175 rpcz_store.cc:276] 0503 07:52:55.906174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.906227 (+ 53us) service_pool.cc:224] Handling call
0503 07:52:56.798994 (+892767us) ts_tablet_manager.cc:1151] Deleting tablet 8dd0b6afae47432e9da300ba07e970e5
0503 07:52:56.799007 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.093810 (+294803us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.188310 (+ 94500us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.247775 (+ 59465us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":892424}
I20260503 07:52:57.249739 1175 tablet_replica.cc:333] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:57.249939 1175 raft_consensus.cc:2243] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:57.250351 1175 raft_consensus.cc:2272] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.251955 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8dd0b6afae47432e9da300ba07e970e5 (table default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]) successfully deleted
W20260503 07:52:57.252215 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cc7a0272fdc34044af78ba21b6ca31bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc7a0272fdc34044af78ba21b6ca31bc already in progress: creating tablet
W20260503 07:52:57.252583 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2ad24ddc82bd401fb5427e7415af3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ad24ddc82bd401fb5427e7415af3922 already in progress: creating tablet
W20260503 07:52:57.252805 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 already in progress: creating tablet
I20260503 07:52:57.254597 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c2004972429a49b78f1e276b92071cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.255214 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2004972429a49b78f1e276b92071cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.256783 744 tablet_service.cc:1511] Processing CreateTablet for tablet 336e5470149f41819b25e1f774cc7229 (DEFAULT_TABLE table=default.Table_82fb22ed1c684680a97c28c1b3a4cc59 [id=7c809d2085224c25b2105b5b2782cd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.256868 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.259529 879 tablet_service.cc:1511] Processing CreateTablet for tablet 336e5470149f41819b25e1f774cc7229 (DEFAULT_TABLE table=default.Table_82fb22ed1c684680a97c28c1b3a4cc59 [id=7c809d2085224c25b2105b5b2782cd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.260076 599 master_service.cc:954] ReplaceTablet: received request to replace tablet f11c020bd0484adfa6d7dae67818f7e5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:57.260351 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 336e5470149f41819b25e1f774cc7229 (DEFAULT_TABLE table=default.Table_82fb22ed1c684680a97c28c1b3a4cc59 [id=7c809d2085224c25b2105b5b2782cd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:57.260829 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336e5470149f41819b25e1f774cc7229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.267457 1175 ts_tablet_manager.cc:1916] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.268289 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336e5470149f41819b25e1f774cc7229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.268537 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0987f089de9f4175af34a86b61ad85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.269321 775 raft_consensus.cc:2468] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:57.270087 986 leader_election.cc:304] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.272648 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.272986 1716 raft_consensus.cc:2804] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:57.274804 1716 raft_consensus.cc:697] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:57.275264 1716 consensus_queue.cc:237] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.277904 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336e5470149f41819b25e1f774cc7229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:57.279045 1166 tablet_bootstrap.cc:492] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.279366 1166 ts_tablet_manager.cc:1403] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.156s user 0.004s sys 0.000s
I20260503 07:52:57.280131 1166 raft_consensus.cc:359] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.281374 1166 raft_consensus.cc:385] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.281448 1166 raft_consensus.cc:740] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.281675 1166 consensus_queue.cc:260] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.285199 917 raft_consensus.cc:3060] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.287118 1166 ts_tablet_manager.cc:1434] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260503 07:52:57.287487 1166 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.289959 1166 tablet_bootstrap.cc:654] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.298806 1697 raft_consensus.cc:493] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.299005 1697 raft_consensus.cc:515] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.299649 1697 leader_election.cc:290] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:57.300237 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.300328 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.300545 1049 raft_consensus.cc:2468] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:52:57.300904 715 leader_election.cc:343] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.301146 716 leader_election.cc:304] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.301517 1697 raft_consensus.cc:2804] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:57.301620 1697 raft_consensus.cc:493] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:57.301776 1697 raft_consensus.cc:3060] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.301617 1165 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.306051 1165 ts_tablet_manager.cc:1403] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.166s user 0.030s sys 0.034s
I20260503 07:52:57.307217 1166 tablet_bootstrap.cc:492] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.307364 1166 ts_tablet_manager.cc:1403] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260503 07:52:57.307812 1165 raft_consensus.cc:359] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.308211 1165 raft_consensus.cc:385] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.308238 1166 raft_consensus.cc:359] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.308419 1166 raft_consensus.cc:385] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.308519 1166 raft_consensus.cc:740] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.308550 1165 raft_consensus.cc:740] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.308759 1166 consensus_queue.cc:260] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.309654 1166 ts_tablet_manager.cc:1434] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.309913 1166 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.311086 1165 consensus_queue.cc:260] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.312292 1165 ts_tablet_manager.cc:1434] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260503 07:52:57.314013 1165 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.317682 1165 tablet_bootstrap.cc:654] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.319166 1166 tablet_bootstrap.cc:654] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.320744 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c75f9f01238b4ea58157bb094224d6c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.321697 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c75f9f01238b4ea58157bb094224d6c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.327435 1166 tablet_bootstrap.cc:492] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.327720 1166 ts_tablet_manager.cc:1403] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20260503 07:52:57.328955 1166 raft_consensus.cc:359] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.329362 1166 raft_consensus.cc:385] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.329500 1166 raft_consensus.cc:740] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.329869 1166 consensus_queue.cc:260] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.330674 1166 ts_tablet_manager.cc:1434] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:57.331111 1166 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.334352 1166 tablet_bootstrap.cc:654] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.337813 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8f6df58637e047ef9b696f22d7c43e48
I20260503 07:52:57.338819 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.338935 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c1c631d3da8f4ec29690c548097a454b
I20260503 07:52:57.339357 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.339447 597 catalog_manager.cc:6741] ReplaceTablet: tablet c1c631d3da8f4ec29690c548097a454b deleted and replaced by tablet 127160dc04c5434aa04ffbb11508afb7
I20260503 07:52:57.340441 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (replaced by tablet 127160dc04c5434aa04ffbb11508afb7) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.341218 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b2ef0e849f4d4eb299726b2b094a1dc3
I20260503 07:52:57.341266 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.342520 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (replaced by tablet 127160dc04c5434aa04ffbb11508afb7) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.342525 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.343202 1734 raft_consensus.cc:493] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.343474 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (replaced by tablet 127160dc04c5434aa04ffbb11508afb7) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.343381 1734 raft_consensus.cc:515] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.344305 1734 leader_election.cc:290] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.344837 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:57.345455 851 leader_election.cc:343] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5dce60ad6aea4465a4ce04ea62bceb13
W20260503 07:52:57.346276 854 leader_election.cc:343] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5dce60ad6aea4465a4ce04ea62bceb13
I20260503 07:52:57.346470 854 leader_election.cc:304] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.347762 1734 raft_consensus.cc:2749] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.349005 1165 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.349061 1717 raft_consensus.cc:493] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.349251 1165 ts_tablet_manager.cc:1403] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.000s
I20260503 07:52:57.349256 1717 raft_consensus.cc:515] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.350013 1717 leader_election.cc:290] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.350287 1166 tablet_bootstrap.cc:492] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.350430 1166 ts_tablet_manager.cc:1403] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.007s
I20260503 07:52:57.350317 1165 raft_consensus.cc:359] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.351514 1173 ts_tablet_manager.cc:1929] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:57.351624 1173 log.cc:1199] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/bcbf3231ab114ce59de775f3dcc1e8f2
I20260503 07:52:57.351696 1166 raft_consensus.cc:359] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.351898 1166 raft_consensus.cc:385] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.351991 1166 raft_consensus.cc:740] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.352104 1173 ts_tablet_manager.cc:1950] T bcbf3231ab114ce59de775f3dcc1e8f2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:57.352247 1166 consensus_queue.cc:260] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.352741 1166 ts_tablet_manager.cc:1434] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:57.353018 1166 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.357910 891 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.358059 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 96f7244292c3400dad2812e0adb162ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.359148 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3c4da1aaaa2e4aa3a54dc2bf7b85d8fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.359992 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c4da1aaaa2e4aa3a54dc2bf7b85d8fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.360037 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b1386995480944aa9881fc68fcc03c6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.360571 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1386995480944aa9881fc68fcc03c6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.351269 1174 ts_tablet_manager.cc:1929] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.361759 1174 log.cc:1199] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bf0f650d2efd4a5d9308952b32fa7d63
I20260503 07:52:57.361959 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_77fa641b22004fc287d8aabc52ead412"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.362156 1174 ts_tablet_manager.cc:1950] T bf0f650d2efd4a5d9308952b32fa7d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:52:57.362437 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77fa641b22004fc287d8aabc52ead412 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.352370 1697 raft_consensus.cc:515] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.356492 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda159becff6466abdcd84193f40a65e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.362890 779 raft_consensus.cc:2468] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:57.363189 1697 leader_election.cc:290] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:57.350553 1165 raft_consensus.cc:385] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.363724 1165 raft_consensus.cc:740] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.363960 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:57.364135 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:57.364360 1049 raft_consensus.cc:3060] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:57.364519 715 leader_election.cc:343] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.364565 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ea019acef54e44d98be52fab929136e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.365054 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea019acef54e44d98be52fab929136e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.365062 1165 consensus_queue.cc:260] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.367380 1174 tablet_replica.cc:333] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.367545 1174 raft_consensus.cc:2243] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.367692 1174 raft_consensus.cc:2272] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.368162 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 320) took 3258 ms. Trace:
I20260503 07:52:57.368335 1173 rpcz_store.cc:276] 0503 07:52:54.110066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.110283 (+ 217us) service_pool.cc:224] Handling call
0503 07:52:57.173044 (+3062761us) ts_tablet_manager.cc:1151] Deleting tablet bcbf3231ab114ce59de775f3dcc1e8f2
0503 07:52:57.173055 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.247320 (+ 74265us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.351420 (+104100us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.368119 (+ 16699us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3062542}
I20260503 07:52:57.368669 1173 tablet_replica.cc:333] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:57.368903 1173 raft_consensus.cc:2243] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.369076 1173 raft_consensus.cc:2272] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.369621 1173 ts_tablet_manager.cc:1916] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.369901 986 leader_election.cc:304] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:57.370286 1724 raft_consensus.cc:2804] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:57.370383 1724 raft_consensus.cc:493] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:57.370496 1724 raft_consensus.cc:3060] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.370905 1174 ts_tablet_manager.cc:1916] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.371047 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet bcbf3231ab114ce59de775f3dcc1e8f2 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
I20260503 07:52:57.371762 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bf0f650d2efd4a5d9308952b32fa7d63 (table default.Table_a32643442a2541d585cec3f44840509c [id=7f8470e7e307465b8eb6fa6b1b5bf94f]) successfully deleted
I20260503 07:52:57.374747 1165 ts_tablet_manager.cc:1434] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260503 07:52:57.375102 1165 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.376575 1165 tablet_bootstrap.cc:654] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.382848 1166 tablet_bootstrap.cc:654] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.384608 1697 raft_consensus.cc:493] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.384840 1697 raft_consensus.cc:515] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.385011 1165 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.385185 1165 ts_tablet_manager.cc:1403] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260503 07:52:57.385695 1697 leader_election.cc:290] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.386183 1165 raft_consensus.cc:359] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.386435 1165 raft_consensus.cc:385] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.386444 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4ec79454524d468c76fd01dec8eb1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.386597 1165 raft_consensus.cc:740] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.386775 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4ec79454524d468c76fd01dec8eb1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.386818 1165 consensus_queue.cc:260] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:57.387036 715 leader_election.cc:343] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.387403 716 leader_election.cc:343] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.387535 716 leader_election.cc:304] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.387531 1165 ts_tablet_manager.cc:1434] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:57.388309 1165 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.388381 1697 raft_consensus.cc:2749] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.388780 1166 tablet_bootstrap.cc:492] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.388934 1166 ts_tablet_manager.cc:1403] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.005s
I20260503 07:52:57.389165 1500 raft_consensus.cc:493] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.389357 1500 raft_consensus.cc:515] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.389760 1166 raft_consensus.cc:359] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.389976 1166 raft_consensus.cc:385] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.390020 1165 tablet_bootstrap.cc:654] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.390057 1166 raft_consensus.cc:740] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.390087 1500 leader_election.cc:290] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.390331 1166 consensus_queue.cc:260] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.390908 1166 ts_tablet_manager.cc:1434] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:57.391317 1166 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:57.392331 986 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c00976f3444c43618af30259f0567d17
I20260503 07:52:57.393494 1166 tablet_bootstrap.cc:654] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.421716 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.422303 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.423787 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda159becff6466abdcd84193f40a65e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.425067 1166 tablet_bootstrap.cc:492] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.425462 1166 ts_tablet_manager.cc:1403] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.007s
I20260503 07:52:57.426764 1165 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.426990 1165 ts_tablet_manager.cc:1403] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.008s
I20260503 07:52:57.427096 1166 raft_consensus.cc:359] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.427280 1166 raft_consensus.cc:385] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.427400 1166 raft_consensus.cc:740] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.427639 1166 consensus_queue.cc:260] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.428143 1165 raft_consensus.cc:359] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.428613 1165 raft_consensus.cc:385] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.428766 1165 raft_consensus.cc:740] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.429147 1165 consensus_queue.cc:260] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.430254 1165 ts_tablet_manager.cc:1434] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:52:57.430588 1165 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.432116 1166 ts_tablet_manager.cc:1434] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:57.432425 1166 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.432967 1165 tablet_bootstrap.cc:654] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.434403 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fbd09bd319440cadcc84f1d55e7bde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.435595 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce0e09526eb4c9ba4b47c36e741702d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.437106 879 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c5c6954554eac970d1e3fb1387c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:49 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.438022 1166 tablet_bootstrap.cc:654] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.444061 1166 tablet_bootstrap.cc:492] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.444252 1166 ts_tablet_manager.cc:1403] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260503 07:52:57.444949 1166 raft_consensus.cc:359] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.445170 1166 raft_consensus.cc:385] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.445235 1166 raft_consensus.cc:740] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.445492 1166 consensus_queue.cc:260] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:57.446009 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98e7006b4f9a48f58815ed3c8d2fea10 has no consensus state
I20260503 07:52:57.446162 1166 ts_tablet_manager.cc:1434] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:57.446511 1166 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.447775 1165 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.447954 1165 ts_tablet_manager.cc:1403] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
I20260503 07:52:57.449043 1165 raft_consensus.cc:359] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.449365 1165 raft_consensus.cc:385] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.449514 1165 raft_consensus.cc:740] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.449792 1175 ts_tablet_manager.cc:1929] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:52:57.449817 1165 consensus_queue.cc:260] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.449951 1175 log.cc:1199] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:57.450407 1175 ts_tablet_manager.cc:1950] T 0e634f8f2aaf4456a64ced5049bdfe21 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:57.450490 1165 ts_tablet_manager.cc:1434] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.450775 1165 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.452559 1165 tablet_bootstrap.cc:654] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.456872 1174 ts_tablet_manager.cc:1929] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.458841 1174 log.cc:1199] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/dda159becff6466abdcd84193f40a65e
I20260503 07:52:57.459308 1174 ts_tablet_manager.cc:1950] T dda159becff6466abdcd84193f40a65e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.460116 1697 raft_consensus.cc:493] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.460292 1697 raft_consensus.cc:515] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.460963 1697 leader_election.cc:290] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.461287 1049 raft_consensus.cc:2468] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:57.461449 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2c6d9dd87646ed9d1f86761f13f628" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.461498 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2c6d9dd87646ed9d1f86761f13f628" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.462152 1165 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.462320 1165 ts_tablet_manager.cc:1403] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260503 07:52:57.463065 1165 raft_consensus.cc:359] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.463243 1165 raft_consensus.cc:385] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.463305 1165 raft_consensus.cc:740] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.463524 1165 consensus_queue.cc:260] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.464227 1165 ts_tablet_manager.cc:1434] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260503 07:52:57.464648 715 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.465085 716 leader_election.cc:304] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.465400 1697 raft_consensus.cc:2804] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:57.465525 1697 raft_consensus.cc:697] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
W20260503 07:52:57.465551 716 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.465710 716 leader_election.cc:304] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.465781 1697 consensus_queue.cc:237] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.466310 1175 tablet_replica.cc:333] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:57.466609 1175 raft_consensus.cc:2243] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.466851 1175 raft_consensus.cc:2272] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.467515 1175 ts_tablet_manager.cc:1916] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.468420 1689 raft_consensus.cc:2749] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.469038 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:57.469197 1166 tablet_bootstrap.cc:654] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.469414 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f7654a4a85b6441f9d36527ced775aa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7654a4a85b6441f9d36527ced775aa2 already in progress: creating tablet
I20260503 07:52:57.473371 1734 raft_consensus.cc:493] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.473579 1734 raft_consensus.cc:515] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.473393 1166 tablet_bootstrap.cc:492] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.473932 1166 ts_tablet_manager.cc:1403] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260503 07:52:57.474408 1734 leader_election.cc:290] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.474997 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.475071 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15b6a7760684f1b8785370065e82e77" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.478266 851 leader_election.cc:304] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.478829 1734 raft_consensus.cc:2749] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.464654 1165 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.481047 1166 raft_consensus.cc:359] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.481247 1166 raft_consensus.cc:385] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.481341 1166 raft_consensus.cc:740] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.481552 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00976f3444c43618af30259f0567d17" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.481950 918 raft_consensus.cc:3060] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:57.483264 988 leader_election.cc:343] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.485085 988 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.485250 988 leader_election.cc:304] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.485541 1165 tablet_bootstrap.cc:654] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.485697 1716 raft_consensus.cc:2749] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.487283 1166 consensus_queue.cc:260] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.488278 1166 ts_tablet_manager.cc:1434] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260503 07:52:57.489462 1166 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.492705 1166 tablet_bootstrap.cc:654] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.494318 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet dda159becff6466abdcd84193f40a65e (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:52:57.495298 1174 tablet_replica.cc:333] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.495530 1174 raft_consensus.cc:2243] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.495683 1174 raft_consensus.cc:2272] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:57.497076 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d58deacb99c643d89a6641ef09b026ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d58deacb99c643d89a6641ef09b026ba already in progress: creating tablet
W20260503 07:52:57.497362 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cac435b09639484ca1ae82f3d4990d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cac435b09639484ca1ae82f3d4990d48 already in progress: creating tablet
W20260503 07:52:57.497591 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 956600f557b84dac98be63ffe14f4e19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956600f557b84dac98be63ffe14f4e19 already in progress: creating tablet
W20260503 07:52:57.497810 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bf51c959093d4579a5916c49e1790737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf51c959093d4579a5916c49e1790737 already in progress: creating tablet
W20260503 07:52:57.498067 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8f6df58637e047ef9b696f22d7c43e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f6df58637e047ef9b696f22d7c43e48 already in progress: creating tablet
W20260503 07:52:57.498291 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c1c631d3da8f4ec29690c548097a454b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1c631d3da8f4ec29690c548097a454b already in progress: creating tablet
W20260503 07:52:57.498510 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b2ef0e849f4d4eb299726b2b094a1dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2ef0e849f4d4eb299726b2b094a1dc3 already in progress: creating tablet
I20260503 07:52:57.499516 1174 ts_tablet_manager.cc:1916] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.500387 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_0c3ec91290084114899616ae3dcd851b [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 1 got 0
I20260503 07:52:57.503554 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.504213 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.505838 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_15b74a48b8224ee48f505600b02a9af9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.506767 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15b74a48b8224ee48f505600b02a9af9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.508317 1165 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.508507 1165 ts_tablet_manager.cc:1403] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260503 07:52:57.509558 1165 raft_consensus.cc:359] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.509793 1165 raft_consensus.cc:385] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.509919 1165 raft_consensus.cc:740] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.510159 1165 consensus_queue.cc:260] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.510766 1165 ts_tablet_manager.cc:1434] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.511067 1165 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.513255 1165 tablet_bootstrap.cc:654] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.523108 1171 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.523285 1171 ts_tablet_manager.cc:1403] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.433s user 0.116s sys 0.177s
I20260503 07:52:57.524051 1173 ts_tablet_manager.cc:1929] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.524230 1171 raft_consensus.cc:359] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.524461 1171 raft_consensus.cc:385] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.524554 1171 raft_consensus.cc:740] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.524835 1171 consensus_queue.cc:260] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.525628 1171 ts_tablet_manager.cc:1434] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260503 07:52:57.525942 1171 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.527885 1171 tablet_bootstrap.cc:654] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.529969 1165 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.530247 1165 ts_tablet_manager.cc:1403] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20260503 07:52:57.531391 1165 raft_consensus.cc:359] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.531705 1165 raft_consensus.cc:385] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.531860 1165 raft_consensus.cc:740] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.532275 1165 consensus_queue.cc:260] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.533330 1724 raft_consensus.cc:515] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.533495 1165 ts_tablet_manager.cc:1434] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:57.533883 1165 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.534214 1724 leader_election.cc:290] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.536011 1165 tablet_bootstrap.cc:654] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.537391 986 leader_election.cc:343] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: dda159becff6466abdcd84193f40a65e
I20260503 07:52:57.547191 1174 ts_tablet_manager.cc:1929] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.547341 1174 log.cc:1199] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:52:57.547703 1174 ts_tablet_manager.cc:1950] T 5e2c6d9dd87646ed9d1f86761f13f628 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.563805 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f11c020bd0484adfa6d7dae67818f7e5
I20260503 07:52:57.564436 599 catalog_manager.cc:6741] ReplaceTablet: tablet f11c020bd0484adfa6d7dae67818f7e5 deleted and replaced by tablet 6954ec38f7f742eaa7cc05af5b1432d0
I20260503 07:52:57.564911 1165 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.565150 1165 ts_tablet_manager.cc:1403] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.004s
I20260503 07:52:57.566159 1165 raft_consensus.cc:359] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.566269 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6954ec38f7f742eaa7cc05af5b1432d0) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.566442 1165 raft_consensus.cc:385] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.566571 1165 raft_consensus.cc:740] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.566875 1165 consensus_queue.cc:260] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.567610 1165 ts_tablet_manager.cc:1434] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.567982 1165 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.570057 1165 tablet_bootstrap.cc:654] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.571010 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6954ec38f7f742eaa7cc05af5b1432d0) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:57.571331 1171 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.571550 1171 ts_tablet_manager.cc:1403] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.046s user 0.026s sys 0.014s
I20260503 07:52:57.572417 1171 raft_consensus.cc:359] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.572654 1173 log.cc:1199] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/a19065f28ee44933a0522bfa28696058
I20260503 07:52:57.572692 1171 raft_consensus.cc:385] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.572780 1171 raft_consensus.cc:740] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.572863 879 tablet_service.cc:1558] Processing DeleteTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6954ec38f7f742eaa7cc05af5b1432d0) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.573091 1171 consensus_queue.cc:260] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.573225 1173 ts_tablet_manager.cc:1950] T a19065f28ee44933a0522bfa28696058 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:57.576910 1171 ts_tablet_manager.cc:1434] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:52:57.580053 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 321) took 3419 ms. Trace:
I20260503 07:52:57.580214 1173 rpcz_store.cc:276] 0503 07:52:54.160185 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.160235 (+ 50us) service_pool.cc:224] Handling call
0503 07:52:57.368599 (+3208364us) ts_tablet_manager.cc:1151] Deleting tablet a19065f28ee44933a0522bfa28696058
0503 07:52:57.368610 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.454902 (+ 86292us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.523929 (+ 69027us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.579995 (+ 56066us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3208164}
I20260503 07:52:57.580545 1171 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.580652 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 322) took 3397 ms. Trace:
I20260503 07:52:57.580725 1173 rpcz_store.cc:276] 0503 07:52:54.183276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.183464 (+ 188us) service_pool.cc:224] Handling call
0503 07:52:57.580495 (+3397031us) ts_tablet_manager.cc:1151] Deleting tablet 596130e78eb1444a96480fc1075478cd
0503 07:52:57.580504 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.580607 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3396339}
I20260503 07:52:57.581033 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 323) took 3389 ms. Trace:
I20260503 07:52:57.581117 1173 rpcz_store.cc:276] 0503 07:52:54.191109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.191166 (+ 57us) service_pool.cc:224] Handling call
0503 07:52:57.580906 (+3389740us) ts_tablet_manager.cc:1151] Deleting tablet d3fda3bba9234622b2c391a31c55dc3a
0503 07:52:57.580913 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.580984 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3389562}
I20260503 07:52:57.581383 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 330) took 3239 ms. Trace:
I20260503 07:52:57.581450 1173 rpcz_store.cc:276] 0503 07:52:54.341981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.343309 (+ 1328us) service_pool.cc:224] Handling call
0503 07:52:57.581272 (+3237963us) ts_tablet_manager.cc:1151] Deleting tablet 4674c22562f744f5bce13d97ad8a52b2
0503 07:52:57.581279 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.581336 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3237554}
I20260503 07:52:57.581751 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 331) took 3232 ms. Trace:
I20260503 07:52:57.581838 1173 rpcz_store.cc:276] 0503 07:52:54.349590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.350695 (+ 1105us) service_pool.cc:224] Handling call
0503 07:52:57.581619 (+3230924us) ts_tablet_manager.cc:1151] Deleting tablet 296541e4c2fc4bc193d6f4cee8e65da0
0503 07:52:57.581626 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.581703 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3230702}
I20260503 07:52:57.582229 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 333) took 3229 ms. Trace:
I20260503 07:52:57.582350 1173 rpcz_store.cc:276] 0503 07:52:54.352452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.360235 (+ 7783us) service_pool.cc:224] Handling call
0503 07:52:57.582087 (+3221852us) ts_tablet_manager.cc:1151] Deleting tablet aef746161e6b446ab0d299d37e2151ea
0503 07:52:57.582098 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.582180 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3221610}
I20260503 07:52:57.582729 1173 tablet_replica.cc:333] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:57.582901 1171 tablet_bootstrap.cc:654] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.582958 1173 raft_consensus.cc:2243] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.583174 1173 raft_consensus.cc:2272] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.583796 1173 ts_tablet_manager.cc:1916] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.584386 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda159becff6466abdcd84193f40a65e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:57.585721 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet a19065f28ee44933a0522bfa28696058 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]) successfully deleted
W20260503 07:52:57.586082 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 596130e78eb1444a96480fc1075478cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596130e78eb1444a96480fc1075478cd already in progress: creating tablet
W20260503 07:52:57.586328 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d3fda3bba9234622b2c391a31c55dc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fda3bba9234622b2c391a31c55dc3a already in progress: creating tablet
W20260503 07:52:57.586522 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4674c22562f744f5bce13d97ad8a52b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4674c22562f744f5bce13d97ad8a52b2 already in progress: creating tablet
W20260503 07:52:57.586594 988 leader_election.cc:343] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.586716 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 296541e4c2fc4bc193d6f4cee8e65da0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296541e4c2fc4bc193d6f4cee8e65da0 already in progress: creating tablet
I20260503 07:52:57.586777 988 leader_election.cc:304] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:57.586901 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet aef746161e6b446ab0d299d37e2151ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aef746161e6b446ab0d299d37e2151ea already in progress: creating tablet
I20260503 07:52:57.587126 1716 raft_consensus.cc:2749] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.587903 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3205a7422449483486c7ec067fbcdfb3" } new_table_name: "default.Table_399e3cb559dc48b69df2badacac96f6c" modify_external_catalogs: true
I20260503 07:52:57.600353 1779 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:52:57.603330 1165 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.603529 1165 ts_tablet_manager.cc:1403] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260503 07:52:57.604353 1165 raft_consensus.cc:359] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.604540 1165 raft_consensus.cc:385] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.604614 1165 raft_consensus.cc:740] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.604885 1165 consensus_queue.cc:260] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.605381 1165 ts_tablet_manager.cc:1434] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.605710 1165 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.607367 1165 tablet_bootstrap.cc:654] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.609321 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1342327adf9443718245c4e4b12fd53a" } new_table_name: "default.Table_5f18b90648844a81aabc4f524cd4bc85" modify_external_catalogs: true
I20260503 07:52:57.611682 1174 tablet_replica.cc:333] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.611929 1174 raft_consensus.cc:2243] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.612012 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5e2c6d9dd87646ed9d1f86761f13f628 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
I20260503 07:52:57.612120 1174 raft_consensus.cc:2272] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.612794 1174 ts_tablet_manager.cc:1916] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.624478 1773 raft_consensus.cc:493] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.625003 1773 raft_consensus.cc:515] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.625931 592 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 127160dc04c5434aa04ffbb11508afb7
I20260503 07:52:57.626267 1165 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.626426 1773 leader_election.cc:290] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:57.626816 854 leader_election.cc:343] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:57.627038 1165 ts_tablet_manager.cc:1403] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.000s
W20260503 07:52:57.627038 851 leader_election.cc:343] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:57.627166 851 leader_election.cc:304] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.627874 1165 raft_consensus.cc:359] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.628055 1165 raft_consensus.cc:385] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.628078 1773 raft_consensus.cc:2749] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.628145 1165 raft_consensus.cc:740] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.628386 1165 consensus_queue.cc:260] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.629074 1165 ts_tablet_manager.cc:1434] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.629354 1165 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.631001 1165 tablet_bootstrap.cc:654] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.634179 1175 ts_tablet_manager.cc:1929] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.634438 1175 log.cc:1199] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c46873d43e1b4495a92996e07f93f918
I20260503 07:52:57.634999 1175 ts_tablet_manager.cc:1950] T c46873d43e1b4495a92996e07f93f918 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:57.639506 1734 raft_consensus.cc:493] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:52:57.639683 1734 raft_consensus.cc:515] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.640610 1734 leader_election.cc:290] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.640776 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.641211 1165 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.641398 1165 ts_tablet_manager.cc:1403] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260503 07:52:57.642236 1165 raft_consensus.cc:359] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.642419 1165 raft_consensus.cc:385] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.642488 1165 raft_consensus.cc:740] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.642737 1165 consensus_queue.cc:260] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.643329 1165 ts_tablet_manager.cc:1434] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:57.643656 1165 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.644624 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 0
I20260503 07:52:57.645500 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.645530 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9153d3245f4dcfacf26f174bced2ba" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.645993 1165 tablet_bootstrap.cc:654] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.651081 851 leader_election.cc:304] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.651505 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 89572734813f4d28846ffe38868a15c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.651664 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.651734 1734 raft_consensus.cc:2749] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:52:57.655006 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 1
I20260503 07:52:57.662163 1697 raft_consensus.cc:493] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.662351 1697 raft_consensus.cc:515] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.663093 1697 leader_election.cc:290] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.664354 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:57.665132 716 leader_election.cc:343] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.670346 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:57.670994 715 leader_election.cc:343] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.671126 715 leader_election.cc:304] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.671536 1697 raft_consensus.cc:2749] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.684185 1171 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.684226 1165 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.684368 1171 ts_tablet_manager.cc:1403] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.104s user 0.026s sys 0.066s
I20260503 07:52:57.684379 1165 ts_tablet_manager.cc:1403] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.003s
I20260503 07:52:57.685129 1165 raft_consensus.cc:359] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.685338 1165 raft_consensus.cc:385] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.685441 1165 raft_consensus.cc:740] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.685360 1171 raft_consensus.cc:359] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.685631 1171 raft_consensus.cc:385] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.685763 1171 raft_consensus.cc:740] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.685688 1165 consensus_queue.cc:260] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.686059 1171 consensus_queue.cc:260] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.686183 1165 ts_tablet_manager.cc:1434] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:57.686507 1165 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.688424 1165 tablet_bootstrap.cc:654] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.688835 1166 tablet_bootstrap.cc:492] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:57.689007 1166 ts_tablet_manager.cc:1403] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.200s user 0.007s sys 0.012s
I20260503 07:52:57.689757 1166 raft_consensus.cc:359] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.689968 1166 raft_consensus.cc:385] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.690047 1166 raft_consensus.cc:740] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.690268 1166 consensus_queue.cc:260] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.690733 1166 ts_tablet_manager.cc:1434] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:57.691045 1166 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:57.691974 1171 ts_tablet_manager.cc:1434] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:52:57.677587 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b4649a4c1b5548c68cb0c3d32f365a12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:57.695030 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4649a4c1b5548c68cb0c3d32f365a12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:57.692860 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b64bdadb494f4a1d891b00d815f6bd1f" } modify_external_catalogs: true
I20260503 07:52:57.696157 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b64bdadb494f4a1d891b00d815f6bd1f" } modify_external_catalogs: true
I20260503 07:52:57.696874 1171 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.698657 1171 tablet_bootstrap.cc:654] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.706573 1171 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.706835 1171 ts_tablet_manager.cc:1403] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.002s
I20260503 07:52:57.707734 1171 raft_consensus.cc:359] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.708019 1171 raft_consensus.cc:385] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.707988 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_51fb3eec8b874340a588a54ee74d00cf" } modify_external_catalogs: true
I20260503 07:52:57.708197 1171 raft_consensus.cc:740] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.708206 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_51fb3eec8b874340a588a54ee74d00cf" } modify_external_catalogs: true
I20260503 07:52:57.708570 1171 consensus_queue.cc:260] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.713183 1165 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.713368 1165 ts_tablet_manager.cc:1403] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.009s
I20260503 07:52:57.713689 1171 ts_tablet_manager.cc:1434] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:52:57.714265 1171 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.714203 1165 raft_consensus.cc:359] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.714427 1165 raft_consensus.cc:385] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.714514 1165 raft_consensus.cc:740] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.714795 1165 consensus_queue.cc:260] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.715400 1165 ts_tablet_manager.cc:1434] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:57.715710 1165 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.717347 1171 tablet_bootstrap.cc:654] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.717468 1165 tablet_bootstrap.cc:654] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.719553 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 456) took 1105 ms. Trace:
I20260503 07:52:57.719647 1175 rpcz_store.cc:276] 0503 07:52:56.613864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.613920 (+ 56us) service_pool.cc:224] Handling call
0503 07:52:57.466238 (+852318us) ts_tablet_manager.cc:1151] Deleting tablet c46873d43e1b4495a92996e07f93f918
0503 07:52:57.466248 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.538681 (+ 72433us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.634058 (+ 95377us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.719496 (+ 85438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":852122}
I20260503 07:52:57.720118 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c46873d43e1b4495a92996e07f93f918 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
I20260503 07:52:57.720527 1174 ts_tablet_manager.cc:1929] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.720683 1174 log.cc:1199] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8c4ec79454524d468c76fd01dec8eb1e
I20260503 07:52:57.721151 1174 ts_tablet_manager.cc:1950] T 8c4ec79454524d468c76fd01dec8eb1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.725158 1174 tablet_replica.cc:333] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.725477 1174 raft_consensus.cc:2243] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.725669 1174 raft_consensus.cc:2272] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.726119 1171 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:52:57.726338 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 855100ffa19d4fe7a92ae13ca5171adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 855100ffa19d4fe7a92ae13ca5171adb already in progress: creating tablet
I20260503 07:52:57.726416 1171 ts_tablet_manager.cc:1403] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260503 07:52:57.726405 1174 ts_tablet_manager.cc:1916] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:57.727188 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 23ff4e3f16c1413c858ed955c77497c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23ff4e3f16c1413c858ed955c77497c9 already in progress: creating tablet
I20260503 07:52:57.727152 1171 raft_consensus.cc:359] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.727329 1171 raft_consensus.cc:385] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.727419 1171 raft_consensus.cc:740] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.727645 1171 consensus_queue.cc:260] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.727839 1697 raft_consensus.cc:493] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:57.727852 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fa97597fa7a1435995f13e189db1f3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa97597fa7a1435995f13e189db1f3fa already in progress: creating tablet
I20260503 07:52:57.727983 1697 raft_consensus.cc:515] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.728430 1171 ts_tablet_manager.cc:1434] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260503 07:52:57.728579 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c1c1b04c89a64f8d9429203c46894d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1c1b04c89a64f8d9429203c46894d39 already in progress: creating tablet
I20260503 07:52:57.728626 1697 leader_election.cc:290] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.729180 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:57.729786 716 leader_election.cc:343] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.730543 1171 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.732656 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_770b887c7e33491ea821bf8d8a86448a" } new_table_name: "default.Table_c054b519f1b144dd898d987a82f17322" modify_external_catalogs: true
W20260503 07:52:57.734472 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d58deacb99c643d89a6641ef09b026ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d58deacb99c643d89a6641ef09b026ba already in progress: creating tablet
I20260503 07:52:57.735002 1165 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.735148 1165 ts_tablet_manager.cc:1403] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.003s
W20260503 07:52:57.735713 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cac435b09639484ca1ae82f3d4990d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cac435b09639484ca1ae82f3d4990d48 already in progress: creating tablet
I20260503 07:52:57.735955 1165 raft_consensus.cc:359] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.736155 1165 raft_consensus.cc:385] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.736276 1165 raft_consensus.cc:740] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:52:57.736286 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bf51c959093d4579a5916c49e1790737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf51c959093d4579a5916c49e1790737 already in progress: creating tablet
I20260503 07:52:57.736235 1171 tablet_bootstrap.cc:654] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.736496 1165 consensus_queue.cc:260] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.737187 1165 ts_tablet_manager.cc:1434] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:57.737540 1165 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.737726 1175 tablet_replica.cc:333] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:57.737764 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 956600f557b84dac98be63ffe14f4e19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956600f557b84dac98be63ffe14f4e19 already in progress: creating tablet
I20260503 07:52:57.739439 1165 tablet_bootstrap.cc:654] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.740975 1175 raft_consensus.cc:2243] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.741196 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:57.741241 1175 raft_consensus.cc:2272] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.742051 1175 ts_tablet_manager.cc:1916] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.742429 1165 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:57.742578 1165 ts_tablet_manager.cc:1403] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260503 07:52:57.743342 1165 raft_consensus.cc:359] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.743518 1165 raft_consensus.cc:385] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.743595 1165 raft_consensus.cc:740] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.743847 1165 consensus_queue.cc:260] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.745461 1165 ts_tablet_manager.cc:1434] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260503 07:52:57.745785 1165 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:57.747620 1165 tablet_bootstrap.cc:654] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.749924 1171 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.750108 1171 ts_tablet_manager.cc:1403] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.006s
I20260503 07:52:57.751085 1171 raft_consensus.cc:359] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.751281 1171 raft_consensus.cc:385] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.751349 1171 raft_consensus.cc:740] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.751627 1171 consensus_queue.cc:260] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.752204 1171 ts_tablet_manager.cc:1434] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:57.752439 1173 ts_tablet_manager.cc:1929] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.752600 1173 log.cc:1199] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/0b9ff03fba3d4a1794a8a5b94caa9731
I20260503 07:52:57.753458 1171 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.754208 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b65693d564704918b540c1c3dd8d1f60" } new_table_name: "default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81" modify_external_catalogs: true
I20260503 07:52:57.755666 1171 tablet_bootstrap.cc:654] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.761195 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 9336e5b80c644ebcb75455770eb45d70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:57.761765 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.765079 1171 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.765245 1171 ts_tablet_manager.cc:1403] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260503 07:52:57.766156 1171 raft_consensus.cc:359] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.766340 1171 raft_consensus.cc:385] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.766433 1171 raft_consensus.cc:740] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:57.766660 715 leader_election.cc:343] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.766651 1171 consensus_queue.cc:260] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.766798 715 leader_election.cc:304] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.767154 1171 ts_tablet_manager.cc:1434] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:57.767416 1697 raft_consensus.cc:2749] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.767465 1171 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.768316 1173 ts_tablet_manager.cc:1950] T 0b9ff03fba3d4a1794a8a5b94caa9731 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:57.770949 1171 tablet_bootstrap.cc:654] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.774835 1716 raft_consensus.cc:493] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.775035 1716 raft_consensus.cc:515] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.775866 1716 leader_election.cc:290] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:57.777956 986 leader_election.cc:343] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:52:57.780200 1171 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.780361 1171 ts_tablet_manager.cc:1403] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260503 07:52:57.781103 1171 raft_consensus.cc:359] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.781291 1171 raft_consensus.cc:385] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.781371 1171 raft_consensus.cc:740] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.781675 1171 consensus_queue.cc:260] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.782943 1171 ts_tablet_manager.cc:1434] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:57.783900 1171 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.785708 1171 tablet_bootstrap.cc:654] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.786183 1697 raft_consensus.cc:493] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.786375 1697 raft_consensus.cc:515] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.786473 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eb2ad7619a4a9aabe8b8d062455390" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.787220 1697 leader_election.cc:290] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.787807 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.788081 1048 raft_consensus.cc:2468] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:57.788722 716 leader_election.cc:304] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:57.789109 1697 raft_consensus.cc:2804] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:57.789261 1697 raft_consensus.cc:493] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:57.789386 1697 raft_consensus.cc:3060] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.789353 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.790148 1767 raft_consensus.cc:493] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:57.790194 715 leader_election.cc:343] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.790341 1767 raft_consensus.cc:515] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.791184 1767 leader_election.cc:290] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.791559 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656dfeb5247e4cdfaacd29690353da83" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.791921 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656dfeb5247e4cdfaacd29690353da83" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:57.792132 715 leader_election.cc:343] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.792424 716 leader_election.cc:343] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.792563 716 leader_election.cc:304] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.792948 1767 raft_consensus.cc:2749] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.796862 1171 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.797012 1171 ts_tablet_manager.cc:1403] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.001s
I20260503 07:52:57.797905 1171 raft_consensus.cc:359] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.798135 1171 raft_consensus.cc:385] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.798226 1171 raft_consensus.cc:740] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.798503 1171 consensus_queue.cc:260] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.798892 1734 raft_consensus.cc:493] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.799086 1734 raft_consensus.cc:515] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.800413 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.800925 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dbfadef15548ec95e4db3725560ca9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.801505 1171 ts_tablet_manager.cc:1434] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:57.801849 1171 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.802627 1716 raft_consensus.cc:493] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.802791 1716 raft_consensus.cc:515] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.803428 1716 leader_election.cc:290] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:57.803934 1171 tablet_bootstrap.cc:654] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:57.805088 986 leader_election.cc:343] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: be15f49b155746d1924868d9f91e9206
W20260503 07:52:57.807807 988 leader_election.cc:343] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.807950 988 leader_election.cc:304] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.809486 1716 raft_consensus.cc:2749] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.822189 854 leader_election.cc:304] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.823422 1773 raft_consensus.cc:2749] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.828536 1697 raft_consensus.cc:515] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.829314 1697 leader_election.cc:290] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.830273 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:57.830464 1048 raft_consensus.cc:3060] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.830461 1734 leader_election.cc:290] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.823931 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be15f49b155746d1924868d9f91e9206" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:57.832471 1779 tablet.cc:1724] T 086c1b3968fd4ae4be703b72eaf05973 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:57.837622 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:57.841325 715 leader_election.cc:343] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.843386 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7b31b3076214d37a744faa4fa8d585b consensus state has no leader
I20260503 07:52:57.843811 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_698bd4594c51474d957b3e47aaa43b4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.847128 1697 raft_consensus.cc:493] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.847370 1697 raft_consensus.cc:515] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.848270 1697 leader_election.cc:290] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.849002 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.849097 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:57.849638 716 leader_election.cc:343] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:57.854912 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3be0ae78ada34cd88debca569b77d24a consensus state has no leader
I20260503 07:52:57.855314 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cdb84a65114d4a77be0516c1fbdeb6be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:57.860409 1734 raft_consensus.cc:493] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.860641 1734 raft_consensus.cc:515] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:57.862730 854 leader_election.cc:343] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 65fbd09bd319440cadcc84f1d55e7bde
I20260503 07:52:57.865906 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_dad6c6e91b084308a94abf81b5c120a3" } modify_external_catalogs: true
I20260503 07:52:57.866132 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_dad6c6e91b084308a94abf81b5c120a3" } modify_external_catalogs: true
W20260503 07:52:57.873519 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 057b62a991b74c859045a74df7dc716f consensus state has no leader
W20260503 07:52:57.873944 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f522dc5e8b12409eb9ed1a763d0db741 consensus state has no leader
I20260503 07:52:57.876096 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_564e5157ad4c4635936c429658c6c64b" } modify_external_catalogs: true
I20260503 07:52:57.876394 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_564e5157ad4c4635936c429658c6c64b" } modify_external_catalogs: true
I20260503 07:52:57.877238 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_14830acecf2946778bf6c51d9120b70d" } new_table_name: "default.Table_0479ecf60a7c44aeaa6094faa36237dc" modify_external_catalogs: true
I20260503 07:52:57.878978 1716 raft_consensus.cc:493] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.879192 1716 raft_consensus.cc:515] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.880117 1716 leader_election.cc:290] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:57.880216 1171 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.880496 1171 ts_tablet_manager.cc:1403] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.079s user 0.023s sys 0.036s
W20260503 07:52:57.881717 986 leader_election.cc:343] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8b84d41bdf374871a096d1dc30dd3543
I20260503 07:52:57.882021 1171 raft_consensus.cc:359] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.882413 1171 raft_consensus.cc:385] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.882536 1171 raft_consensus.cc:740] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.883148 1697 raft_consensus.cc:493] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.883102 1171 consensus_queue.cc:260] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.883301 1697 raft_consensus.cc:515] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.883970 1697 leader_election.cc:290] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:57.884610 1171 ts_tablet_manager.cc:1434] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260503 07:52:57.885056 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:57.885202 1171 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:57.885560 716 leader_election.cc:343] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.886581 1773 raft_consensus.cc:493] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.886806 1773 raft_consensus.cc:515] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.888827 1171 tablet_bootstrap.cc:654] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.889379 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:57.891057 988 leader_election.cc:343] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.891242 988 leader_election.cc:304] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.891983 1716 raft_consensus.cc:2749] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:57.893353 854 leader_election.cc:343] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: b77c5c6954554eac970d1e3fb1387c2b
W20260503 07:52:57.893659 715 leader_election.cc:343] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.893834 715 leader_election.cc:304] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.894327 1697 raft_consensus.cc:2749] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.900998 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 335) took 3528 ms. Trace:
I20260503 07:52:57.901142 1173 rpcz_store.cc:276] 0503 07:52:54.372335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.373652 (+ 1317us) service_pool.cc:224] Handling call
0503 07:52:57.582623 (+3208971us) ts_tablet_manager.cc:1151] Deleting tablet 0b9ff03fba3d4a1794a8a5b94caa9731
0503 07:52:57.582632 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.621873 (+ 39241us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.721545 (+ 99672us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:57.900958 (+179413us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205485}
I20260503 07:52:57.901646 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 338) took 3346 ms. Trace:
I20260503 07:52:57.901790 1173 rpcz_store.cc:276] 0503 07:52:54.555392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.555444 (+ 52us) service_pool.cc:224] Handling call
0503 07:52:57.901495 (+3346051us) ts_tablet_manager.cc:1151] Deleting tablet d8b0329a61dd4476bc0a65e90404efb4
0503 07:52:57.901507 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.901611 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3330065}
I20260503 07:52:57.902184 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 341) took 3346 ms. Trace:
I20260503 07:52:57.902297 1173 rpcz_store.cc:276] 0503 07:52:54.555894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.556037 (+ 143us) service_pool.cc:224] Handling call
0503 07:52:57.902053 (+3346016us) ts_tablet_manager.cc:1151] Deleting tablet 54bf46b34b1043e2ab6c9f8b2c871227
0503 07:52:57.902063 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.902154 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3324299}
I20260503 07:52:57.902710 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 371) took 3283 ms. Trace:
I20260503 07:52:57.902839 1173 rpcz_store.cc:276] 0503 07:52:54.619130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.876019 (+256889us) service_pool.cc:224] Handling call
0503 07:52:57.902558 (+3026539us) ts_tablet_manager.cc:1151] Deleting tablet 773fca453dac452abc723e49b70111b9
0503 07:52:57.902569 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.902677 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3026342}
I20260503 07:52:57.903187 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 372) took 3283 ms. Trace:
I20260503 07:52:57.903297 1173 rpcz_store.cc:276] 0503 07:52:54.620210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.876230 (+256020us) service_pool.cc:224] Handling call
0503 07:52:57.903064 (+3026834us) ts_tablet_manager.cc:1151] Deleting tablet 3650ec1de28c4f1bafd979257dd2b778
0503 07:52:57.903072 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.903155 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3026707}
I20260503 07:52:57.903642 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 374) took 3201 ms. Trace:
I20260503 07:52:57.903759 1173 rpcz_store.cc:276] 0503 07:52:54.702520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.877274 (+174754us) service_pool.cc:224] Handling call
0503 07:52:57.903515 (+3026241us) ts_tablet_manager.cc:1151] Deleting tablet 5ce16dd96cf04ae293601108381a2a47
0503 07:52:57.903525 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:57.903606 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3026076}
I20260503 07:52:57.904088 1173 tablet_replica.cc:333] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:57.904999 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 0b9ff03fba3d4a1794a8a5b94caa9731 (table default.Table_6fb564bf16234e23874093b62f3961c0 [id=16442f1d73a0449094fa45afffb69152]) successfully deleted
W20260503 07:52:57.905334 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d8b0329a61dd4476bc0a65e90404efb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b0329a61dd4476bc0a65e90404efb4 already in progress: creating tablet
W20260503 07:52:57.905578 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 54bf46b34b1043e2ab6c9f8b2c871227 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bf46b34b1043e2ab6c9f8b2c871227 already in progress: creating tablet
W20260503 07:52:57.905777 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 773fca453dac452abc723e49b70111b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 773fca453dac452abc723e49b70111b9 already in progress: creating tablet
W20260503 07:52:57.906044 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3650ec1de28c4f1bafd979257dd2b778 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3650ec1de28c4f1bafd979257dd2b778 already in progress: creating tablet
W20260503 07:52:57.906260 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5ce16dd96cf04ae293601108381a2a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce16dd96cf04ae293601108381a2a47 already in progress: creating tablet
W20260503 07:52:57.910938 715 leader_election.cc:343] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.911150 715 leader_election.cc:304] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.911693 1697 raft_consensus.cc:2749] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.912305 1734 leader_election.cc:290] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:57.913951 851 leader_election.cc:343] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 65fbd09bd319440cadcc84f1d55e7bde
I20260503 07:52:57.914104 851 leader_election.cc:304] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.914665 1773 leader_election.cc:290] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.914880 1773 raft_consensus.cc:2749] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.915246 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b84d41bdf374871a096d1dc30dd3543" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:57.916633 851 leader_election.cc:343] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:57.916783 851 leader_election.cc:304] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.917344 1734 raft_consensus.cc:2749] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.917640 1171 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.917953 1171 ts_tablet_manager.cc:1403] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.020s
I20260503 07:52:57.918838 1173 raft_consensus.cc:2243] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.919096 1173 raft_consensus.cc:2272] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.919401 1171 raft_consensus.cc:359] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.919796 1171 raft_consensus.cc:385] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.920207 1174 ts_tablet_manager.cc:1929] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.920135 1048 raft_consensus.cc:2468] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:57.920351 1174 log.cc:1199] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:52:57.920518 1171 raft_consensus.cc:740] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.920795 1174 ts_tablet_manager.cc:1950] T ed95a89bf4bc4b6fa72b224f49082423 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.921003 1171 consensus_queue.cc:260] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.921306 716 leader_election.cc:304] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:57.922034 1171 ts_tablet_manager.cc:1434] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:57.922572 1171 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.924304 1697 raft_consensus.cc:2804] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:57.924525 1697 raft_consensus.cc:697] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:57.924863 1697 consensus_queue.cc:237] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.926764 1173 ts_tablet_manager.cc:1916] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.926927 1171 tablet_bootstrap.cc:654] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.927762 1174 tablet_replica.cc:333] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:57.927982 1174 raft_consensus.cc:2243] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:57.928189 1174 raft_consensus.cc:2272] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:57.928745 1174 ts_tablet_manager.cc:1916] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:57.930040 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:44841
--webserver_interface=127.0.105.62
--webserver_port=39175
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260503 07:52:57.932430 988 leader_election.cc:343] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:57.932579 988 leader_election.cc:304] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.933156 1716 raft_consensus.cc:2749] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:57.943603 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9e78eb6d2a3489dbb15806dd93867a4 has no consensus state
I20260503 07:52:57.945569 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 086c1b3968fd4ae4be703b72eaf05973 (table default.Table_be722fc4ce8f434d88dff4dc553a1205 [id=61ea7b42555143188666f1400ff2bfbe]). Expected version 2 got 1
I20260503 07:52:57.946731 601 master_service.cc:954] ReplaceTablet: received request to replace tablet d8b0329a61dd4476bc0a65e90404efb4 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:57.957777 1734 raft_consensus.cc:493] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.957999 1734 raft_consensus.cc:515] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:57.958828 1734 leader_election.cc:290] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:57.959892 1171 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:57.960204 1171 ts_tablet_manager.cc:1403] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.008s
W20260503 07:52:57.961035 854 leader_election.cc:343] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 89572734813f4d28846ffe38868a15c3
W20260503 07:52:57.961396 851 leader_election.cc:343] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 89572734813f4d28846ffe38868a15c3
I20260503 07:52:57.961519 851 leader_election.cc:304] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:57.961907 1171 raft_consensus.cc:359] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.962116 1734 raft_consensus.cc:2749] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.962237 1171 raft_consensus.cc:385] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:57.962366 1171 raft_consensus.cc:740] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:57.962770 1171 consensus_queue.cc:260] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.964493 1171 ts_tablet_manager.cc:1434] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:52:57.965572 1171 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:57.967036 1716 raft_consensus.cc:493] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:57.967237 1716 raft_consensus.cc:515] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.969254 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dfcff75f90434caf7dc26408958a16" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:57.969528 779 raft_consensus.cc:2468] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:57.970129 986 leader_election.cc:304] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:57.970431 1724 raft_consensus.cc:2804] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:57.970574 1724 raft_consensus.cc:493] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:57.970678 1724 raft_consensus.cc:3060] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:57.973541 1171 tablet_bootstrap.cc:654] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.974840 1716 leader_election.cc:290] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:57.976516 1166 tablet_bootstrap.cc:654] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:57.994459 1174 ts_tablet_manager.cc:1929] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:57.994742 1174 log.cc:1199] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/2f0489d86704462ab237e5226df1251f
I20260503 07:52:57.995215 1174 ts_tablet_manager.cc:1950] T 2f0489d86704462ab237e5226df1251f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:57.998380 1724 raft_consensus.cc:515] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:57.999586 1724 leader_election.cc:290] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:58.000751 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dfcff75f90434caf7dc26408958a16" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:58.001017 779 raft_consensus.cc:3060] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.004595 1697 raft_consensus.cc:493] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.004782 1697 raft_consensus.cc:515] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.005622 1697 leader_election.cc:290] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.006237 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765ff6b70046f6a46aab3f413d04f8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.006669 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765ff6b70046f6a46aab3f413d04f8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.006886 716 leader_election.cc:343] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:58.009461 715 leader_election.cc:343] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.009687 715 leader_election.cc:304] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.010272 1767 raft_consensus.cc:2749] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.010602 1773 raft_consensus.cc:493] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.010814 1773 raft_consensus.cc:515] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.011621 1773 leader_election.cc:290] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.011703 1767 consensus_queue.cc:1048] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:58.011802 1773 raft_consensus.cc:493] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.011948 1773 raft_consensus.cc:515] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.012648 1773 leader_election.cc:290] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:58.014338 854 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 0e634f8f2aaf4456a64ced5049bdfe21
W20260503 07:52:58.014572 854 leader_election.cc:343] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 6ce0e09526eb4c9ba4b47c36e741702d
W20260503 07:52:58.015735 851 leader_election.cc:343] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:58.015934 851 leader_election.cc:304] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.016453 1734 raft_consensus.cc:2749] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.016924 1716 raft_consensus.cc:493] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.017184 1716 raft_consensus.cc:515] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.018033 1716 leader_election.cc:290] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:58.019637 851 leader_election.cc:343] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 6ce0e09526eb4c9ba4b47c36e741702d
I20260503 07:52:58.020035 851 leader_election.cc:304] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.020198 1174 tablet_replica.cc:333] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:58.020473 1174 raft_consensus.cc:2243] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.020582 1734 raft_consensus.cc:2749] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.020640 1174 raft_consensus.cc:2272] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.021267 1174 ts_tablet_manager.cc:1916] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:58.025040 986 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f407467a0c9c406faaa657ce70a1028b
I20260503 07:52:58.029714 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dfcff75f90434caf7dc26408958a16" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.030746 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dfcff75f90434caf7dc26408958a16" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:58.031581 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f407467a0c9c406faaa657ce70a1028b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.033175 988 leader_election.cc:343] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:58.034066 988 leader_election.cc:343] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:58.034668 988 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.034835 988 leader_election.cc:304] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.035465 1724 raft_consensus.cc:2749] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.037062 1697 raft_consensus.cc:493] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.037267 1697 raft_consensus.cc:515] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.038029 1697 leader_election.cc:290] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.038561 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efec3cb45daf44e59132ea4d8929bd43" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.038647 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efec3cb45daf44e59132ea4d8929bd43" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.038882 1697 raft_consensus.cc:493] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.039036 1697 raft_consensus.cc:515] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:58.039106 716 leader_election.cc:343] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.039693 1697 leader_election.cc:290] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:58.039983 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:58.040143 715 leader_election.cc:343] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.040297 715 leader_election.cc:304] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:58.040462 716 leader_election.cc:343] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.040859 1697 raft_consensus.cc:2749] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.040956 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.041479 715 leader_election.cc:343] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.041622 715 leader_election.cc:304] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.042027 1697 raft_consensus.cc:2749] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.041847 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_24dec90bc24e4a8a9103832658dfcfcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.052551 1734 raft_consensus.cc:493] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.052831 1734 raft_consensus.cc:515] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.053992 1734 leader_election.cc:290] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:58.055482 854 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 9336e5b80c644ebcb75455770eb45d70
W20260503 07:52:58.055687 851 leader_election.cc:343] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:58.055913 851 leader_election.cc:304] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.056421 1734 raft_consensus.cc:2749] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.059012 1697 raft_consensus.cc:493] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.059198 1697 raft_consensus.cc:515] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.059922 1697 leader_election.cc:290] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:58.062409 715 consensus_peers.cc:597] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.065878 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aeea6b4ead45ef82934811494cf263" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.066597 715 leader_election.cc:343] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.068295 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aeea6b4ead45ef82934811494cf263" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.068774 1048 raft_consensus.cc:2468] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:58.069308 716 leader_election.cc:304] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.069782 1697 raft_consensus.cc:2804] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:58.069870 1697 raft_consensus.cc:493] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:58.069959 1697 raft_consensus.cc:3060] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.083053 1697 raft_consensus.cc:515] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.083065 1174 ts_tablet_manager.cc:1929] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.083582 1174 log.cc:1199] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f11c020bd0484adfa6d7dae67818f7e5
I20260503 07:52:58.084064 1174 ts_tablet_manager.cc:1950] T f11c020bd0484adfa6d7dae67818f7e5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:58.084899 1697 leader_election.cc:290] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.085515 779 raft_consensus.cc:2468] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:58.085536 1734 raft_consensus.cc:493] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.085757 1734 raft_consensus.cc:515] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.086174 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aeea6b4ead45ef82934811494cf263" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:58.086467 1050 raft_consensus.cc:3060] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.086496 1734 leader_election.cc:290] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.091667 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1aeea6b4ead45ef82934811494cf263" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:58.092334 715 leader_election.cc:343] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.093014 986 leader_election.cc:304] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.093601 1724 raft_consensus.cc:2804] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:58.093845 1724 raft_consensus.cc:697] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:58.094259 1724 consensus_queue.cc:237] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:52:58.097610 851 leader_election.cc:343] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 96f7244292c3400dad2812e0adb162ef
I20260503 07:52:58.097813 917 raft_consensus.cc:3060] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.103408 1175 ts_tablet_manager.cc:1929] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.103672 1175 log.cc:1199] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/dda159becff6466abdcd84193f40a65e
I20260503 07:52:58.104254 1175 ts_tablet_manager.cc:1950] T dda159becff6466abdcd84193f40a65e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:58.105008 854 leader_election.cc:343] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 96f7244292c3400dad2812e0adb162ef
I20260503 07:52:58.105204 854 leader_election.cc:304] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.106341 1734 raft_consensus.cc:2749] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:57.725257 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8c4ec79454524d468c76fd01dec8eb1e (table default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]) successfully deleted
W20260503 07:52:58.120548 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 395250us
W20260503 07:52:58.121348 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_698bd4594c51474d957b3e47aaa43b4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.121984 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ed95a89bf4bc4b6fa72b224f49082423 (table default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]) successfully deleted
I20260503 07:52:58.122186 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 2f0489d86704462ab237e5226df1251f (table default.Table_f0a921f6b8344bbab898c35c3c59d1a2 [id=99ec5c91c64c44f4880574f176e882a4]) successfully deleted
W20260503 07:52:58.123018 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdb84a65114d4a77be0516c1fbdeb6be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.127740 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 2be28ad252ff47879caa1021fdf5db66 from {username='slave'} at 127.0.0.1:44308
W20260503 07:52:58.128158 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24dec90bc24e4a8a9103832658dfcfcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.132828 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a5f3d5305ab4390b83d2c3a51947d3a" } modify_external_catalogs: true
I20260503 07:52:58.133342 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a5f3d5305ab4390b83d2c3a51947d3a" } modify_external_catalogs: true
I20260503 07:52:58.136132 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_88245cee4c2545c4afc3a1859deb67db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.136937 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88245cee4c2545c4afc3a1859deb67db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.137956 1697 raft_consensus.cc:493] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.138685 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]) successfully deleted
I20260503 07:52:58.138255 1697 raft_consensus.cc:515] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.139469 1697 leader_election.cc:290] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:58.140450 986 consensus_peers.cc:597] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.141429 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb96ba84739c45b7847f0c43ab4a08e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.141454 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb96ba84739c45b7847f0c43ab4a08e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.141651 1048 raft_consensus.cc:2468] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:58.142058 716 leader_election.cc:304] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:58.142328 1697 raft_consensus.cc:2804] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:58.142401 1697 raft_consensus.cc:493] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:58.142493 1697 raft_consensus.cc:3060] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:58.142875 715 leader_election.cc:343] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.144496 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d05882184ada46ecbcceeb86e6c4862b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.147274 1767 raft_consensus.cc:493] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.147449 1767 raft_consensus.cc:515] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:58.147636 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d05882184ada46ecbcceeb86e6c4862b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.148105 1767 leader_election.cc:290] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.149256 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388c63dc20da408ca3e141ada0200be6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.149745 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388c63dc20da408ca3e141ada0200be6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:58.150282 716 leader_election.cc:343] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.150303 916 raft_consensus.cc:3060] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:58.151335 715 leader_election.cc:343] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.151490 715 leader_election.cc:304] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.151954 1767 raft_consensus.cc:2749] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.153118 1050 raft_consensus.cc:2468] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:58.153748 1697 raft_consensus.cc:515] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.155061 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb96ba84739c45b7847f0c43ab4a08e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:58.155804 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb96ba84739c45b7847f0c43ab4a08e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:58.155992 1048 raft_consensus.cc:3060] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.170018 1779 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260503 07:52:58.171077 715 leader_election.cc:343] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.171367 716 leader_election.cc:304] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.171744 1697 leader_election.cc:290] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.171955 1767 raft_consensus.cc:2804] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:52:58.178035 586 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d7b31b3076214d37a744faa4fa8d585b (table default.Table_399e3cb559dc48b69df2badacac96f6c [id=c92b3bc4731e4254b0c0ea4836119701], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7b31b3076214d37a744faa4fa8d585b consensus state has no leader
I20260503 07:52:58.178239 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_f397484bea66470d840ab901d70b6e51 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 2 got 0
I20260503 07:52:58.181061 1767 raft_consensus.cc:697] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:58.181514 1767 consensus_queue.cc:237] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.193089 1166 tablet_bootstrap.cc:492] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:58.193269 1166 ts_tablet_manager.cc:1403] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.502s user 0.002s sys 0.002s
I20260503 07:52:58.194248 1166 raft_consensus.cc:359] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.194449 1166 raft_consensus.cc:385] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.194535 1166 raft_consensus.cc:740] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.194808 1166 consensus_queue.cc:260] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.199498 1166 ts_tablet_manager.cc:1434] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:52:58.201211 592 master_service.cc:954] ReplaceTablet: received request to replace tablet b0f7b07d945c4726a77578987c22415d from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:58.201676 1166 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:58.207643 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b0f7b07d945c4726a77578987c22415d
I20260503 07:52:58.208158 592 catalog_manager.cc:6741] ReplaceTablet: tablet b0f7b07d945c4726a77578987c22415d deleted and replaced by tablet eccf6c7770554ba3861e4add2f7f180a
W20260503 07:52:58.208308 988 consensus_peers.cc:597] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.210510 879 tablet_service.cc:1558] Processing DeleteTablet for tablet b0f7b07d945c4726a77578987c22415d with delete_type TABLET_DATA_DELETED (replaced by tablet eccf6c7770554ba3861e4add2f7f180a) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.211127 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet b0f7b07d945c4726a77578987c22415d with delete_type TABLET_DATA_DELETED (replaced by tablet eccf6c7770554ba3861e4add2f7f180a) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.211589 1808 raft_consensus.cc:493] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.211755 1808 raft_consensus.cc:515] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.212577 1808 leader_election.cc:290] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.212874 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4ec79454524d468c76fd01dec8eb1e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.213357 988 leader_election.cc:343] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.216881 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b0f7b07d945c4726a77578987c22415d with delete_type TABLET_DATA_DELETED (replaced by tablet eccf6c7770554ba3861e4add2f7f180a) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.217175 1174 tablet_replica.cc:333] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:58.217368 1174 raft_consensus.cc:2243] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.217742 1174 raft_consensus.cc:2272] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.218372 1174 ts_tablet_manager.cc:1916] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.218921 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_515e4767dbc34f0a9305add1a1151aea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.219646 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_515e4767dbc34f0a9305add1a1151aea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:58.220091 986 leader_election.cc:343] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8c4ec79454524d468c76fd01dec8eb1e
I20260503 07:52:58.220245 986 leader_election.cc:304] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.220508 1724 raft_consensus.cc:2749] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.224123 1048 raft_consensus.cc:2468] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:58.225313 1175 tablet_replica.cc:333] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:58.225558 1175 raft_consensus.cc:2243] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.225565 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet dda159becff6466abdcd84193f40a65e (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:52:58.225767 1175 raft_consensus.cc:2272] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.226554 1175 ts_tablet_manager.cc:1916] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.230473 1779 tablet.cc:1719] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:52:58.236260 716 leader_election.cc:304] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.243546 1165 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:58.243706 1165 ts_tablet_manager.cc:1403] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.498s user 0.111s sys 0.220s
I20260503 07:52:58.244520 1165 raft_consensus.cc:359] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.244755 1165 raft_consensus.cc:385] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.244897 1173 ts_tablet_manager.cc:1929] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.244901 1165 raft_consensus.cc:740] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.245121 1173 log.cc:1199] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/295cfe6e7a7043b2905a6e90dd520002
I20260503 07:52:58.245209 1165 consensus_queue.cc:260] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.245523 1173 ts_tablet_manager.cc:1950] T 295cfe6e7a7043b2905a6e90dd520002 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:58.245533 1810 raft_consensus.cc:2804] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:58.245673 1810 raft_consensus.cc:697] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:58.245944 1810 consensus_queue.cc:237] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.248145 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_0c3ec91290084114899616ae3dcd851b [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 1 got 0
I20260503 07:52:58.248378 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_fba12625060d45f8822e66e12a8564c3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]). Expected version 1 got 0
I20260503 07:52:58.249158 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 6de27712304a49a9aaaeaff474e61f08 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.250490 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.250721 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.251965 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8d79df088f24420b99a9c984f9700e80 (DEFAULT_TABLE table=default.Table_99705f926f5747b9b2be64fbd6e1e16a [id=adfc04569e9c4aa38cfbbeb9b8c8dd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.252383 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.252750 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 (DEFAULT_TABLE table=default.Table_0479ecf60a7c44aeaa6094faa36237dc [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.254050 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 379) took 3495 ms. Trace:
I20260503 07:52:58.254172 1173 rpcz_store.cc:276] 0503 07:52:54.758703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.895592 (+136889us) service_pool.cc:224] Handling call
0503 07:52:57.904021 (+3008429us) ts_tablet_manager.cc:1151] Deleting tablet 295cfe6e7a7043b2905a6e90dd520002
0503 07:52:57.904031 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.045681 (+141650us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.244805 (+199124us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.253996 (+ 9191us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3008267}
I20260503 07:52:58.254549 1175 ts_tablet_manager.cc:1929] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.254685 1175 log.cc:1199] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c00976f3444c43618af30259f0567d17
I20260503 07:52:58.254791 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 380) took 3485 ms. Trace:
I20260503 07:52:58.254853 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6de27712304a49a9aaaeaff474e61f08 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.254873 1173 rpcz_store.cc:276] 0503 07:52:54.769351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.895764 (+126413us) service_pool.cc:224] Handling call
0503 07:52:58.254604 (+3358840us) ts_tablet_manager.cc:1151] Deleting tablet 568ccdf187eb4cae9688ff4929f3e95e
0503 07:52:58.254614 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.254726 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358705}
I20260503 07:52:58.255028 1175 ts_tablet_manager.cc:1950] T c00976f3444c43618af30259f0567d17 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:58.255399 750 tablet_service.cc:1511] Processing CreateTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 (DEFAULT_TABLE table=default.Table_0479ecf60a7c44aeaa6094faa36237dc [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.255458 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 382) took 3467 ms. Trace:
I20260503 07:52:58.255554 1173 rpcz_store.cc:276] 0503 07:52:54.787653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.896805 (+109152us) service_pool.cc:224] Handling call
0503 07:52:58.255269 (+3358464us) ts_tablet_manager.cc:1151] Deleting tablet 3cf72d49cfd24083abee07e0d2190e3e
0503 07:52:58.255282 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.255399 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358278}
I20260503 07:52:58.255836 744 tablet_service.cc:1511] Processing CreateTablet for tablet 8d79df088f24420b99a9c984f9700e80 (DEFAULT_TABLE table=default.Table_99705f926f5747b9b2be64fbd6e1e16a [id=adfc04569e9c4aa38cfbbeb9b8c8dd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.256229 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 383) took 3272 ms. Trace:
I20260503 07:52:58.256326 759 tablet_service.cc:1511] Processing CreateTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 (DEFAULT_TABLE table=default.Table_34a7397dcc2743f9bd22ca7aea4bf369 [id=142de16e25994f2c82f8841acc7e1d44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.256325 1173 rpcz_store.cc:276] 0503 07:52:54.983530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.983623 (+ 93us) service_pool.cc:224] Handling call
0503 07:52:58.256062 (+3272439us) ts_tablet_manager.cc:1151] Deleting tablet 722411278ae148d5b3d082d95683d12a
0503 07:52:58.256073 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.256163 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3228976}
I20260503 07:52:58.256785 742 tablet_service.cc:1511] Processing CreateTablet for tablet 0422b379bbf34a8e8773541f2336f477 (DEFAULT_TABLE table=default.Table_42447cd849da46668ce923e765d2bf6f [id=e10d6e3f5ddc4009bf4aa3398e63633f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.256820 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 385) took 3203 ms. Trace:
I20260503 07:52:58.256906 1173 rpcz_store.cc:276] 0503 07:52:55.053311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.053374 (+ 63us) service_pool.cc:224] Handling call
0503 07:52:58.256669 (+3203295us) ts_tablet_manager.cc:1151] Deleting tablet 4de65c754b47440a914f3f2bdb86059c
0503 07:52:58.256679 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.256769 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3195569}
I20260503 07:52:58.257392 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 384) took 3206 ms. Trace:
I20260503 07:52:58.257575 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d79df088f24420b99a9c984f9700e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.257485 1173 rpcz_store.cc:276] 0503 07:52:55.050526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.074319 (+ 23793us) service_pool.cc:224] Handling call
0503 07:52:58.257246 (+3182927us) ts_tablet_manager.cc:1151] Deleting tablet ea2683448c3f4df3bb0b14683d8b5222
0503 07:52:58.257256 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.257345 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3150535}
I20260503 07:52:58.257987 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 386) took 3059 ms. Trace:
I20260503 07:52:58.258155 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e78eb6d2a3489dbb15806dd93867a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.258086 1173 rpcz_store.cc:276] 0503 07:52:55.198212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.212486 (+ 14274us) service_pool.cc:224] Handling call
0503 07:52:58.257839 (+3045353us) ts_tablet_manager.cc:1151] Deleting tablet bf0f650d2efd4a5d9308952b32fa7d63
0503 07:52:58.257848 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.257934 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3044718}
I20260503 07:52:58.258664 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de27712304a49a9aaaeaff474e61f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.258893 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 387) took 2960 ms. Trace:
I20260503 07:52:58.258695 593 catalog_manager.cc:5671] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:58.258992 1173 rpcz_store.cc:276] 0503 07:52:55.297963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.298581 (+ 618us) service_pool.cc:224] Handling call
0503 07:52:58.258621 (+2960040us) ts_tablet_manager.cc:1151] Deleting tablet 5deea77f36d540bb8f721657b7e3500e
0503 07:52:58.258632 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.258719 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2952057}
I20260503 07:52:58.259195 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:58.259423 1173 tablet_replica.cc:333] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:58.259649 1173 raft_consensus.cc:2243] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.259872 1173 raft_consensus.cc:2272] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.260514 1173 ts_tablet_manager.cc:1916] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.263157 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 295cfe6e7a7043b2905a6e90dd520002 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
W20260503 07:52:58.263381 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 568ccdf187eb4cae9688ff4929f3e95e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ccdf187eb4cae9688ff4929f3e95e already in progress: creating tablet
W20260503 07:52:58.263587 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3cf72d49cfd24083abee07e0d2190e3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cf72d49cfd24083abee07e0d2190e3e already in progress: creating tablet
W20260503 07:52:58.263772 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 722411278ae148d5b3d082d95683d12a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 722411278ae148d5b3d082d95683d12a already in progress: creating tablet
I20260503 07:52:58.263706 880 tablet_service.cc:1511] Processing CreateTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 (DEFAULT_TABLE table=default.Table_0479ecf60a7c44aeaa6094faa36237dc [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:58.263938 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4de65c754b47440a914f3f2bdb86059c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de65c754b47440a914f3f2bdb86059c already in progress: creating tablet
I20260503 07:52:58.264053 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e78eb6d2a3489dbb15806dd93867a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:58.264079 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ea2683448c3f4df3bb0b14683d8b5222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2683448c3f4df3bb0b14683d8b5222 already in progress: creating tablet
I20260503 07:52:58.264506 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6de27712304a49a9aaaeaff474e61f08 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.264843 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de27712304a49a9aaaeaff474e61f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.266038 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 0422b379bbf34a8e8773541f2336f477 (DEFAULT_TABLE table=default.Table_42447cd849da46668ce923e765d2bf6f [id=e10d6e3f5ddc4009bf4aa3398e63633f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.266409 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0422b379bbf34a8e8773541f2336f477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.268435 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae (DEFAULT_TABLE table=default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb [id=2c6f70868c49417892c329788c89d1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.268502 885 tablet_service.cc:1511] Processing CreateTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 (DEFAULT_TABLE table=default.Table_34a7397dcc2743f9bd22ca7aea4bf369 [id=142de16e25994f2c82f8841acc7e1d44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.268750 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cca44c2622e4f9493d71e59fc3056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.268904 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04bceb67d194f21bab9e7aa790d5a04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:58.269344 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bf0f650d2efd4a5d9308952b32fa7d63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0f650d2efd4a5d9308952b32fa7d63 already in progress: creating tablet
W20260503 07:52:58.269565 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5deea77f36d540bb8f721657b7e3500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5deea77f36d540bb8f721657b7e3500e already in progress: creating tablet
I20260503 07:52:58.272410 886 tablet_service.cc:1511] Processing CreateTablet for tablet 0422b379bbf34a8e8773541f2336f477 (DEFAULT_TABLE table=default.Table_42447cd849da46668ce923e765d2bf6f [id=e10d6e3f5ddc4009bf4aa3398e63633f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.272807 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0422b379bbf34a8e8773541f2336f477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.272764 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 (DEFAULT_TABLE table=default.Table_34a7397dcc2743f9bd22ca7aea4bf369 [id=142de16e25994f2c82f8841acc7e1d44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.273095 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04bceb67d194f21bab9e7aa790d5a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.274602 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de27712304a49a9aaaeaff474e61f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.275108 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0422b379bbf34a8e8773541f2336f477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.275454 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d79df088f24420b99a9c984f9700e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.275856 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e78eb6d2a3489dbb15806dd93867a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.276319 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04bceb67d194f21bab9e7aa790d5a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.276554 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae (DEFAULT_TABLE table=default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb [id=2c6f70868c49417892c329788c89d1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.276886 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cca44c2622e4f9493d71e59fc3056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.280085 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.268500 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8d79df088f24420b99a9c984f9700e80 (DEFAULT_TABLE table=default.Table_99705f926f5747b9b2be64fbd6e1e16a [id=adfc04569e9c4aa38cfbbeb9b8c8dd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.281390 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d79df088f24420b99a9c984f9700e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.281456 917 raft_consensus.cc:3060] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.285012 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc695ff556240299788c02f416410c2 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.286722 746 tablet_service.cc:1511] Processing CreateTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae (DEFAULT_TABLE table=default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb [id=2c6f70868c49417892c329788c89d1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.287015 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc695ff556240299788c02f416410c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.289273 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cca44c2622e4f9493d71e59fc3056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.304782 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1bf42130a55744429d2c64ed55671507
I20260503 07:52:58.303799 1174 ts_tablet_manager.cc:1929] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:58.310392 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:58.311816 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.313225 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc695ff556240299788c02f416410c2 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.313656 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc695ff556240299788c02f416410c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.313781 1174 log.cc:1199] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b0f7b07d945c4726a77578987c22415d
I20260503 07:52:58.316691 1174 ts_tablet_manager.cc:1950] T b0f7b07d945c4726a77578987c22415d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:58.317265 880 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc695ff556240299788c02f416410c2 (DEFAULT_TABLE table=default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.317785 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc695ff556240299788c02f416410c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.317857 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b0f7b07d945c4726a77578987c22415d (table default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]) successfully deleted
I20260503 07:52:58.321342 1018 tablet_service.cc:1511] Processing CreateTablet for tablet d8534ccfdff5477982c94684277cbbfc (DEFAULT_TABLE table=default.Table_336d7539481842f8a51b034d94471e83 [id=2fd53ea98fe1453db2de8b9243cd8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.327198 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:58.329957 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 1bf42130a55744429d2c64ed55671507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bf42130a55744429d2c64ed55671507 already in progress: creating tablet
I20260503 07:52:58.330946 886 tablet_service.cc:1511] Processing CreateTablet for tablet 822c15b68f61466584eec0702196a5c5 (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.331394 885 tablet_service.cc:1511] Processing CreateTablet for tablet d8534ccfdff5477982c94684277cbbfc (DEFAULT_TABLE table=default.Table_336d7539481842f8a51b034d94471e83 [id=2fd53ea98fe1453db2de8b9243cd8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.331897 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.332036 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822c15b68f61466584eec0702196a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.332562 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_dbe658b698884e3ba4af466a1b26aca5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.332966 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7de9390d9cce4a0ab3ed232174f9ed0a" } new_table_name: "default.Table_569d7dd42684487a89c9749674c78b1a" modify_external_catalogs: true
W20260503 07:52:58.333184 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbe658b698884e3ba4af466a1b26aca5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.336145 742 tablet_service.cc:1511] Processing CreateTablet for tablet 822c15b68f61466584eec0702196a5c5 (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.336412 1165 ts_tablet_manager.cc:1434] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.093s user 0.003s sys 0.000s
I20260503 07:52:58.336987 761 tablet_service.cc:1511] Processing CreateTablet for tablet d8534ccfdff5477982c94684277cbbfc (DEFAULT_TABLE table=default.Table_336d7539481842f8a51b034d94471e83 [id=2fd53ea98fe1453db2de8b9243cd8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.336714 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822c15b68f61466584eec0702196a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.338577 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8534ccfdff5477982c94684277cbbfc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:58.339668 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.340401 1165 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.344313 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8534ccfdff5477982c94684277cbbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.344527 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c2004972429a49b78f1e276b92071cad" } new_table_name: "default.Table_0490dfca116c457eb695c2c2a3df990b" modify_external_catalogs: true
I20260503 07:52:58.346144 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 822c15b68f61466584eec0702196a5c5 (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.347471 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.348042 1808 raft_consensus.cc:493] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.351121 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ab33d15e70ec4856a15ed7c6175cd334
I20260503 07:52:58.352623 1023 tablet_service.cc:1511] Processing CreateTablet for tablet daa746af69854c00af24357a0d555513 (DEFAULT_TABLE table=default.Table_704725dd7d6349ce9fa1159720280ae3 [id=b71991f8fdb54a6e96891834a8c6c851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.353016 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822c15b68f61466584eec0702196a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.353610 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e3a65f762f5400397093e1d1f388077"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.353833 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 98e7006b4f9a48f58815ed3c8d2fea10 (DEFAULT_TABLE table=default.Table_2e7941983e7c4c108534b667ccb9d335 [id=2963c5f239f64b2eaf79a8f4946d6217]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:58.354187 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e3a65f762f5400397093e1d1f388077 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.356666 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 423d4178b5c040d5b12f0f225d112449 (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.357728 1032 tablet_service.cc:1511] Processing CreateTablet for tablet fd492fb40d4944e0bb1e1e7019570778 (DEFAULT_TABLE table=default.Table_b2dff38f4b794cd6a9f8449b7576447d [id=f66fe82cda22463dbae09663f924f6ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.358222 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 484) took 1110 ms. Trace:
I20260503 07:52:58.358536 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa746af69854c00af24357a0d555513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.359432 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e7006b4f9a48f58815ed3c8d2fea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.359469 1020 tablet_service.cc:1511] Processing CreateTablet for tablet ef0d8dca80f242b189f234634991a542 (DEFAULT_TABLE table=default.Table_806f5406fbdd4481879937bfc675fd46 [id=0938a8435c814a0a96101a3a3baa6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.359453 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.359853 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0d8dca80f242b189f234634991a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.360948 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.361874 1808 raft_consensus.cc:515] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.362234 1165 tablet_bootstrap.cc:654] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.362730 1808 leader_election.cc:290] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.363844 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae9ff227c8a49e8b9a85635ec59c805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.364675 1175 rpcz_store.cc:276] 0503 07:52:57.233905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.239949 (+ 6044us) service_pool.cc:224] Handling call
0503 07:52:58.225242 (+985293us) ts_tablet_manager.cc:1151] Deleting tablet c00976f3444c43618af30259f0567d17
0503 07:52:58.225250 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.230701 (+ 5451us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.254482 (+ 23781us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.344688 (+ 90206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":984989}
I20260503 07:52:58.366899 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c00976f3444c43618af30259f0567d17 (table default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]) successfully deleted
I20260503 07:52:58.366962 897 tablet_service.cc:1511] Processing CreateTablet for tablet daa746af69854c00af24357a0d555513 (DEFAULT_TABLE table=default.Table_704725dd7d6349ce9fa1159720280ae3 [id=b71991f8fdb54a6e96891834a8c6c851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.367853 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd492fb40d4944e0bb1e1e7019570778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.368346 884 tablet_service.cc:1511] Processing CreateTablet for tablet fd492fb40d4944e0bb1e1e7019570778 (DEFAULT_TABLE table=default.Table_b2dff38f4b794cd6a9f8449b7576447d [id=f66fe82cda22463dbae09663f924f6ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.369828 1697 raft_consensus.cc:493] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.369916 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.369995 1697 raft_consensus.cc:515] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.370591 1697 leader_election.cc:290] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.372612 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.373178 745 tablet_service.cc:1511] Processing CreateTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.373329 889 tablet_service.cc:1511] Processing CreateTablet for tablet ef0d8dca80f242b189f234634991a542 (DEFAULT_TABLE table=default.Table_806f5406fbdd4481879937bfc675fd46 [id=0938a8435c814a0a96101a3a3baa6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.373683 751 tablet_service.cc:1511] Processing CreateTablet for tablet ef0d8dca80f242b189f234634991a542 (DEFAULT_TABLE table=default.Table_806f5406fbdd4481879937bfc675fd46 [id=0938a8435c814a0a96101a3a3baa6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.373814 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8534ccfdff5477982c94684277cbbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.373795 744 tablet_service.cc:1511] Processing CreateTablet for tablet 98e7006b4f9a48f58815ed3c8d2fea10 (DEFAULT_TABLE table=default.Table_2e7941983e7c4c108534b667ccb9d335 [id=2963c5f239f64b2eaf79a8f4946d6217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.374605 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d4178b5c040d5b12f0f225d112449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.375140 759 tablet_service.cc:1511] Processing CreateTablet for tablet daa746af69854c00af24357a0d555513 (DEFAULT_TABLE table=default.Table_704725dd7d6349ce9fa1159720280ae3 [id=b71991f8fdb54a6e96891834a8c6c851]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.375840 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:58.376353 986 leader_election.cc:343] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: bf0f650d2efd4a5d9308952b32fa7d63
W20260503 07:52:58.376394 716 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.377534 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:52:58.378242 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f397484bea66470d840ab901d70b6e51" } new_table_name: "default.Table_ea61c565e9a54e118c4b0f1b52179e39" modify_external_catalogs: true
I20260503 07:52:58.378907 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.381145 1175 tablet_replica.cc:333] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:58.383701 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2be28ad252ff47879caa1021fdf5db66
I20260503 07:52:58.384465 1175 raft_consensus.cc:2243] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.384598 601 catalog_manager.cc:6741] ReplaceTablet: tablet 2be28ad252ff47879caa1021fdf5db66 deleted and replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6
I20260503 07:52:58.384555 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.384891 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.385994 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.385993 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.386847 750 tablet_service.cc:1511] Processing CreateTablet for tablet 423d4178b5c040d5b12f0f225d112449 (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.390270 752 tablet_service.cc:1511] Processing CreateTablet for tablet fd492fb40d4944e0bb1e1e7019570778 (DEFAULT_TABLE table=default.Table_b2dff38f4b794cd6a9f8449b7576447d [id=f66fe82cda22463dbae09663f924f6ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.390688 1175 raft_consensus.cc:2272] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.392288 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.392722 1175 ts_tablet_manager.cc:1916] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.391762 896 tablet_service.cc:1511] Processing CreateTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.396298 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.396869 715 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.396935 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.397006 715 leader_election.cc:304] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.397459 1697 raft_consensus.cc:2749] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.399175 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c5765ff6b70046f6a46aab3f413d04f8
I20260503 07:52:58.400471 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0c3ec91290084114899616ae3dcd851b" } new_table_name: "default.Table_09de7b363b1a4cbd8be93baba97b150c" modify_external_catalogs: true
W20260503 07:52:58.401006 593 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.1:41325 (request call id 89) took 893 ms (client timeout 1000 ms). Trace:
W20260503 07:52:58.401131 593 rpcz_store.cc:269] 0503 07:52:57.507742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.519594 (+ 11852us) service_pool.cc:224] Handling call
0503 07:52:57.553659 (+ 34065us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:52:58.400952 (+847293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:52:58.270707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:52:58.270822 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:52:58.270827 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:52:58.270829 (+ 2us) tablet.cc:662] Decoding operations
0503 07:52:58.270910 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:52:58.270918 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:52:58.270922 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:52:58.270964 (+ 42us) tablet.cc:701] Row locks acquired
0503 07:52:58.270966 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:52:58.270991 (+ 25us) write_op.cc:270] Start()
0503 07:52:58.271015 (+ 24us) write_op.cc:276] Timestamp: P: 1777794778270957 usec, L: 0
0503 07:52:58.271019 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:52:58.271141 (+ 122us) log.cc:844] Serialized 527 byte log entry
0503 07:52:58.303391 (+ 32250us) op_driver.cc:464] REPLICATION: finished
0503 07:52:58.304201 (+ 810us) write_op.cc:301] APPLY: starting
0503 07:52:58.304212 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0503 07:52:58.304256 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0503 07:52:58.304288 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:52:58.304325 (+ 37us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:52:58.304352 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:52:58.304373 (+ 21us) write_op.cc:312] APPLY: finished
0503 07:52:58.304435 (+ 62us) log.cc:844] Serialized 23 byte log entry
0503 07:52:58.304475 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:52:58.304489 (+ 14us) write_op.cc:454] Released schema lock
0503 07:52:58.304495 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 07:52:58.328432 (+ 23937us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:52:58.328438 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101938,"reported_tablets":4,"spinlock_wait_cycles":76903808,"child_traces":[["op",{"apply.queue_time_us":754,"apply.run_cpu_time_us":349,"apply.run_wall_time_us":349,"num_ops":1,"prepare.queue_time_us":10814,"prepare.run_cpu_time_us":672,"prepare.run_wall_time_us":57693,"raft.queue_time_us":2642,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":32358,"thread_start_us":57144,"threads_started":1}]]}
I20260503 07:52:58.402190 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e7c83fe022a34a8e810f1de1bb5e5523" } new_table_name: "default.Table_e4ae69024f594a199dc5ccabcf7cdddb" modify_external_catalogs: true
I20260503 07:52:58.403510 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e6fcade062b24ee280d4943d3254df03
I20260503 07:52:58.405308 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.405802 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.406097 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.406950 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae9ff227c8a49e8b9a85635ec59c805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.407943 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0f650d2efd4a5d9308952b32fa7d63" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.412397 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0d8dca80f242b189f234634991a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.416290 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0d8dca80f242b189f234634991a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.416328 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.419570 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:58.423264 988 leader_election.cc:343] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.423591 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e7006b4f9a48f58815ed3c8d2fea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.428402 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa746af69854c00af24357a0d555513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.431270 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d4178b5c040d5b12f0f225d112449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.431763 1165 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
W20260503 07:52:58.432595 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ab33d15e70ec4856a15ed7c6175cd334 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab33d15e70ec4856a15ed7c6175cd334 already in progress: creating tablet
W20260503 07:52:58.433074 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2be28ad252ff47879caa1021fdf5db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2be28ad252ff47879caa1021fdf5db66 already in progress: creating tablet
W20260503 07:52:58.433468 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 94cd6a702c59445882a81ca2e3a0f3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94cd6a702c59445882a81ca2e3a0f3f6 already in progress: creating tablet
I20260503 07:52:58.433768 1171 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.426323 988 leader_election.cc:304] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.433924 1171 ts_tablet_manager.cc:1403] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.469s user 0.028s sys 0.078s
I20260503 07:52:58.432314 1174 tablet_replica.cc:333] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:58.434770 1174 raft_consensus.cc:2243] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.435021 1174 raft_consensus.cc:2272] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.435720 1174 ts_tablet_manager.cc:1916] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.433967 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd492fb40d4944e0bb1e1e7019570778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.436820 1808 raft_consensus.cc:2749] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.436859 1171 raft_consensus.cc:359] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.437057 1171 raft_consensus.cc:385] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.426138 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.438084 1171 raft_consensus.cc:740] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.438334 1171 consensus_queue.cc:260] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:58.434355 891 tablet_service.cc:1511] Processing CreateTablet for tablet 423d4178b5c040d5b12f0f225d112449 (DEFAULT_TABLE table=default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.439366 1171 ts_tablet_manager.cc:1434] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:52:58.440142 1171 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.441929 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa746af69854c00af24357a0d555513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.442765 879 tablet_service.cc:1511] Processing CreateTablet for tablet 98e7006b4f9a48f58815ed3c8d2fea10 (DEFAULT_TABLE table=default.Table_2e7941983e7c4c108534b667ccb9d335 [id=2963c5f239f64b2eaf79a8f4946d6217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.443046 886 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.443403 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd492fb40d4944e0bb1e1e7019570778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.444016 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae9ff227c8a49e8b9a85635ec59c805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.445993 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e238863a7ff042de954787ef849a7c9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.447592 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b028017b7cc74ef6a199d6b9e0ba6e14 consensus state has no leader
I20260503 07:52:58.448724 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c165c4af7b3b4f99b92b64a3e9212fd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.449152 1171 tablet_bootstrap.cc:654] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.449870 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5f7e8f63b8a74a30b6305c5db547c630"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.450392 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f7e8f63b8a74a30b6305c5db547c630 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:58.450562 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e238863a7ff042de954787ef849a7c9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:58.453289 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c165c4af7b3b4f99b92b64a3e9212fd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.460374 885 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.462795 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4a245aa51e4d46388849d524124ea6ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.463269 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a245aa51e4d46388849d524124ea6ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.464375 1166 tablet_bootstrap.cc:654] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.465106 1175 ts_tablet_manager.cc:1929] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.465236 1175 log.cc:1199] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f407467a0c9c406faaa657ce70a1028b
I20260503 07:52:58.465605 1175 ts_tablet_manager.cc:1950] T f407467a0c9c406faaa657ce70a1028b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:58.466320 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 487) took 1209 ms. Trace:
I20260503 07:52:58.466437 1175 rpcz_store.cc:276] 0503 07:52:57.256562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.256762 (+ 200us) service_pool.cc:224] Handling call
0503 07:52:58.365947 (+1109185us) ts_tablet_manager.cc:1151] Deleting tablet f407467a0c9c406faaa657ce70a1028b
0503 07:52:58.365956 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.451036 (+ 85080us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.465017 (+ 13981us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.466284 (+ 1267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108896}
I20260503 07:52:58.466841 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f407467a0c9c406faaa657ce70a1028b (table default.Table_98bf34009bfe4112bc02fc3b4688a1f6 [id=2d52f50c360c42b9a8e1d679998e3478]) successfully deleted
I20260503 07:52:58.470250 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e7006b4f9a48f58815ed3c8d2fea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.470923 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d4178b5c040d5b12f0f225d112449. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:52:58.472110 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e36b8bb09d5849cea5ba5b67155b590a has no consensus state
I20260503 07:52:58.473440 1171 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.473659 1171 ts_tablet_manager.cc:1403] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.013s
I20260503 07:52:58.474261 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_93b4bdecd9754df4b30241cc36c107f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.474519 1171 raft_consensus.cc:359] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:58.474908 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93b4bdecd9754df4b30241cc36c107f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.483726 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_55cec2a278e54eb2931506731ca04e8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.484267 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55cec2a278e54eb2931506731ca04e8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.490284 1173 ts_tablet_manager.cc:1929] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.490407 1173 log.cc:1199] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/62ac84e88ebe478fb6200bb5052a8f84
I20260503 07:52:58.490792 1173 ts_tablet_manager.cc:1950] T 62ac84e88ebe478fb6200bb5052a8f84 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:58.491104 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 388) took 2993 ms. Trace:
I20260503 07:52:58.491219 1173 rpcz_store.cc:276] 0503 07:52:55.497436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.497793 (+ 357us) service_pool.cc:224] Handling call
0503 07:52:58.259340 (+2761547us) ts_tablet_manager.cc:1151] Deleting tablet 62ac84e88ebe478fb6200bb5052a8f84
0503 07:52:58.259350 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.329768 (+ 70418us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.490199 (+160431us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.491066 (+ 867us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2748985}
I20260503 07:52:58.492384 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 62ac84e88ebe478fb6200bb5052a8f84 (table default.Table_1c5b17831e3840c39a9fd9555ff84a2e [id=b7e5a7a0b554425daa66dd715b18adf5]) successfully deleted
I20260503 07:52:58.493306 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8c645c5277204399a1bb940f83954890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.493794 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c645c5277204399a1bb940f83954890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:58.498948 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8055ed2748e4a0e9ba1194c40afb5e2 consensus state has no leader
I20260503 07:52:58.499204 595 master_service.cc:954] ReplaceTablet: received request to replace tablet e63048335fe349ebb6001b37e63a389e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:58.500428 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 389) took 2942 ms. Trace:
I20260503 07:52:58.500558 1173 rpcz_store.cc:276] 0503 07:52:55.557826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.559160 (+ 1334us) service_pool.cc:224] Handling call
0503 07:52:58.500271 (+2941111us) ts_tablet_manager.cc:1151] Deleting tablet f54aaadc3d22437286303caac65c7cb4
0503 07:52:58.500280 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.500390 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2940877}
I20260503 07:52:58.500950 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 390) took 2930 ms. Trace:
W20260503 07:52:58.501039 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f54aaadc3d22437286303caac65c7cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54aaadc3d22437286303caac65c7cb4 already in progress: creating tablet
I20260503 07:52:58.501048 1173 rpcz_store.cc:276] 0503 07:52:55.570585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.576496 (+ 5911us) service_pool.cc:224] Handling call
0503 07:52:58.500815 (+2924319us) ts_tablet_manager.cc:1151] Deleting tablet fb821b329d284643a889b07f9a4f287e
0503 07:52:58.500823 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.500910 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924133}
I20260503 07:52:58.501293 1173 tablet_replica.cc:333] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:58.501492 1173 raft_consensus.cc:2243] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.501650 1173 raft_consensus.cc:2272] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.502161 1173 ts_tablet_manager.cc:1916] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:58.503988 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet fb821b329d284643a889b07f9a4f287e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb821b329d284643a889b07f9a4f287e already in progress: creating tablet
I20260503 07:52:58.504343 1166 tablet_bootstrap.cc:492] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:58.504482 1166 ts_tablet_manager.cc:1403] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.303s user 0.002s sys 0.002s
I20260503 07:52:58.505143 1166 raft_consensus.cc:359] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.505335 1166 raft_consensus.cc:385] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.505416 1166 raft_consensus.cc:740] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.505626 1166 consensus_queue.cc:260] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.508680 1166 ts_tablet_manager.cc:1434] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260503 07:52:58.515249 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7907a9cceaa443795275c9cbb62cb22 consensus state has no leader
I20260503 07:52:58.516796 1165 ts_tablet_manager.cc:1403] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.002s
I20260503 07:52:58.517551 1165 raft_consensus.cc:359] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.517927 1166 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:58.518462 1171 raft_consensus.cc:385] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.518751 1171 raft_consensus.cc:740] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.519007 1165 raft_consensus.cc:385] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.519095 1165 raft_consensus.cc:740] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.519541 916 raft_consensus.cc:3060] T ef0ad3ee6d1445b28ffc55ba93d57901 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.521149 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b4649a4c1b5548c68cb0c3d32f365a12" } modify_external_catalogs: true
I20260503 07:52:58.521323 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b4649a4c1b5548c68cb0c3d32f365a12" } modify_external_catalogs: true
I20260503 07:52:58.525266 1808 raft_consensus.cc:493] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.525311 1171 consensus_queue.cc:260] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.525615 1808 raft_consensus.cc:515] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.526115 1171 ts_tablet_manager.cc:1434] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260503 07:52:58.526260 1808 leader_election.cc:290] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.526983 1171 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.528280 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 489) took 1189 ms. Trace:
I20260503 07:52:58.528674 1175 rpcz_store.cc:276] 0503 07:52:57.339199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.339259 (+ 60us) service_pool.cc:224] Handling call
0503 07:52:58.518620 (+1179361us) ts_tablet_manager.cc:1151] Deleting tablet 8f6df58637e047ef9b696f22d7c43e48
0503 07:52:58.518631 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.528230 (+ 9599us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179089}
I20260503 07:52:58.529192 1171 tablet_bootstrap.cc:654] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:58.529332 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8f6df58637e047ef9b696f22d7c43e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f6df58637e047ef9b696f22d7c43e48 already in progress: creating tablet
I20260503 07:52:58.531401 1767 raft_consensus.cc:493] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.532819 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed95a89bf4bc4b6fa72b224f49082423" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.533730 1767 raft_consensus.cc:515] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.534799 1767 leader_election.cc:290] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:58.535605 1165 consensus_queue.cc:260] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.536213 1165 ts_tablet_manager.cc:1434] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260503 07:52:58.537097 1165 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.537251 1173 ts_tablet_manager.cc:1929] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.537381 1173 log.cc:1199] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8a45012e871b4c14a3fafb4443e1e92b
I20260503 07:52:58.537763 1173 ts_tablet_manager.cc:1950] T 8a45012e871b4c14a3fafb4443e1e92b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:58.538136 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 396) took 2753 ms. Trace:
I20260503 07:52:58.538233 1173 rpcz_store.cc:276] 0503 07:52:55.784868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.784914 (+ 46us) service_pool.cc:224] Handling call
0503 07:52:58.501235 (+2716321us) ts_tablet_manager.cc:1151] Deleting tablet 8a45012e871b4c14a3fafb4443e1e92b
0503 07:52:58.501243 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.505114 (+ 3871us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.537183 (+ 32069us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.538084 (+ 901us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716115}
I20260503 07:52:58.538641 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 398) took 2731 ms. Trace:
I20260503 07:52:58.538743 1173 rpcz_store.cc:276] 0503 07:52:55.807319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.807485 (+ 166us) service_pool.cc:224] Handling call
0503 07:52:58.538489 (+2731004us) ts_tablet_manager.cc:1151] Deleting tablet 8ffec630db9a430fa3006268b0e28fcd
0503 07:52:58.538498 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.538592 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2730748}
W20260503 07:52:58.539040 986 leader_election.cc:343] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:52:58.539103 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 399) took 2731 ms. Trace:
I20260503 07:52:58.539220 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8a45012e871b4c14a3fafb4443e1e92b (table default.Table_f3f0440daf4a4fe89f92e6c20afef7e5 [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:52:58.539171 1173 rpcz_store.cc:276] 0503 07:52:55.807435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.807787 (+ 352us) service_pool.cc:224] Handling call
0503 07:52:58.538943 (+2731156us) ts_tablet_manager.cc:1151] Deleting tablet ac8d392c3bb94f03819fae08fc009fbc
0503 07:52:58.538952 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.539048 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2730978}
W20260503 07:52:58.539371 988 leader_election.cc:343] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:58.539500 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8ffec630db9a430fa3006268b0e28fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffec630db9a430fa3006268b0e28fcd already in progress: creating tablet
I20260503 07:52:58.539534 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 397) took 2732 ms. Trace:
I20260503 07:52:58.539624 1173 rpcz_store.cc:276] 0503 07:52:55.807176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.807997 (+ 821us) service_pool.cc:224] Handling call
0503 07:52:58.539395 (+2731398us) ts_tablet_manager.cc:1151] Deleting tablet 92c1709a2a49475daaa2372360610b1e
0503 07:52:58.539404 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.539483 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2731262}
I20260503 07:52:58.540052 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 400) took 2723 ms. Trace:
I20260503 07:52:58.540179 1173 rpcz_store.cc:276] 0503 07:52:55.817009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.817056 (+ 47us) service_pool.cc:224] Handling call
0503 07:52:58.539883 (+2722827us) ts_tablet_manager.cc:1151] Deleting tablet db13f91ef1d740c387bacbb689ddf1a8
0503 07:52:58.539891 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.539984 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722655}
W20260503 07:52:58.540306 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ac8d392c3bb94f03819fae08fc009fbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac8d392c3bb94f03819fae08fc009fbc already in progress: creating tablet
W20260503 07:52:58.540527 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 92c1709a2a49475daaa2372360610b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92c1709a2a49475daaa2372360610b1e already in progress: creating tablet
I20260503 07:52:58.539968 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2b065666ec4f1299b47d45cd1f600b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.547137 1171 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:52:58.547183 716 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.547268 1171 ts_tablet_manager.cc:1403] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.009s
I20260503 07:52:58.539980 988 leader_election.cc:304] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.547936 1808 raft_consensus.cc:2749] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.548099 1171 raft_consensus.cc:359] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.548298 1171 raft_consensus.cc:385] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.548372 1171 raft_consensus.cc:740] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.539582 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 490) took 1187 ms. Trace:
I20260503 07:52:58.548573 1171 consensus_queue.cc:260] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.549088 1171 ts_tablet_manager.cc:1434] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:58.549403 1171 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.551266 1175 rpcz_store.cc:276] 0503 07:52:57.342227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.342431 (+ 204us) service_pool.cc:224] Handling call
0503 07:52:58.529773 (+1187342us) ts_tablet_manager.cc:1151] Deleting tablet c1c631d3da8f4ec29690c548097a454b
0503 07:52:58.529783 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.529903 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1187071}
I20260503 07:52:58.553068 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 491) took 1210 ms. Trace:
I20260503 07:52:58.553530 1175 rpcz_store.cc:276] 0503 07:52:57.342387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.342432 (+ 45us) service_pool.cc:224] Handling call
0503 07:52:58.552932 (+1210500us) ts_tablet_manager.cc:1151] Deleting tablet b2ef0e849f4d4eb299726b2b094a1dc3
0503 07:52:58.552941 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.553035 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27,"tablet-delete.queue_time_us":1210241}
I20260503 07:52:58.541821 1166 tablet_bootstrap.cc:654] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.545154 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2b065666ec4f1299b47d45cd1f600b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.560477 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet db13f91ef1d740c387bacbb689ddf1a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db13f91ef1d740c387bacbb689ddf1a8 already in progress: creating tablet
W20260503 07:52:58.561725 715 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.561858 715 leader_election.cc:304] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.562222 1697 raft_consensus.cc:2749] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.562812 1174 ts_tablet_manager.cc:1929] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.564420 1174 log.cc:1199] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/75dfcff75f90434caf7dc26408958a16
I20260503 07:52:58.564617 1173 tablet_replica.cc:333] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:58.564905 1173 raft_consensus.cc:2243] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.565199 1173 raft_consensus.cc:2272] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.565438 1165 tablet_bootstrap.cc:654] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.565797 1173 ts_tablet_manager.cc:1916] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.566262 1767 raft_consensus.cc:493] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.551569 1171 tablet_bootstrap.cc:654] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:58.559257 986 consensus_peers.cc:597] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0f7b07d945c4726a77578987c22415d. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:52:58.566702 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b2ef0e849f4d4eb299726b2b094a1dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2ef0e849f4d4eb299726b2b094a1dc3 already in progress: creating tablet
I20260503 07:52:58.567202 1175 tablet_replica.cc:333] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:58.567684 1175 raft_consensus.cc:2243] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:58.567914 1767 raft_consensus.cc:515] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.569937 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6c79b1104334de0b8cdd97f0a8f79ed" } modify_external_catalogs: true
I20260503 07:52:58.570114 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6c79b1104334de0b8cdd97f0a8f79ed" } modify_external_catalogs: true
I20260503 07:52:58.570762 1767 leader_election.cc:290] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:58.570979 1174 ts_tablet_manager.cc:1950] T 75dfcff75f90434caf7dc26408958a16 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:58.569260 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:58.571606 716 leader_election.cc:343] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.572064 1175 pending_rounds.cc:70] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:58.572302 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 75dfcff75f90434caf7dc26408958a16 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
I20260503 07:52:58.572590 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.573002 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e6fcade062b24ee280d4943d3254df03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6fcade062b24ee280d4943d3254df03 already in progress: creating tablet
W20260503 07:52:58.573638 715 leader_election.cc:343] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.573740 715 leader_election.cc:304] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.576733 1174 tablet_replica.cc:333] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:58.577067 1174 raft_consensus.cc:2243] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.577108 599 master_service.cc:954] ReplaceTablet: received request to replace tablet f11c020bd0484adfa6d7dae67818f7e5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:58.577353 1174 raft_consensus.cc:2272] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.577911 1174 ts_tablet_manager.cc:1916] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.578914 1175 pending_rounds.cc:77] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847407725998080 op_type: NO_OP noop_request { }
I20260503 07:52:58.582481 1175 raft_consensus.cc:2889] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:58.582846 1175 raft_consensus.cc:2272] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.583581 1175 ts_tablet_manager.cc:1916] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.587023 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2296ebfcda984fb7ab807952ca7e5991" } modify_external_catalogs: true
I20260503 07:52:58.587239 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2296ebfcda984fb7ab807952ca7e5991" } modify_external_catalogs: true
I20260503 07:52:58.592307 1808 raft_consensus.cc:493] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.592470 1808 raft_consensus.cc:515] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.593088 1808 leader_election.cc:290] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.593451 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.593798 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:58.594003 988 leader_election.cc:343] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.594026 779 raft_consensus.cc:2468] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:58.594475 986 leader_election.cc:304] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.594946 1808 raft_consensus.cc:2804] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:58.595027 1808 raft_consensus.cc:493] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:58.595117 1808 raft_consensus.cc:3060] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.597610 1808 raft_consensus.cc:515] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.598301 1808 leader_election.cc:290] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.598798 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:58.598964 779 raft_consensus.cc:3060] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.601940 779 raft_consensus.cc:2468] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:58.602391 986 leader_election.cc:304] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:58.602713 1808 raft_consensus.cc:2804] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:58.602990 1808 raft_consensus.cc:697] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:58.603266 1808 consensus_queue.cc:237] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.604241 1767 raft_consensus.cc:2749] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.609776 897 tablet_service.cc:1511] Processing CreateTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 (DEFAULT_TABLE table=default.Table_d05882184ada46ecbcceeb86e6c4862b [id=6447efccb67d498d909af233d569cb40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.610159 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9833d3b3bf174720b5da54e19ae8e015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.612527 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6da5a4c519a249ca90c466eab47aa00b (DEFAULT_TABLE table=default.Table_cdb84a65114d4a77be0516c1fbdeb6be [id=85c3b666dc2e4727a286a979be048d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.612910 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da5a4c519a249ca90c466eab47aa00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.615808 1173 ts_tablet_manager.cc:1929] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.615912 1173 log.cc:1199] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/741a28af9fe946db8c9305aa1dabe999
I20260503 07:52:58.616269 1173 ts_tablet_manager.cc:1950] T 741a28af9fe946db8c9305aa1dabe999 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:58.616586 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 401) took 2791 ms. Trace:
I20260503 07:52:58.616693 1173 rpcz_store.cc:276] 0503 07:52:55.825203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.825256 (+ 53us) service_pool.cc:224] Handling call
0503 07:52:58.564524 (+2739268us) ts_tablet_manager.cc:1151] Deleting tablet 741a28af9fe946db8c9305aa1dabe999
0503 07:52:58.564536 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.581474 (+ 16938us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.615726 (+ 34252us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.616543 (+ 817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739075}
I20260503 07:52:58.618955 891 tablet_service.cc:1511] Processing CreateTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 (DEFAULT_TABLE table=default.Table_515e4767dbc34f0a9305add1a1151aea [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.619316 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fc61b1b49045fbb9b6b0cb94b1d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.626256 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 (DEFAULT_TABLE table=default.Table_d05882184ada46ecbcceeb86e6c4862b [id=6447efccb67d498d909af233d569cb40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.626659 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 46dd100e06ff41be960b265b52d1c607 (DEFAULT_TABLE table=default.Table_88245cee4c2545c4afc3a1859deb67db [id=db3d2f6209bc495a94f1fe4b141fc46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.627866 1173 tablet_replica.cc:333] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:58.627875 1165 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:58.627956 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9833d3b3bf174720b5da54e19ae8e015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.628015 1165 ts_tablet_manager.cc:1403] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.092s user 0.006s sys 0.003s
I20260503 07:52:58.628082 1173 raft_consensus.cc:2243] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.628265 1173 raft_consensus.cc:2272] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.628794 1173 ts_tablet_manager.cc:1916] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.629313 1165 raft_consensus.cc:359] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.629498 1165 raft_consensus.cc:385] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.629572 1165 raft_consensus.cc:740] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.629817 1165 consensus_queue.cc:260] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.630259 1165 ts_tablet_manager.cc:1434] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:52:58.630610 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d647277295e42cdb65f45a619e63960" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:58.631477 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dd100e06ff41be960b265b52d1c607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.639773 1171 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.639942 1171 ts_tablet_manager.cc:1403] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.013s
I20260503 07:52:58.640767 1171 raft_consensus.cc:359] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.640949 1171 raft_consensus.cc:385] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.641011 1171 raft_consensus.cc:740] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.641271 1171 consensus_queue.cc:260] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.642022 1171 ts_tablet_manager.cc:1434] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:58.642779 1171 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.644423 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 741a28af9fe946db8c9305aa1dabe999 (table default.Table_1fa1310e53144f7a9abf9399919088b0 [id=af2f774026f042d28d54095e150fab4f]) successfully deleted
I20260503 07:52:58.645259 1171 tablet_bootstrap.cc:654] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.646107 1165 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.649062 1165 tablet_bootstrap.cc:654] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:58.651916 988 leader_election.cc:343] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.658779 1174 ts_tablet_manager.cc:1929] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.658998 1174 log.cc:1199] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c5765ff6b70046f6a46aab3f413d04f8
I20260503 07:52:58.662418 884 tablet_service.cc:1511] Processing CreateTablet for tablet 46dd100e06ff41be960b265b52d1c607 (DEFAULT_TABLE table=default.Table_88245cee4c2545c4afc3a1859deb67db [id=db3d2f6209bc495a94f1fe4b141fc46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.662879 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dd100e06ff41be960b265b52d1c607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.664237 1174 ts_tablet_manager.cc:1950] T c5765ff6b70046f6a46aab3f413d04f8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:58.664844 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 (DEFAULT_TABLE table=default.Table_515e4767dbc34f0a9305add1a1151aea [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.665251 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fc61b1b49045fbb9b6b0cb94b1d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.665230 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c5765ff6b70046f6a46aab3f413d04f8 (table default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]) successfully deleted
I20260503 07:52:58.668287 1175 ts_tablet_manager.cc:1929] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:58.668421 1175 log.cc:1199] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f11c020bd0484adfa6d7dae67818f7e5
I20260503 07:52:58.668797 1175 ts_tablet_manager.cc:1950] T f11c020bd0484adfa6d7dae67818f7e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:58.669565 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 492) took 1103 ms. Trace:
I20260503 07:52:58.669701 1175 rpcz_store.cc:276] 0503 07:52:57.565677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.566182 (+ 505us) service_pool.cc:224] Handling call
0503 07:52:58.567129 (+1000947us) ts_tablet_manager.cc:1151] Deleting tablet f11c020bd0484adfa6d7dae67818f7e5
0503 07:52:58.567140 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.617829 (+ 50689us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.668201 (+ 50372us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.669530 (+ 1329us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000691}
I20260503 07:52:58.669925 1175 tablet_replica.cc:333] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:58.670145 1175 raft_consensus.cc:2243] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.670288 1175 raft_consensus.cc:2272] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.670761 1175 ts_tablet_manager.cc:1916] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.672761 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]) successfully deleted
I20260503 07:52:58.676275 1165 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:58.676872 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac (DEFAULT_TABLE table=default.Table_698bd4594c51474d957b3e47aaa43b4f [id=a85678c9656b418fb8d93a6d3166bd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.677251 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e6193c682b44c5aec60cb6e64a7fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.677789 1171 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.677963 1171 ts_tablet_manager.cc:1403] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.002s
I20260503 07:52:58.679672 1165 ts_tablet_manager.cc:1403] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
I20260503 07:52:58.680339 1808 raft_consensus.cc:493] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.680471 1808 raft_consensus.cc:515] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.681134 1808 leader_election.cc:290] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.681356 1171 raft_consensus.cc:359] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.681509 1171 raft_consensus.cc:385] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.681588 1171 raft_consensus.cc:740] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.681804 1171 consensus_queue.cc:260] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:58.682130 986 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:52:58.682276 1171 ts_tablet_manager.cc:1434] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260503 07:52:58.682559 1171 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.683564 1165 raft_consensus.cc:359] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.683743 1165 raft_consensus.cc:385] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.683818 1165 raft_consensus.cc:740] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.686329 1165 consensus_queue.cc:260] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.689610 752 tablet_service.cc:1511] Processing CreateTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac (DEFAULT_TABLE table=default.Table_698bd4594c51474d957b3e47aaa43b4f [id=a85678c9656b418fb8d93a6d3166bd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.690004 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e6193c682b44c5aec60cb6e64a7fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.696875 761 tablet_service.cc:1511] Processing CreateTablet for tablet 46dd100e06ff41be960b265b52d1c607 (DEFAULT_TABLE table=default.Table_88245cee4c2545c4afc3a1859deb67db [id=db3d2f6209bc495a94f1fe4b141fc46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.708449 1166 tablet_bootstrap.cc:492] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:58.708614 1166 ts_tablet_manager.cc:1403] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.191s user 0.007s sys 0.005s
I20260503 07:52:58.708885 1767 consensus_queue.cc:1048] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:52:58.710994 715 consensus_peers.cc:597] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.711339 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 (DEFAULT_TABLE table=default.Table_d05882184ada46ecbcceeb86e6c4862b [id=6447efccb67d498d909af233d569cb40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.711715 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9833d3b3bf174720b5da54e19ae8e015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.715767 889 tablet_service.cc:1511] Processing CreateTablet for tablet e19e450241e44b19a038808fd4d32e66 (DEFAULT_TABLE table=default.Table_b4649a4c1b5548c68cb0c3d32f365a12 [id=3fae92253a774fe6a073200bd8a38b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.716271 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2c6d9dd87646ed9d1f86761f13f628" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:58.718222 988 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.718353 988 leader_election.cc:304] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.718725 1808 raft_consensus.cc:2749] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.715049 1830 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:58.724005 742 tablet_service.cc:1511] Processing CreateTablet for tablet e19e450241e44b19a038808fd4d32e66 (DEFAULT_TABLE table=default.Table_b4649a4c1b5548c68cb0c3d32f365a12 [id=3fae92253a774fe6a073200bd8a38b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.724293 1166 raft_consensus.cc:359] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.724435 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19e450241e44b19a038808fd4d32e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.724469 1166 raft_consensus.cc:385] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.724640 1166 raft_consensus.cc:740] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.724890 1166 consensus_queue.cc:260] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.726619 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dd100e06ff41be960b265b52d1c607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.725903 744 tablet_service.cc:1511] Processing CreateTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 (DEFAULT_TABLE table=default.Table_515e4767dbc34f0a9305add1a1151aea [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.730780 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fc61b1b49045fbb9b6b0cb94b1d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.733049 1173 ts_tablet_manager.cc:1929] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.733278 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19e450241e44b19a038808fd4d32e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.733901 879 tablet_service.cc:1511] Processing CreateTablet for tablet 817a6e4deeff411fb350ce25df1933ef (DEFAULT_TABLE table=default.Table_ea019acef54e44d98be52fab929136e9 [id=a67f2ffc07784fe1ae0babb5e5ee9935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.733968 742 tablet_service.cc:1511] Processing CreateTablet for tablet 817a6e4deeff411fb350ce25df1933ef (DEFAULT_TABLE table=default.Table_ea019acef54e44d98be52fab929136e9 [id=a67f2ffc07784fe1ae0babb5e5ee9935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.734355 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a6e4deeff411fb350ce25df1933ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.736673 1166 ts_tablet_manager.cc:1434] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260503 07:52:58.737325 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a6e4deeff411fb350ce25df1933ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.737607 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6da5a4c519a249ca90c466eab47aa00b (DEFAULT_TABLE table=default.Table_cdb84a65114d4a77be0516c1fbdeb6be [id=85c3b666dc2e4727a286a979be048d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.740127 1166 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:58.740491 1165 ts_tablet_manager.cc:1434] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260503 07:52:58.741245 1173 log.cc:1199] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/4d4d8dfc410a40ec825d8e45e07388f6
I20260503 07:52:58.740782 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da5a4c519a249ca90c466eab47aa00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.746088 1810 raft_consensus.cc:493] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.746284 1810 raft_consensus.cc:515] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.747511 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.747725 897 tablet_service.cc:1511] Processing CreateTablet for tablet b435d9b81275447189fba50c82258955 (DEFAULT_TABLE table=default.Table_c75f9f01238b4ea58157bb094224d6c0 [id=7d5a087b020243b19eed8c3cc7b172ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:58.747995 715 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.747400 1810 leader_election.cc:290] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:58.750516 1165 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.753060 1173 ts_tablet_manager.cc:1950] T 4d4d8dfc410a40ec825d8e45e07388f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:58.755539 752 tablet_service.cc:1511] Processing CreateTablet for tablet b435d9b81275447189fba50c82258955 (DEFAULT_TABLE table=default.Table_c75f9f01238b4ea58157bb094224d6c0 [id=7d5a087b020243b19eed8c3cc7b172ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.755944 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b435d9b81275447189fba50c82258955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.757043 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e19e450241e44b19a038808fd4d32e66 (DEFAULT_TABLE table=default.Table_b4649a4c1b5548c68cb0c3d32f365a12 [id=3fae92253a774fe6a073200bd8a38b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.757910 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:58.758638 1015 tablet_service.cc:1511] Processing CreateTablet for tablet b435d9b81275447189fba50c82258955 (DEFAULT_TABLE table=default.Table_c75f9f01238b4ea58157bb094224d6c0 [id=7d5a087b020243b19eed8c3cc7b172ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:58.759766 716 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.759897 716 leader_election.cc:304] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.762372 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b435d9b81275447189fba50c82258955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.762678 1810 raft_consensus.cc:2749] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.761144 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 6da5a4c519a249ca90c466eab47aa00b (DEFAULT_TABLE table=default.Table_cdb84a65114d4a77be0516c1fbdeb6be [id=85c3b666dc2e4727a286a979be048d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.766616 1018 tablet_service.cc:1511] Processing CreateTablet for tablet e36b8bb09d5849cea5ba5b67155b590a (DEFAULT_TABLE table=default.Table_0490dfca116c457eb695c2c2a3df990b [id=b7439d8936be452d809bdac4fbb6e60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.767549 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3421b6842944b7b5a3582b8c059837 (DEFAULT_TABLE table=default.Table_77fa641b22004fc287d8aabc52ead412 [id=25b2dd590c5f43e399747c40e04a2fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.769969 896 tablet_service.cc:1511] Processing CreateTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac (DEFAULT_TABLE table=default.Table_698bd4594c51474d957b3e47aaa43b4f [id=a85678c9656b418fb8d93a6d3166bd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.772650 1028 tablet_service.cc:1511] Processing CreateTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 (DEFAULT_TABLE table=default.Table_15b74a48b8224ee48f505600b02a9af9 [id=2cf7597d6c724c8c933538309adbb5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.773151 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19e450241e44b19a038808fd4d32e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.773144 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_fba12625060d45f8822e66e12a8564c3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]). Expected version 1 got 0
I20260503 07:52:58.773473 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]). Expected version 2 got 0
I20260503 07:52:58.773567 1165 tablet_bootstrap.cc:654] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.773692 598 catalog_manager.cc:5671] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:58.774256 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:58.774416 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
I20260503 07:52:58.774564 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:52:58.774816 598 catalog_manager.cc:5671] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:58.775168 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_09de7b363b1a4cbd8be93baba97b150c [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 2 got 0
I20260503 07:52:58.775398 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3421b6842944b7b5a3582b8c059837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.776087 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_34a7397dcc2743f9bd22ca7aea4bf369" } modify_external_catalogs: true
I20260503 07:52:58.776281 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_34a7397dcc2743f9bd22ca7aea4bf369" } modify_external_catalogs: true
I20260503 07:52:58.779703 745 tablet_service.cc:1511] Processing CreateTablet for tablet e36b8bb09d5849cea5ba5b67155b590a (DEFAULT_TABLE table=default.Table_0490dfca116c457eb695c2c2a3df990b [id=b7439d8936be452d809bdac4fbb6e60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.780750 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36b8bb09d5849cea5ba5b67155b590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.783313 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef30af01dc6f40b4b71f59b9cb7ffd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.788290 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36b8bb09d5849cea5ba5b67155b590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.792450 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b435d9b81275447189fba50c82258955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.796983 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 (DEFAULT_TABLE table=default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.797155 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 (DEFAULT_TABLE table=default.Table_b1386995480944aa9881fc68fcc03c6a [id=9e52d8ade083485388c1fafc4f1f4549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.797611 1020 tablet_service.cc:1511] Processing CreateTablet for tablet f77cc1370a434961ae9138cbb8c39d7b (DEFAULT_TABLE table=default.Table_24dec90bc24e4a8a9103832658dfcfcf [id=6dd1cefdb69f421ea74ffbb3c7a5b9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.798188 1031 tablet_service.cc:1511] Processing CreateTablet for tablet eccf6c7770554ba3861e4add2f7f180a (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.798768 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a762d4755fcb43dc82e2785313e86194 (DEFAULT_TABLE table=default.Table_3c4da1aaaa2e4aa3a54dc2bf7b85d8fd [id=8b4067e4b1c04488a0662fc76c43f92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.801734 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3421b6842944b7b5a3582b8c059837 (DEFAULT_TABLE table=default.Table_77fa641b22004fc287d8aabc52ead412 [id=25b2dd590c5f43e399747c40e04a2fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.802186 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3421b6842944b7b5a3582b8c059837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.802906 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6954ec38f7f742eaa7cc05af5b1432d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.803467 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a762d4755fcb43dc82e2785313e86194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.804037 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cc1370a434961ae9138cbb8c39d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.804584 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccf6c7770554ba3861e4add2f7f180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.804702 746 tablet_service.cc:1511] Processing CreateTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 (DEFAULT_TABLE table=default.Table_15b74a48b8224ee48f505600b02a9af9 [id=2cf7597d6c724c8c933538309adbb5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.805114 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c6b320f8c446a2bee7dc25af7f49c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.806675 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e054473f51a46658409679b60b4f097" } modify_external_catalogs: true
I20260503 07:52:58.806870 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e054473f51a46658409679b60b4f097" } modify_external_catalogs: true
I20260503 07:52:58.817227 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef30af01dc6f40b4b71f59b9cb7ffd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.818054 757 tablet_service.cc:1511] Processing CreateTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 (DEFAULT_TABLE table=default.Table_b1386995480944aa9881fc68fcc03c6a [id=9e52d8ade083485388c1fafc4f1f4549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.819339 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c6b320f8c446a2bee7dc25af7f49c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.824717 758 tablet_service.cc:1511] Processing CreateTablet for tablet f77cc1370a434961ae9138cbb8c39d7b (DEFAULT_TABLE table=default.Table_24dec90bc24e4a8a9103832658dfcfcf [id=6dd1cefdb69f421ea74ffbb3c7a5b9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.825791 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cc1370a434961ae9138cbb8c39d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.829945 741 tablet_service.cc:1511] Processing CreateTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 (DEFAULT_TABLE table=default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.830426 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6954ec38f7f742eaa7cc05af5b1432d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.832912 743 tablet_service.cc:1511] Processing CreateTablet for tablet eccf6c7770554ba3861e4add2f7f180a (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.833425 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccf6c7770554ba3861e4add2f7f180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.842410 752 tablet_service.cc:1511] Processing CreateTablet for tablet a762d4755fcb43dc82e2785313e86194 (DEFAULT_TABLE table=default.Table_3c4da1aaaa2e4aa3a54dc2bf7b85d8fd [id=8b4067e4b1c04488a0662fc76c43f92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.842875 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a762d4755fcb43dc82e2785313e86194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.773383 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 817a6e4deeff411fb350ce25df1933ef (DEFAULT_TABLE table=default.Table_ea019acef54e44d98be52fab929136e9 [id=a67f2ffc07784fe1ae0babb5e5ee9935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.850209 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a6e4deeff411fb350ce25df1933ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.773945 1171 tablet_bootstrap.cc:654] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:58.856380 986 consensus_peers.cc:597] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75dfcff75f90434caf7dc26408958a16. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.774672 1831 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:58.860520 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da5a4c519a249ca90c466eab47aa00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.861232 1171 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.861407 1171 ts_tablet_manager.cc:1403] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.179s user 0.002s sys 0.001s
I20260503 07:52:58.862844 1171 raft_consensus.cc:359] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.863083 1171 raft_consensus.cc:385] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.863168 1171 raft_consensus.cc:740] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.863497 1171 consensus_queue.cc:260] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.864552 880 tablet_service.cc:1511] Processing CreateTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 (DEFAULT_TABLE table=default.Table_15b74a48b8224ee48f505600b02a9af9 [id=2cf7597d6c724c8c933538309adbb5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.864905 1171 ts_tablet_manager.cc:1434] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260503 07:52:58.865062 889 tablet_service.cc:1511] Processing CreateTablet for tablet e36b8bb09d5849cea5ba5b67155b590a (DEFAULT_TABLE table=default.Table_0490dfca116c457eb695c2c2a3df990b [id=b7439d8936be452d809bdac4fbb6e60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.866741 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 402) took 2851 ms. Trace:
I20260503 07:52:58.866891 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3421b6842944b7b5a3582b8c059837 (DEFAULT_TABLE table=default.Table_77fa641b22004fc287d8aabc52ead412 [id=25b2dd590c5f43e399747c40e04a2fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.868906 1724 raft_consensus.cc:493] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.873593 1834 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:58.874352 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e6193c682b44c5aec60cb6e64a7fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.874512 1173 rpcz_store.cc:276] 0503 07:52:55.902788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:55.902841 (+ 53us) service_pool.cc:224] Handling call
0503 07:52:58.627804 (+2724963us) ts_tablet_manager.cc:1151] Deleting tablet 4d4d8dfc410a40ec825d8e45e07388f6
0503 07:52:58.627813 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.715675 (+ 87862us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.726024 (+ 10349us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.754069 (+ 28045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2724741}
I20260503 07:52:58.875979 1724 raft_consensus.cc:515] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.876530 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 4d4d8dfc410a40ec825d8e45e07388f6 (table default.Table_0b06a748faa64b029ec876cdcfc0478f [id=27c0ca8e039e4316b8878cbe7df0ddb0]) successfully deleted
I20260503 07:52:58.876641 1724 leader_election.cc:290] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.876701 885 tablet_service.cc:1511] Processing CreateTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 (DEFAULT_TABLE table=default.Table_b1386995480944aa9881fc68fcc03c6a [id=9e52d8ade083485388c1fafc4f1f4549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.877331 886 tablet_service.cc:1511] Processing CreateTablet for tablet f77cc1370a434961ae9138cbb8c39d7b (DEFAULT_TABLE table=default.Table_24dec90bc24e4a8a9103832658dfcfcf [id=6dd1cefdb69f421ea74ffbb3c7a5b9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.878937 895 tablet_service.cc:1511] Processing CreateTablet for tablet eccf6c7770554ba3861e4add2f7f180a (DEFAULT_TABLE table=default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.879279 894 tablet_service.cc:1511] Processing CreateTablet for tablet a762d4755fcb43dc82e2785313e86194 (DEFAULT_TABLE table=default.Table_3c4da1aaaa2e4aa3a54dc2bf7b85d8fd [id=8b4067e4b1c04488a0662fc76c43f92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.879562 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 (DEFAULT_TABLE table=default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:58.879766 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.880610 1166 tablet_bootstrap.cc:654] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:58.883157 988 leader_election.cc:343] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.883067 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 422) took 2348 ms. Trace:
I20260503 07:52:58.884337 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:58.884961 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:58.884653 715 consensus_peers.cc:597] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.884137 1173 rpcz_store.cc:276] 0503 07:52:56.528464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.528517 (+ 53us) service_pool.cc:224] Handling call
0503 07:52:58.874966 (+2346449us) ts_tablet_manager.cc:1151] Deleting tablet cc7a0272fdc34044af78ba21b6ca31bc
0503 07:52:58.874976 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.876600 (+ 1624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2345288}
W20260503 07:52:58.886327 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cc7a0272fdc34044af78ba21b6ca31bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc7a0272fdc34044af78ba21b6ca31bc already in progress: creating tablet
I20260503 07:52:58.886734 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c6b320f8c446a2bee7dc25af7f49c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.886926 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a762d4755fcb43dc82e2785313e86194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.886950 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:58.888523 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef30af01dc6f40b4b71f59b9cb7ffd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.890539 776 raft_consensus.cc:2468] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:58.892329 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccf6c7770554ba3861e4add2f7f180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.892566 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6954ec38f7f742eaa7cc05af5b1432d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.893110 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cc1370a434961ae9138cbb8c39d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.899893 1171 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.901846 1165 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:58.902112 1165 ts_tablet_manager.cc:1403] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.152s user 0.008s sys 0.000s
I20260503 07:52:58.904394 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 423) took 2360 ms. Trace:
I20260503 07:52:58.904497 1173 rpcz_store.cc:276] 0503 07:52:56.543554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.544129 (+ 575us) service_pool.cc:224] Handling call
0503 07:52:58.886645 (+2342516us) ts_tablet_manager.cc:1151] Deleting tablet 2ad24ddc82bd401fb5427e7415af3922
0503 07:52:58.886652 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.904339 (+ 17687us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2341822}
I20260503 07:52:58.904940 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 424) took 2347 ms. Trace:
I20260503 07:52:58.905032 1173 rpcz_store.cc:276] 0503 07:52:56.557539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.559532 (+ 1993us) service_pool.cc:224] Handling call
0503 07:52:58.904789 (+2345257us) ts_tablet_manager.cc:1151] Deleting tablet 1cdca8ec33a144e2b44cd9a0c0d61d93
0503 07:52:58.904798 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.904886 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2339620}
W20260503 07:52:58.905134 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2ad24ddc82bd401fb5427e7415af3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ad24ddc82bd401fb5427e7415af3922 already in progress: creating tablet
I20260503 07:52:58.905319 1173 tablet_replica.cc:333] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:58.905505 1173 raft_consensus.cc:2243] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:58.905498 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 already in progress: creating tablet
I20260503 07:52:58.905675 1173 raft_consensus.cc:2272] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.906163 1173 ts_tablet_manager.cc:1916] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.911473 1175 ts_tablet_manager.cc:1929] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.909416 986 leader_election.cc:304] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.914443 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36b8bb09d5849cea5ba5b67155b590a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.914475 594 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:52:58.915341 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9872574717e846d9a7ef117ac6a2b8b7" } new_table_name: "default.Table_66fac03a66604b56b59ac48cbec5670b" modify_external_catalogs: true
I20260503 07:52:58.916899 1724 raft_consensus.cc:493] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.917040 1724 raft_consensus.cc:515] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.917563 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3421b6842944b7b5a3582b8c059837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:58.917645 1724 leader_election.cc:290] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:58.918813 986 leader_election.cc:343] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 2f0489d86704462ab237e5226df1251f
I20260503 07:52:58.919319 1175 log.cc:1199] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/be15f49b155746d1924868d9f91e9206
I20260503 07:52:58.919875 1175 ts_tablet_manager.cc:1950] T be15f49b155746d1924868d9f91e9206 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:58.920327 988 consensus_peers.cc:597] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:58.920622 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0489d86704462ab237e5226df1251f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.920982 1716 raft_consensus.cc:2804] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:58.921299 1716 raft_consensus.cc:493] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:58.921420 1716 raft_consensus.cc:3060] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:58.922622 988 leader_election.cc:343] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.922739 988 leader_election.cc:304] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:58.922964 1724 raft_consensus.cc:2749] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:58.924269 1171 tablet_bootstrap.cc:654] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.927619 1165 raft_consensus.cc:359] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.928978 1165 raft_consensus.cc:385] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.929144 1165 raft_consensus.cc:740] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.931077 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e63048335fe349ebb6001b37e63a389e
I20260503 07:52:58.931574 595 catalog_manager.cc:6741] ReplaceTablet: tablet e63048335fe349ebb6001b37e63a389e deleted and replaced by tablet 78b3210d1ecd42198e080b02a8b594a5
I20260503 07:52:58.931746 1165 consensus_queue.cc:260] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.932238 1165 ts_tablet_manager.cc:1434] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260503 07:52:58.932731 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e63048335fe349ebb6001b37e63a389e with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3210d1ecd42198e080b02a8b594a5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.932946 1174 tablet_replica.cc:333] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:58.933143 1174 raft_consensus.cc:2243] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.933287 1174 raft_consensus.cc:2272] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.934003 1174 ts_tablet_manager.cc:1916] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:58.936960 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer 65adddd546eb49779519c7f7378d0e60 (127.0.105.62:44841): Couldn't send request to peer 65adddd546eb49779519c7f7378d0e60. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.62:44841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 07:52:58.939314 885 tablet_service.cc:1558] Processing DeleteTablet for tablet e63048335fe349ebb6001b37e63a389e with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3210d1ecd42198e080b02a8b594a5) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:58.939595 1174 ts_tablet_manager.cc:1929] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:58.941264 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 493) took 1283 ms. Trace:
I20260503 07:52:58.942162 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e63048335fe349ebb6001b37e63a389e with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3210d1ecd42198e080b02a8b594a5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.943791 1716 raft_consensus.cc:515] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.944806 1716 leader_election.cc:290] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.945677 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:58.942286 1175 rpcz_store.cc:276] 0503 07:52:57.640577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.640651 (+ 74us) service_pool.cc:224] Handling call
0503 07:52:58.669886 (+1029235us) ts_tablet_manager.cc:1151] Deleting tablet be15f49b155746d1924868d9f91e9206
0503 07:52:58.669892 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.706656 (+ 36764us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.881566 (+174910us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:58.924077 (+ 42511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1860,"tablet-delete.queue_time_us":1028915}
W20260503 07:52:58.946355 988 leader_election.cc:343] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.946617 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet be15f49b155746d1924868d9f91e9206 (table default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
I20260503 07:52:58.945058 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:58.947096 1165 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.947297 776 raft_consensus.cc:3060] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.950177 776 raft_consensus.cc:2468] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:58.951503 1174 log.cc:1199] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e63048335fe349ebb6001b37e63a389e
I20260503 07:52:58.951952 1174 ts_tablet_manager.cc:1950] T e63048335fe349ebb6001b37e63a389e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:58.953397 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e63048335fe349ebb6001b37e63a389e (table default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]) successfully deleted
I20260503 07:52:58.954944 986 leader_election.cc:304] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:58.955626 1716 raft_consensus.cc:2804] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:58.956070 1716 raft_consensus.cc:697] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:58.956367 1716 consensus_queue.cc:237] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.957347 1165 tablet_bootstrap.cc:654] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.958340 1175 tablet_replica.cc:333] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:58.960534 1171 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:58.960683 1171 ts_tablet_manager.cc:1403] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.002s
I20260503 07:52:58.961544 1175 raft_consensus.cc:2243] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:58.962628 1175 raft_consensus.cc:2272] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:58.964891 1171 raft_consensus.cc:359] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.965086 1171 raft_consensus.cc:385] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.966408 1830 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:58.968937 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e19e450241e44b19a038808fd4d32e66
I20260503 07:52:58.970425 752 tablet_service.cc:1558] Processing DeleteTablet for tablet e19e450241e44b19a038808fd4d32e66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:58.970467 885 tablet_service.cc:1558] Processing DeleteTablet for tablet e19e450241e44b19a038808fd4d32e66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:58.971071 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e19e450241e44b19a038808fd4d32e66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19e450241e44b19a038808fd4d32e66 already in progress: creating tablet
I20260503 07:52:58.971583 1166 tablet_bootstrap.cc:492] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:58.971786 1166 ts_tablet_manager.cc:1403] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.235s user 0.007s sys 0.000s
I20260503 07:52:58.972412 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_00bf13f51cb2470783a5ec5fd0300ab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:58.972553 1166 raft_consensus.cc:359] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.972754 1166 raft_consensus.cc:385] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.972815 1166 raft_consensus.cc:740] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.972860 1165 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:58.973012 1165 ts_tablet_manager.cc:1403] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260503 07:52:58.973006 1171 raft_consensus.cc:740] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:58.973042 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00bf13f51cb2470783a5ec5fd0300ab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:58.973047 1724 raft_consensus.cc:493] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:58.973162 1724 raft_consensus.cc:515] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.973239 1171 consensus_queue.cc:260] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.974140 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:58.974404 1175 ts_tablet_manager.cc:1916] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:58.974392 779 raft_consensus.cc:2468] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:58.974680 1171 ts_tablet_manager.cc:1434] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260503 07:52:58.974732 1724 leader_election.cc:290] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:58.974802 986 leader_election.cc:304] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:58.975003 1171 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:58.973804 1165 raft_consensus.cc:359] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.975386 1165 raft_consensus.cc:385] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:58.975469 1165 raft_consensus.cc:740] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:58.975639 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:58.976222 1165 consensus_queue.cc:260] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:58.976783 988 leader_election.cc:343] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:58.976935 1165 ts_tablet_manager.cc:1434] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260503 07:52:58.977770 1724 raft_consensus.cc:2804] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:58.978407 1724 raft_consensus.cc:493] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:58.978546 1724 raft_consensus.cc:3060] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:58.981318 1831 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:52:58.982470 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet e19e450241e44b19a038808fd4d32e66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:58.983546 1165 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:58.986045 1165 tablet_bootstrap.cc:654] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:58.993587 1166 consensus_queue.cc:260] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:58.994220 1166 ts_tablet_manager.cc:1434] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260503 07:52:58.994568 1166 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.001609 1165 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.001778 1165 ts_tablet_manager.cc:1403] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260503 07:52:59.002480 1165 raft_consensus.cc:359] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.002641 1165 raft_consensus.cc:385] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.002719 1165 raft_consensus.cc:740] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.002923 1165 consensus_queue.cc:260] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.005404 1165 ts_tablet_manager.cc:1434] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:59.005815 1165 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.007625 1165 tablet_bootstrap.cc:654] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.014884 1173 ts_tablet_manager.cc:1929] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.015023 1173 log.cc:1199] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/0e634f8f2aaf4456a64ced5049bdfe21
I20260503 07:52:59.018561 1166 tablet_bootstrap.cc:654] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.020079 1173 ts_tablet_manager.cc:1950] T 0e634f8f2aaf4456a64ced5049bdfe21 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.020437 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 425) took 2434 ms. Trace:
I20260503 07:52:59.020565 1173 rpcz_store.cc:276] 0503 07:52:56.586334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.586717 (+ 383us) service_pool.cc:224] Handling call
0503 07:52:58.905241 (+2318524us) ts_tablet_manager.cc:1151] Deleting tablet 0e634f8f2aaf4456a64ced5049bdfe21
0503 07:52:58.905253 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:58.968290 (+ 63037us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.014797 (+ 46507us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.020404 (+ 5607us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2318363}
I20260503 07:52:59.021070 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 0e634f8f2aaf4456a64ced5049bdfe21 (table default.Table_157ae3f1f274402c9578a83a27a09e8a [id=5f833ec515f14fea86f74d703325e51c]) successfully deleted
I20260503 07:52:59.021535 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 426) took 2431 ms. Trace:
I20260503 07:52:59.021703 1173 rpcz_store.cc:276] 0503 07:52:56.590462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.592704 (+ 2242us) service_pool.cc:224] Handling call
0503 07:52:59.021389 (+2428685us) ts_tablet_manager.cc:1151] Deleting tablet f7654a4a85b6441f9d36527ced775aa2
0503 07:52:59.021400 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.021503 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2428415}
W20260503 07:52:59.022277 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f7654a4a85b6441f9d36527ced775aa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7654a4a85b6441f9d36527ced775aa2 already in progress: creating tablet
I20260503 07:52:59.022658 1173 tablet_replica.cc:333] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.023342 1173 raft_consensus.cc:2243] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.023578 1173 raft_consensus.cc:2272] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.024261 1173 ts_tablet_manager.cc:1916] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.028659 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bce8073c9aa549f3b9ee0397984c350b
I20260503 07:52:59.029588 1165 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.029757 1165 ts_tablet_manager.cc:1403] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.007s
I20260503 07:52:59.030282 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bce8073c9aa549f3b9ee0397984c350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.030429 752 tablet_service.cc:1558] Processing DeleteTablet for tablet bce8073c9aa549f3b9ee0397984c350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:59.031028 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bce8073c9aa549f3b9ee0397984c350b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bce8073c9aa549f3b9ee0397984c350b already in progress: creating tablet
I20260503 07:52:59.031476 1171 tablet_bootstrap.cc:654] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.031958 1165 raft_consensus.cc:359] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.032579 1165 raft_consensus.cc:385] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.032694 1165 raft_consensus.cc:740] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.033047 1166 tablet_bootstrap.cc:492] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.033048 1165 consensus_queue.cc:260] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.033218 1166 ts_tablet_manager.cc:1403] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260503 07:52:59.033952 1166 raft_consensus.cc:359] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.034130 1166 raft_consensus.cc:385] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.034231 1166 raft_consensus.cc:740] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.034505 1166 consensus_queue.cc:260] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.035478 1166 ts_tablet_manager.cc:1434] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:59.036423 1165 ts_tablet_manager.cc:1434] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:52:59.037334 1165 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.038102 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fba12625060d45f8822e66e12a8564c3" } new_table_name: "default.Table_380ccf69fa8943d6ac4c87a883a25068" modify_external_catalogs: true
I20260503 07:52:59.038985 1165 tablet_bootstrap.cc:654] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.036571 1166 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.043859 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet bce8073c9aa549f3b9ee0397984c350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.054050 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 053b644e68e04a80966f374883170221
I20260503 07:52:59.054651 599 master_service.cc:954] ReplaceTablet: received request to replace tablet b5bdaa3dd3a844d8b57def2b9faa03d8 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.057003 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 053b644e68e04a80966f374883170221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:59.057785 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 053b644e68e04a80966f374883170221 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 053b644e68e04a80966f374883170221 already in progress: creating tablet
I20260503 07:52:59.058522 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0587fb3c8fde478f986d1a87b3f0d543"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.059113 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0587fb3c8fde478f986d1a87b3f0d543 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.061137 1724 raft_consensus.cc:515] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.062533 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:59.063673 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 053b644e68e04a80966f374883170221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:52:59.065296 988 leader_election.cc:343] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.066139 1166 tablet_bootstrap.cc:654] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.066224 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da9549389254875b94268abc5c3bb3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.066910 779 raft_consensus.cc:3060] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.067830 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 053b644e68e04a80966f374883170221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.069173 1810 consensus_queue.cc:1048] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:59.069684 779 raft_consensus.cc:2468] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.070462 986 leader_election.cc:304] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.071147 1724 leader_election.cc:290] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.071923 1173 ts_tablet_manager.cc:1929] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.072113 1173 log.cc:1199] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/3b8a6c13c0ab45f0ae784e1ab352a0bc
I20260503 07:52:59.075569 1724 raft_consensus.cc:2804] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.075749 1724 raft_consensus.cc:697] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.076319 1724 consensus_queue.cc:237] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.080796 1166 tablet_bootstrap.cc:492] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.081091 1166 ts_tablet_manager.cc:1403] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260503 07:52:59.082141 1166 raft_consensus.cc:359] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.082336 1166 raft_consensus.cc:385] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.082414 1166 raft_consensus.cc:740] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.082834 1173 ts_tablet_manager.cc:1950] T 3b8a6c13c0ab45f0ae784e1ab352a0bc P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.083720 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 427) took 2458 ms. Trace:
I20260503 07:52:59.083841 1173 rpcz_store.cc:276] 0503 07:52:56.625253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.628245 (+ 2992us) service_pool.cc:224] Handling call
0503 07:52:59.022593 (+2394348us) ts_tablet_manager.cc:1151] Deleting tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc
0503 07:52:59.022604 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.068481 (+ 45877us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.071839 (+ 3358us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.083495 (+ 11656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2393044}
I20260503 07:52:59.084290 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 3b8a6c13c0ab45f0ae784e1ab352a0bc (table default.Table_ae34e18001ee40e8b15584b8091515f4 [id=d2169ca8a5c5407db9158eae0bd86bfd]) successfully deleted
I20260503 07:52:59.084676 1166 consensus_queue.cc:260] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.088263 1166 ts_tablet_manager.cc:1434] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260503 07:52:59.089187 1166 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.093288 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 438) took 2164 ms. Trace:
I20260503 07:52:59.094316 1810 raft_consensus.cc:493] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.094646 1810 raft_consensus.cc:515] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.096482 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67387c8aba1f4d728b3691c5da720e4d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.097225 1173 rpcz_store.cc:276] 0503 07:52:56.929024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.929147 (+ 123us) service_pool.cc:224] Handling call
0503 07:52:59.092567 (+2163420us) ts_tablet_manager.cc:1151] Deleting tablet 855100ffa19d4fe7a92ae13ca5171adb
0503 07:52:59.092580 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.093233 (+ 653us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2143381}
W20260503 07:52:59.098109 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 855100ffa19d4fe7a92ae13ca5171adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 855100ffa19d4fe7a92ae13ca5171adb already in progress: creating tablet
W20260503 07:52:59.098654 715 leader_election.cc:343] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.099126 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 439) took 2152 ms. Trace:
I20260503 07:52:59.099215 1173 rpcz_store.cc:276] 0503 07:52:56.946230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.946305 (+ 75us) service_pool.cc:224] Handling call
0503 07:52:59.098467 (+2152162us) ts_tablet_manager.cc:1151] Deleting tablet 23ff4e3f16c1413c858ed955c77497c9
0503 07:52:59.098477 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.099074 (+ 597us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149092}
W20260503 07:52:59.099810 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 23ff4e3f16c1413c858ed955c77497c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23ff4e3f16c1413c858ed955c77497c9 already in progress: creating tablet
I20260503 07:52:59.100226 1166 tablet_bootstrap.cc:654] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.098907 1810 leader_election.cc:290] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.106084 596 catalog_manager.cc:5671] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:59.107002 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_fba12625060d45f8822e66e12a8564c3 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]). Expected version 1 got 0
I20260503 07:52:59.107573 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 440) took 2139 ms. Trace:
I20260503 07:52:59.107686 1173 rpcz_store.cc:276] 0503 07:52:56.967687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.967973 (+ 286us) service_pool.cc:224] Handling call
0503 07:52:59.107422 (+2139449us) ts_tablet_manager.cc:1151] Deleting tablet fa97597fa7a1435995f13e189db1f3fa
0503 07:52:59.107432 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.107523 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139155}
W20260503 07:52:59.108282 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet fa97597fa7a1435995f13e189db1f3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa97597fa7a1435995f13e189db1f3fa already in progress: creating tablet
I20260503 07:52:59.108777 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 441) took 2140 ms. Trace:
I20260503 07:52:59.108886 1173 rpcz_store.cc:276] 0503 07:52:56.967899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:56.968300 (+ 401us) service_pool.cc:224] Handling call
0503 07:52:59.108571 (+2140271us) ts_tablet_manager.cc:1151] Deleting tablet c1c1b04c89a64f8d9429203c46894d39
0503 07:52:59.108583 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.108702 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140056}
W20260503 07:52:59.109460 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c1c1b04c89a64f8d9429203c46894d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1c1b04c89a64f8d9429203c46894d39 already in progress: creating tablet
I20260503 07:52:59.109817 1173 tablet_replica.cc:333] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.110061 1173 raft_consensus.cc:2243] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.110252 1173 raft_consensus.cc:2272] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.110921 1173 ts_tablet_manager.cc:1916] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.117866 1166 tablet_bootstrap.cc:492] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.118036 1166 ts_tablet_manager.cc:1403] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260503 07:52:59.118800 1166 raft_consensus.cc:359] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.118969 1166 raft_consensus.cc:385] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.119055 1166 raft_consensus.cc:740] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.119107 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e04bceb67d194f21bab9e7aa790d5a04
I20260503 07:52:59.119306 1166 consensus_queue.cc:260] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.119911 897 tablet_service.cc:1558] Processing DeleteTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.120404 1166 ts_tablet_manager.cc:1434] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260503 07:52:59.120831 752 tablet_service.cc:1558] Processing DeleteTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.121114 1166 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:59.121752 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e04bceb67d194f21bab9e7aa790d5a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e04bceb67d194f21bab9e7aa790d5a04 already in progress: creating tablet
I20260503 07:52:59.126461 1166 tablet_bootstrap.cc:654] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.126976 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42447cd849da46668ce923e765d2bf6f" } new_table_name: "default.Table_18c1b7fdcbb24350ab6e740fd46f6fb5" modify_external_catalogs: true
I20260503 07:52:59.135489 1173 ts_tablet_manager.cc:1929] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.135620 1173 log.cc:1199] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/be381bee559841bfb90a4d2ce8c4fa5f
I20260503 07:52:59.136078 1173 ts_tablet_manager.cc:1950] T be381bee559841bfb90a4d2ce8c4fa5f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.141896 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f5896bb71c674358957c87a347b8fb79
I20260503 07:52:59.143095 897 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.143159 752 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:59.143905 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f5896bb71c674358957c87a347b8fb79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5896bb71c674358957c87a347b8fb79 already in progress: creating tablet
I20260503 07:52:59.147843 1165 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.147971 1165 ts_tablet_manager.cc:1403] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.014s
I20260503 07:52:59.148722 1165 raft_consensus.cc:359] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.148938 1165 raft_consensus.cc:385] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.149029 1165 raft_consensus.cc:740] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.149248 1166 tablet_bootstrap.cc:492] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.149448 1166 ts_tablet_manager.cc:1403] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260503 07:52:59.150552 1166 raft_consensus.cc:359] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.150822 1166 raft_consensus.cc:385] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.150766 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_28f49895d1f749fc903b0abd23078009" } new_table_name: "default.Table_17f168c46dea4d82a0beacb34d4387a1" modify_external_catalogs: true
I20260503 07:52:59.150955 1166 raft_consensus.cc:740] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.151202 1166 consensus_queue.cc:260] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.151790 1166 ts_tablet_manager.cc:1434] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:59.156013 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e04bceb67d194f21bab9e7aa790d5a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.160445 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 9e162006cee34182b51f97629a174509 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.160683 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 442) took 2104 ms. Trace:
I20260503 07:52:59.152136 1166 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.160809 1173 rpcz_store.cc:276] 0503 07:52:57.056469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.056531 (+ 62us) service_pool.cc:224] Handling call
0503 07:52:59.109724 (+2053193us) ts_tablet_manager.cc:1151] Deleting tablet be381bee559841bfb90a4d2ce8c4fa5f
0503 07:52:59.109742 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.114263 (+ 4521us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.135394 (+ 21131us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.160642 (+ 25248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2045333}
I20260503 07:52:59.163609 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.163878 1173 tablet_replica.cc:333] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.164070 1173 raft_consensus.cc:2243] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.164664 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet be381bee559841bfb90a4d2ce8c4fa5f (table default.Table_9ca0504ccfb247419d00883fe78b7fac [id=f40f3bc626a84df480b4bffad73755d0]) successfully deleted
I20260503 07:52:59.164753 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67387c8aba1f4d728b3691c5da720e4d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:59.165423 716 leader_election.cc:343] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.165551 716 leader_election.cc:304] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.165758 1173 raft_consensus.cc:2272] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.165941 1810 raft_consensus.cc:2749] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.166294 1173 ts_tablet_manager.cc:1916] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.166886 1165 consensus_queue.cc:260] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.167444 1165 ts_tablet_manager.cc:1434] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20260503 07:52:59.168120 1166 tablet_bootstrap.cc:654] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.170713 1716 raft_consensus.cc:493] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:52:59.179971 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f4446badf064ecabc01b330f3babde2 consensus state has no leader
W20260503 07:52:59.181002 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a7907a9cceaa443795275c9cbb62cb22 (table default.Table_e4ae69024f594a199dc5ccabcf7cdddb [id=040b2bdef1584c959f5b5f1f2eaa8429], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a7907a9cceaa443795275c9cbb62cb22 consensus state has no leader
I20260503 07:52:59.187953 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4a3b06105ee840a190bc1378c02837cb" } new_table_name: "default.Table_a043996e2db248e59da337f4eb243320" modify_external_catalogs: true
I20260503 07:52:59.190608 1165 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.191682 1767 raft_consensus.cc:493] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.191833 1767 raft_consensus.cc:515] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.192526 1767 leader_election.cc:290] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.192498 1716 raft_consensus.cc:515] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.193205 1716 leader_election.cc:290] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.193185 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.194024 715 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.194355 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765ff6b70046f6a46aab3f413d04f8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.197992 1175 ts_tablet_manager.cc:1929] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.198627 1175 log.cc:1199] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8b84d41bdf374871a096d1dc30dd3543
I20260503 07:52:59.199208 1173 ts_tablet_manager.cc:1929] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.199376 1173 log.cc:1199] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/5dce60ad6aea4465a4ce04ea62bceb13
I20260503 07:52:59.199790 1173 ts_tablet_manager.cc:1950] T 5dce60ad6aea4465a4ce04ea62bceb13 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.200701 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 446) took 2068 ms. Trace:
I20260503 07:52:59.200827 1173 rpcz_store.cc:276] 0503 07:52:57.132529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.132583 (+ 54us) service_pool.cc:224] Handling call
0503 07:52:59.163822 (+2031239us) ts_tablet_manager.cc:1151] Deleting tablet 5dce60ad6aea4465a4ce04ea62bceb13
0503 07:52:59.163830 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.173034 (+ 9204us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.199127 (+ 26093us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.200642 (+ 1515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2031015}
I20260503 07:52:59.202591 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_ea61c565e9a54e118c4b0f1b52179e39 [id=0a3183eb2a7d4d9ebe87627bc031f95c] alter complete (version 3)
W20260503 07:52:59.197453 988 leader_election.cc:343] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:59.205106 986 leader_election.cc:343] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c5765ff6b70046f6a46aab3f413d04f8
I20260503 07:52:59.204999 1697 consensus_queue.cc:1048] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:59.206499 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c72daa9502084bff9445da8f6a6715ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.207082 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72daa9502084bff9445da8f6a6715ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.208246 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 451) took 2011 ms. Trace:
I20260503 07:52:59.208405 1840 raft_consensus.cc:493] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.208384 1173 rpcz_store.cc:276] 0503 07:52:57.196713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.197123 (+ 410us) service_pool.cc:224] Handling call
0503 07:52:59.208061 (+2010938us) ts_tablet_manager.cc:1151] Deleting tablet d58deacb99c643d89a6641ef09b026ba
0503 07:52:59.208074 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.208198 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2010748}
W20260503 07:52:59.208918 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d58deacb99c643d89a6641ef09b026ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d58deacb99c643d89a6641ef09b026ba already in progress: creating tablet
I20260503 07:52:59.208581 1840 raft_consensus.cc:515] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.209998 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.210817 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.210839 716 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.210916 986 leader_election.cc:304] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.210954 716 leader_election.cc:304] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.211277 1697 raft_consensus.cc:2749] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.211572 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 452) took 2014 ms. Trace:
I20260503 07:52:59.211580 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.211798 779 raft_consensus.cc:2468] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:52:59.213307 988 leader_election.cc:343] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.213591 1840 leader_election.cc:290] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.213588 986 leader_election.cc:304] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.213994 1840 raft_consensus.cc:2804] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.214108 1840 raft_consensus.cc:493] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.214195 1840 raft_consensus.cc:3060] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.214948 1175 ts_tablet_manager.cc:1950] T 8b84d41bdf374871a096d1dc30dd3543 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.215385 1848 raft_consensus.cc:2749] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.219129 1840 raft_consensus.cc:515] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.220152 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:59.212026 1173 rpcz_store.cc:276] 0503 07:52:57.196828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.197348 (+ 520us) service_pool.cc:224] Handling call
0503 07:52:59.210864 (+2013516us) ts_tablet_manager.cc:1151] Deleting tablet cac435b09639484ca1ae82f3d4990d48
0503 07:52:59.210871 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.211508 (+ 637us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2013344}
I20260503 07:52:59.220477 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 495) took 1566 ms. Trace:
W20260503 07:52:59.220897 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cac435b09639484ca1ae82f3d4990d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cac435b09639484ca1ae82f3d4990d48 already in progress: creating tablet
I20260503 07:52:59.221345 1175 rpcz_store.cc:276] 0503 07:52:57.651501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.651562 (+ 61us) service_pool.cc:224] Handling call
0503 07:52:58.946253 (+1294691us) ts_tablet_manager.cc:1151] Deleting tablet 8b84d41bdf374871a096d1dc30dd3543
0503 07:52:58.946262 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.059029 (+112767us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.157225 (+ 98196us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.217949 (+ 60724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1294424}
I20260503 07:52:59.221658 1175 tablet_replica.cc:333] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.221602 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 453) took 2024 ms. Trace:
I20260503 07:52:59.221647 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be42428a60142ca99f48e592a29070f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.221843 779 raft_consensus.cc:3060] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.221746 1173 rpcz_store.cc:276] 0503 07:52:57.196924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.197552 (+ 628us) service_pool.cc:224] Handling call
0503 07:52:59.221412 (+2023860us) ts_tablet_manager.cc:1151] Deleting tablet bf51c959093d4579a5916c49e1790737
0503 07:52:59.221426 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.221553 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2023706}
I20260503 07:52:59.221894 1175 raft_consensus.cc:2243] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.222043 1175 raft_consensus.cc:2272] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:59.222272 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bf51c959093d4579a5916c49e1790737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf51c959093d4579a5916c49e1790737 already in progress: creating tablet
W20260503 07:52:59.222575 988 leader_election.cc:343] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.222856 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8b84d41bdf374871a096d1dc30dd3543 (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
I20260503 07:52:59.224869 779 raft_consensus.cc:2468] T 3be42428a60142ca99f48e592a29070f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.225283 1840 leader_election.cc:290] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.228289 1175 ts_tablet_manager.cc:1916] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.228755 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 454) took 2031 ms. Trace:
I20260503 07:52:59.228848 1173 rpcz_store.cc:276] 0503 07:52:57.197070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.197736 (+ 666us) service_pool.cc:224] Handling call
0503 07:52:59.228569 (+2030833us) ts_tablet_manager.cc:1151] Deleting tablet 956600f557b84dac98be63ffe14f4e19
0503 07:52:59.228579 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.228694 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030672}
W20260503 07:52:59.229331 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 956600f557b84dac98be63ffe14f4e19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956600f557b84dac98be63ffe14f4e19 already in progress: creating tablet
I20260503 07:52:59.229421 986 leader_election.cc:304] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:59.230758 1801 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:52:59.231204 1801 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 07:52:59.231336 1801 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260503 07:52:59.232561 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 457) took 1894 ms. Trace:
I20260503 07:52:59.232656 1173 rpcz_store.cc:276] 0503 07:52:57.338529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.338598 (+ 69us) service_pool.cc:224] Handling call
0503 07:52:59.232400 (+1893802us) ts_tablet_manager.cc:1151] Deleting tablet 8f6df58637e047ef9b696f22d7c43e48
0503 07:52:59.232410 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.232503 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1893419}
W20260503 07:52:59.233549 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8f6df58637e047ef9b696f22d7c43e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f6df58637e047ef9b696f22d7c43e48 already in progress: creating tablet
I20260503 07:52:59.234124 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 458) took 1893 ms. Trace:
I20260503 07:52:59.234565 1173 rpcz_store.cc:276] 0503 07:52:57.340294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.340356 (+ 62us) service_pool.cc:224] Handling call
0503 07:52:59.233969 (+1893613us) ts_tablet_manager.cc:1151] Deleting tablet c1c631d3da8f4ec29690c548097a454b
0503 07:52:59.233978 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.234076 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1893367}
I20260503 07:52:59.234861 1844 raft_consensus.cc:2804] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.235004 1165 tablet_bootstrap.cc:654] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.235025 1844 raft_consensus.cc:697] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.235613 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 459) took 1877 ms. Trace:
I20260503 07:52:59.235536 1844 consensus_queue.cc:237] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.236132 1173 rpcz_store.cc:276] 0503 07:52:57.357668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.357785 (+ 117us) service_pool.cc:224] Handling call
0503 07:52:59.235461 (+1877676us) ts_tablet_manager.cc:1151] Deleting tablet b2ef0e849f4d4eb299726b2b094a1dc3
0503 07:52:59.235471 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.235562 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1877397}
I20260503 07:52:59.239838 897 tablet_service.cc:1558] Processing DeleteTablet for tablet af1b61a2548e4f3fafb4ed0982dbd9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.240612 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 0481b55721854d70a670a79ff2f42dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.240993 1173 tablet_replica.cc:333] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:52:59.240999 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b2ef0e849f4d4eb299726b2b094a1dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2ef0e849f4d4eb299726b2b094a1dc3 already in progress: creating tablet
I20260503 07:52:59.241521 1173 raft_consensus.cc:2243] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.241837 889 tablet_service.cc:1558] Processing DeleteTablet for tablet c46873d43e1b4495a92996e07f93f918 with delete_type TABLET_DATA_DELETED (replaced by tablet 92c1709a2a49475daaa2372360610b1e) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.242179 1173 raft_consensus.cc:2272] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.242596 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd0b6afae47432e9da300ba07e970e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.242972 1173 ts_tablet_manager.cc:1916] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.243362 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 1498486dd3db414c8062cba2d54037bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.244289 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7cea10a432034ea5b19576ea1448baa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.245123 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cea10a432034ea5b19576ea1448baa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.249089 1166 tablet_bootstrap.cc:492] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.249236 1166 ts_tablet_manager.cc:1403] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.097s user 0.009s sys 0.005s
I20260503 07:52:59.250386 1166 raft_consensus.cc:359] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.250629 1166 raft_consensus.cc:385] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.250752 1166 raft_consensus.cc:740] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.251116 1166 consensus_queue.cc:260] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.251654 1166 ts_tablet_manager.cc:1434] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:59.251927 1166 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.253598 1166 tablet_bootstrap.cc:654] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.258386 1171 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.258575 1171 ts_tablet_manager.cc:1403] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.284s user 0.022s sys 0.015s
I20260503 07:52:59.259332 1171 raft_consensus.cc:359] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.259512 1171 raft_consensus.cc:385] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.259589 1171 raft_consensus.cc:740] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.259864 1173 ts_tablet_manager.cc:1929] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:59.259918 715 consensus_peers.cc:597] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:59.259857 1171 consensus_queue.cc:260] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.259979 1173 log.cc:1199] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/96f7244292c3400dad2812e0adb162ef
W20260503 07:52:59.260218 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d647277295e42cdb65f45a619e63960 consensus state has no leader
I20260503 07:52:59.260396 1173 ts_tablet_manager.cc:1950] T 96f7244292c3400dad2812e0adb162ef P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.264693 752 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.264973 1174 tablet_replica.cc:333] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.265197 1174 raft_consensus.cc:2243] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:59.265322 746 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.265370 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.265480 1174 pending_rounds.cc:70] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:52:59.265547 1174 pending_rounds.cc:77] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847411698307072 op_type: NO_OP noop_request { }
I20260503 07:52:59.265597 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.265681 1174 raft_consensus.cc:2889] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:59.265787 1174 raft_consensus.cc:2272] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.265806 757 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.266104 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.266779 1174 ts_tablet_manager.cc:1916] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.269488 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 460) took 1911 ms. Trace:
I20260503 07:52:59.269904 1173 rpcz_store.cc:276] 0503 07:52:57.357820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.357985 (+ 165us) service_pool.cc:224] Handling call
0503 07:52:59.240881 (+1882896us) ts_tablet_manager.cc:1151] Deleting tablet 96f7244292c3400dad2812e0adb162ef
0503 07:52:59.240894 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.246095 (+ 5201us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.259778 (+ 13683us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.269449 (+ 9671us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1882509}
I20260503 07:52:59.270606 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 96f7244292c3400dad2812e0adb162ef (table default.Table_3b227a9ce91a4483ac9b59c1efe6f11b [id=8ce24058abb74116b4b4ccb8c9352003]) successfully deleted
I20260503 07:52:59.270991 1173 tablet_replica.cc:333] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.274288 1174 ts_tablet_manager.cc:1929] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:59.274503 1174 log.cc:1199] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bb96ba84739c45b7847f0c43ab4a08e7
I20260503 07:52:59.275053 1174 ts_tablet_manager.cc:1950] T bb96ba84739c45b7847f0c43ab4a08e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.276059 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bb96ba84739c45b7847f0c43ab4a08e7 (table default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]) successfully deleted
W20260503 07:52:59.276113 1801 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260503 07:52:59.276412 1173 raft_consensus.cc:2243] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.276456 1174 tablet_replica.cc:333] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.276602 1173 raft_consensus.cc:2272] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.276768 1174 raft_consensus.cc:2243] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.276973 1174 raft_consensus.cc:2272] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.277187 1173 ts_tablet_manager.cc:1916] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.277938 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d00be731a08f4242a005057e341dd1d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.278828 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d00be731a08f4242a005057e341dd1d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.279212 1171 ts_tablet_manager.cc:1434] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260503 07:52:59.281409 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:59.282339 1171 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.285562 1175 ts_tablet_manager.cc:1929] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.290805 1174 ts_tablet_manager.cc:1916] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.291026 1175 log.cc:1199] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:52:59.291436 1175 ts_tablet_manager.cc:1950] T 5e2c6d9dd87646ed9d1f86761f13f628 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.292893 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 497) took 1552 ms. Trace:
I20260503 07:52:59.293797 1173 ts_tablet_manager.cc:1929] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.293922 1173 log.cc:1199] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/65fbd09bd319440cadcc84f1d55e7bde
I20260503 07:52:59.292073 1171 tablet_bootstrap.cc:654] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.294307 1173 ts_tablet_manager.cc:1950] T 65fbd09bd319440cadcc84f1d55e7bde P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.294605 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 461) took 1860 ms. Trace:
I20260503 07:52:59.294710 1173 rpcz_store.cc:276] 0503 07:52:57.434230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.434301 (+ 71us) service_pool.cc:224] Handling call
0503 07:52:59.270916 (+1836615us) ts_tablet_manager.cc:1151] Deleting tablet 65fbd09bd319440cadcc84f1d55e7bde
0503 07:52:59.270925 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.290861 (+ 19936us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.293744 (+ 2883us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.294559 (+ 815us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1836349}
I20260503 07:52:59.295156 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 65fbd09bd319440cadcc84f1d55e7bde (table default.Table_2c8528bc9a27424185c3afea1df39fc9 [id=d60f7489816c4a0ba96ec72d3fdfe261]) successfully deleted
I20260503 07:52:59.293946 1175 rpcz_store.cc:276] 0503 07:52:57.740767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.741095 (+ 328us) service_pool.cc:224] Handling call
0503 07:52:59.221592 (+1480497us) ts_tablet_manager.cc:1151] Deleting tablet 5e2c6d9dd87646ed9d1f86761f13f628
0503 07:52:59.221602 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.261149 (+ 39547us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.285501 (+ 24352us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.292846 (+ 7345us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1480257}
I20260503 07:52:59.304361 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:59.304597 1175 tablet_replica.cc:333] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.304705 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5e2c6d9dd87646ed9d1f86761f13f628 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
I20260503 07:52:59.304800 1175 raft_consensus.cc:2243] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:59.305054 599 master_service.cc:954] ReplaceTablet: received request to replace tablet ea2683448c3f4df3bb0b14683d8b5222 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.305173 1175 raft_consensus.cc:2272] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.305601 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f3ba0569253f4fc09368055804a5dcde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.305934 1175 ts_tablet_manager.cc:1916] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:59.306118 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3ba0569253f4fc09368055804a5dcde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:52:59.312835 1801 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:52:59.312990 1801 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:52:59.313053 1801 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 07:52:59.316798 1171 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.316948 1171 ts_tablet_manager.cc:1403] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.002s
I20260503 07:52:59.317476 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.318166 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_16ede9de6dc5448e981c9d7a23f0705e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.318282 1171 raft_consensus.cc:359] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.318482 1171 raft_consensus.cc:385] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.318586 1171 raft_consensus.cc:740] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:52:59.318732 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16ede9de6dc5448e981c9d7a23f0705e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.318862 1171 consensus_queue.cc:260] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.319417 1171 ts_tablet_manager.cc:1434] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:59.320475 1171 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:52:59.320751 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0422b379bbf34a8e8773541f2336f477 consensus state has no leader
I20260503 07:52:59.329572 1171 tablet_bootstrap.cc:654] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.333232 1173 tablet_replica.cc:333] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.333508 1173 raft_consensus.cc:2243] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.333737 1173 raft_consensus.cc:2272] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.334427 1173 ts_tablet_manager.cc:1916] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:59.335242 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e162006cee34182b51f97629a174509 consensus state has no leader
I20260503 07:52:59.335491 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 3cf72d49cfd24083abee07e0d2190e3e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.336050 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_78703a3f97e64063b89538ad0132cc85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.336369 1175 ts_tablet_manager.cc:1929] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:59.336481 1175 log.cc:1199] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b0f7b07d945c4726a77578987c22415d
W20260503 07:52:59.336642 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78703a3f97e64063b89538ad0132cc85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.336931 1175 ts_tablet_manager.cc:1950] T b0f7b07d945c4726a77578987c22415d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.337697 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 500) took 1126 ms. Trace:
I20260503 07:52:59.337815 1175 rpcz_store.cc:276] 0503 07:52:58.210982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.211048 (+ 66us) service_pool.cc:224] Handling call
0503 07:52:59.304502 (+1093454us) ts_tablet_manager.cc:1151] Deleting tablet b0f7b07d945c4726a77578987c22415d
0503 07:52:59.304511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.315447 (+ 10936us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.336289 (+ 20842us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.337658 (+ 1369us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1093241}
I20260503 07:52:59.338142 1175 tablet_replica.cc:333] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.338340 1175 raft_consensus.cc:2243] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.338495 1175 raft_consensus.cc:2272] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.338598 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b0f7b07d945c4726a77578987c22415d (table default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]) successfully deleted
I20260503 07:52:59.339099 1175 ts_tablet_manager.cc:1916] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.344594 1173 ts_tablet_manager.cc:1929] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.344722 1173 log.cc:1199] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/6ce0e09526eb4c9ba4b47c36e741702d
I20260503 07:52:59.347800 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9e162006cee34182b51f97629a174509
I20260503 07:52:59.348702 600 catalog_manager.cc:6741] ReplaceTablet: tablet 9e162006cee34182b51f97629a174509 deleted and replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d
I20260503 07:52:59.348995 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_24a0406bc2814a528e089ec908f4e841"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.349458 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24a0406bc2814a528e089ec908f4e841 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.353389 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.353698 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.354915 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.355813 779 raft_consensus.cc:1275] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260503 07:52:59.356160 988 consensus_peers.cc:597] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:52:59.356474 1165 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.356458 1844 consensus_queue.cc:1048] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:52:59.356632 1165 ts_tablet_manager.cc:1403] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.189s user 0.002s sys 0.003s
I20260503 07:52:59.357141 1171 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.357277 1171 ts_tablet_manager.cc:1403] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.003s
I20260503 07:52:59.357436 1165 raft_consensus.cc:359] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.357620 1165 raft_consensus.cc:385] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.357685 1165 raft_consensus.cc:740] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.357975 1171 raft_consensus.cc:359] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.357933 1165 consensus_queue.cc:260] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.358125 1171 raft_consensus.cc:385] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.358193 1171 raft_consensus.cc:740] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.358392 1171 consensus_queue.cc:260] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.358621 1165 ts_tablet_manager.cc:1434] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:59.358845 1171 ts_tablet_manager.cc:1434] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:52:59.358901 1165 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.359519 1173 ts_tablet_manager.cc:1950] T 6ce0e09526eb4c9ba4b47c36e741702d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.359814 1171 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.361920 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 462) took 1926 ms. Trace:
I20260503 07:52:59.362057 1173 rpcz_store.cc:276] 0503 07:52:57.435434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.435495 (+ 61us) service_pool.cc:224] Handling call
0503 07:52:59.333109 (+1897614us) ts_tablet_manager.cc:1151] Deleting tablet 6ce0e09526eb4c9ba4b47c36e741702d
0503 07:52:59.333124 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.341074 (+ 7950us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.344491 (+ 3417us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.361882 (+ 17391us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1897335}
I20260503 07:52:59.362450 1173 tablet_replica.cc:333] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.362670 1173 raft_consensus.cc:2243] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.362711 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 6ce0e09526eb4c9ba4b47c36e741702d (table default.Table_c609207b4a1c47cbb38b1193163cb037 [id=aca9f69cb52b44d5a3a4dac6baceea3c]) successfully deleted
I20260503 07:52:59.362831 1173 raft_consensus.cc:2272] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:59.370486 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17b547a24cfa4478a90d3035a59a3381 consensus state has no leader
I20260503 07:52:59.371233 1175 ts_tablet_manager.cc:1929] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.371351 1175 log.cc:1199] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:52:59.375214 1166 tablet_bootstrap.cc:492] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.375367 1166 ts_tablet_manager.cc:1403] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.123s user 0.015s sys 0.034s
I20260503 07:52:59.376940 1166 raft_consensus.cc:359] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.377960 1173 ts_tablet_manager.cc:1916] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.373512 1844 raft_consensus.cc:493] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.377131 1166 raft_consensus.cc:385] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.378180 1844 raft_consensus.cc:515] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.378767 1166 raft_consensus.cc:740] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.378965 1844 leader_election.cc:290] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.379096 1165 tablet_bootstrap.cc:654] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.373611 1171 tablet_bootstrap.cc:654] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.380004 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.379918 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.380355 776 raft_consensus.cc:2468] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:52:59.380741 988 leader_election.cc:343] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.381060 1175 ts_tablet_manager.cc:1950] T ed95a89bf4bc4b6fa72b224f49082423 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.381232 986 leader_election.cc:304] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.382138 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 502) took 1131 ms. Trace:
I20260503 07:52:59.382215 1175 rpcz_store.cc:276] 0503 07:52:58.250160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.250385 (+ 225us) service_pool.cc:224] Handling call
0503 07:52:59.338091 (+1087706us) ts_tablet_manager.cc:1151] Deleting tablet ed95a89bf4bc4b6fa72b224f49082423
0503 07:52:59.338099 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.368365 (+ 30266us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.371174 (+ 2809us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.382084 (+ 10910us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087477}
I20260503 07:52:59.382614 1175 tablet_replica.cc:333] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.382725 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ed95a89bf4bc4b6fa72b224f49082423 (table default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]) successfully deleted
I20260503 07:52:59.382795 1175 raft_consensus.cc:2243] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.382359 1844 raft_consensus.cc:2804] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.383001 1175 raft_consensus.cc:2272] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.383070 1844 raft_consensus.cc:493] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.383174 1844 raft_consensus.cc:3060] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.383201 1174 ts_tablet_manager.cc:1929] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.383306 1174 log.cc:1199] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:52:59.383554 1175 ts_tablet_manager.cc:1916] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.383651 1174 ts_tablet_manager.cc:1950] T fe2b065666ec4f1299b47d45cd1f600b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.384774 1173 ts_tablet_manager.cc:1929] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.384891 1173 log.cc:1199] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b77c5c6954554eac970d1e3fb1387c2b
I20260503 07:52:59.385205 1173 ts_tablet_manager.cc:1950] T b77c5c6954554eac970d1e3fb1387c2b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.385885 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 463) took 1948 ms. Trace:
I20260503 07:52:59.385983 1173 rpcz_store.cc:276] 0503 07:52:57.436964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.437020 (+ 56us) service_pool.cc:224] Handling call
0503 07:52:59.362394 (+1925374us) ts_tablet_manager.cc:1151] Deleting tablet b77c5c6954554eac970d1e3fb1387c2b
0503 07:52:59.362402 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.381717 (+ 19315us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.384716 (+ 2999us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.385837 (+ 1121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1925155}
I20260503 07:52:59.386476 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b77c5c6954554eac970d1e3fb1387c2b (table default.Table_19875ebf44a24b49991351b7681d86c4 [id=859e3aea8345456dac23062f2f25a127]) successfully deleted
I20260503 07:52:59.386588 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_77fa641b22004fc287d8aabc52ead412" } modify_external_catalogs: true
I20260503 07:52:59.386485 1844 raft_consensus.cc:515] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.386785 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_77fa641b22004fc287d8aabc52ead412" } modify_external_catalogs: true
I20260503 07:52:59.387295 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4735ea34fadb44c6bccac28390513b6e" } modify_external_catalogs: true
I20260503 07:52:59.387408 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4735ea34fadb44c6bccac28390513b6e" } modify_external_catalogs: true
I20260503 07:52:59.387948 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:59.388520 988 leader_election.cc:343] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.388705 1844 leader_election.cc:290] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.389071 1166 consensus_queue.cc:260] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.390589 1801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:44841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.62
--webserver_port=39175
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:52:59.392344 1831 tablet.cc:1724] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.392730 1801 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:52:59.394904 1801 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260503 07:52:59.397881 1166 ts_tablet_manager.cc:1434] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260503 07:52:59.398864 1166 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.400369 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 464) took 1827 ms. Trace:
I20260503 07:52:59.400472 1173 rpcz_store.cc:276] 0503 07:52:57.572639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.572705 (+ 66us) service_pool.cc:224] Handling call
0503 07:52:59.398875 (+1826170us) ts_tablet_manager.cc:1151] Deleting tablet f11c020bd0484adfa6d7dae67818f7e5
0503 07:52:59.400202 (+ 1327us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.400312 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1825890}
I20260503 07:52:59.400830 1166 tablet_bootstrap.cc:654] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:52:59.403188 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f11c020bd0484adfa6d7dae67818f7e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f11c020bd0484adfa6d7dae67818f7e5 already in progress: creating tablet
I20260503 07:52:59.403661 1173 tablet_replica.cc:333] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.403972 1173 raft_consensus.cc:2243] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.404309 1173 raft_consensus.cc:2272] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.405000 1173 ts_tablet_manager.cc:1916] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.408447 1171 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.408608 1171 ts_tablet_manager.cc:1403] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.003s
I20260503 07:52:59.409379 1171 raft_consensus.cc:359] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.409559 1171 raft_consensus.cc:385] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.409668 1171 raft_consensus.cc:740] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.409969 1171 consensus_queue.cc:260] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.411265 1171 ts_tablet_manager.cc:1434] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:59.412214 1171 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.412231 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8853624ee831417c9dbc9a87aef34f3e" } modify_external_catalogs: true
I20260503 07:52:59.412400 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8853624ee831417c9dbc9a87aef34f3e" } modify_external_catalogs: true
I20260503 07:52:59.414243 1734 raft_consensus.cc:493] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.414382 1734 raft_consensus.cc:515] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.414760 1171 tablet_bootstrap.cc:654] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.415041 1734 leader_election.cc:290] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:59.416380 854 leader_election.cc:343] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:59.423694 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 637462b45502433796daa7a9cd8586d3 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.428853 1165 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.429083 1165 ts_tablet_manager.cc:1403] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
I20260503 07:52:59.429944 1165 raft_consensus.cc:359] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.430203 1165 raft_consensus.cc:385] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.430341 1165 raft_consensus.cc:740] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.430624 1165 consensus_queue.cc:260] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.431196 1165 ts_tablet_manager.cc:1434] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:59.431416 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77fa106f0cc24a35bd23b457660a45dc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.431607 776 raft_consensus.cc:3060] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.434312 776 raft_consensus.cc:2468] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.434763 986 leader_election.cc:304] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.434986 1830 tablet.cc:1724] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.435362 1173 ts_tablet_manager.cc:1929] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:59.435433 851 leader_election.cc:343] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8dd0b6afae47432e9da300ba07e970e5
I20260503 07:52:59.435465 1844 raft_consensus.cc:2804] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.435496 1173 log.cc:1199] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/89572734813f4d28846ffe38868a15c3
I20260503 07:52:59.435606 1844 raft_consensus.cc:697] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.435585 851 leader_election.cc:304] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.437564 1734 raft_consensus.cc:2749] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.437680 1174 tablet_replica.cc:333] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.437801 1173 ts_tablet_manager.cc:1950] T 89572734813f4d28846ffe38868a15c3 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.437835 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet fe2b065666ec4f1299b47d45cd1f600b (table default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]) successfully deleted
I20260503 07:52:59.437912 1174 raft_consensus.cc:2243] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.438069 1174 raft_consensus.cc:2272] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.438493 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 465) took 1787 ms. Trace:
I20260503 07:52:59.438719 1174 ts_tablet_manager.cc:1916] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.438625 1173 rpcz_store.cc:276] 0503 07:52:57.650963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.651440 (+ 477us) service_pool.cc:224] Handling call
0503 07:52:59.403549 (+1752109us) ts_tablet_manager.cc:1151] Deleting tablet 89572734813f4d28846ffe38868a15c3
0503 07:52:59.403562 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.423564 (+ 20002us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.435261 (+ 11697us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.438458 (+ 3197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1751929}
I20260503 07:52:59.439076 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 89572734813f4d28846ffe38868a15c3 (table default.Table_808dbcf79af44f209e756d91fe98e82c [id=af3d96f4252648fbaa21f49793fc6a60]) successfully deleted
I20260503 07:52:59.440665 1844 consensus_queue.cc:237] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.440757 596 master_service.cc:954] ReplaceTablet: received request to replace tablet b269ee59036d4c2f866b6b2bf45c35cf from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.443619 1173 tablet_replica.cc:333] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.443948 1173 raft_consensus.cc:2243] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.444798 1173 raft_consensus.cc:2272] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.445526 1173 ts_tablet_manager.cc:1916] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.446065 1165 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.449713 1175 ts_tablet_manager.cc:1929] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.449930 1175 log.cc:1199] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:52:59.450464 1175 ts_tablet_manager.cc:1950] T 55eb2ad7619a4a9aabe8b8d062455390 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.451279 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 503) took 1200 ms. Trace:
I20260503 07:52:59.451431 1175 rpcz_store.cc:276] 0503 07:52:58.250329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.250649 (+ 320us) service_pool.cc:224] Handling call
0503 07:52:59.382539 (+1131890us) ts_tablet_manager.cc:1151] Deleting tablet 55eb2ad7619a4a9aabe8b8d062455390
0503 07:52:59.382549 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.393196 (+ 10647us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.436088 (+ 42892us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.451247 (+ 15159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131727}
I20260503 07:52:59.451862 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 55eb2ad7619a4a9aabe8b8d062455390 (table default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]) successfully deleted
I20260503 07:52:59.451936 1175 tablet_replica.cc:333] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.452610 1175 raft_consensus.cc:2243] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.453526 1171 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.453763 1171 ts_tablet_manager.cc:1403] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.003s
I20260503 07:52:59.454573 1171 raft_consensus.cc:359] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.454823 1171 raft_consensus.cc:385] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.454955 1171 raft_consensus.cc:740] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.455286 1171 consensus_queue.cc:260] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.455842 1171 ts_tablet_manager.cc:1434] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:52:59.456322 1734 raft_consensus.cc:493] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.456492 1171 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.456491 1734 raft_consensus.cc:515] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.457108 1734 leader_election.cc:290] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:52:59.458051 854 leader_election.cc:343] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:59.458498 1171 tablet_bootstrap.cc:654] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.458932 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_15b74a48b8224ee48f505600b02a9af9" } modify_external_catalogs: true
I20260503 07:52:59.459120 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_15b74a48b8224ee48f505600b02a9af9" } modify_external_catalogs: true
I20260503 07:52:59.459257 1848 raft_consensus.cc:493] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.459393 1848 raft_consensus.cc:515] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.459892 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c054b519f1b144dd898d987a82f17322" } modify_external_catalogs: true
I20260503 07:52:59.460000 1848 leader_election.cc:290] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.460032 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c054b519f1b144dd898d987a82f17322" } modify_external_catalogs: true
I20260503 07:52:59.460422 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.460929 988 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.461102 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.461309 775 raft_consensus.cc:2468] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:59.461675 986 leader_election.cc:304] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.462117 1848 raft_consensus.cc:2804] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:52:59.462145 851 leader_election.cc:343] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:59.462217 1848 raft_consensus.cc:493] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.462275 851 leader_election.cc:304] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.462320 1848 raft_consensus.cc:3060] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.462738 1734 raft_consensus.cc:2749] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.466024 1848 raft_consensus.cc:515] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.466944 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:59.466995 1848 leader_election.cc:290] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.467157 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.467372 775 raft_consensus.cc:3060] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:59.467553 988 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:59.469413 1882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:52:59.470167 1877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:59.470197 775 raft_consensus.cc:2468] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.470614 986 leader_election.cc:304] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.471396 1801 server_base.cc:1061] running on GCE node
I20260503 07:52:59.471455 1848 raft_consensus.cc:2804] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:52:59.471788 1879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:52:59.472193 1848 raft_consensus.cc:697] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.472641 1848 consensus_queue.cc:237] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.473021 1801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:52:59.478451 1165 tablet_bootstrap.cc:654] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.478377 597 catalog_manager.cc:5671] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:59.479018 597 catalog_manager.cc:5671] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:59.479413 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]). Expected version 2 got 0
I20260503 07:52:59.479918 1175 raft_consensus.cc:2272] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.480044 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_09de7b363b1a4cbd8be93baba97b150c [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 2 got 0
I20260503 07:52:59.480286 1173 ts_tablet_manager.cc:1929] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.480451 1173 log.cc:1199] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9336e5b80c644ebcb75455770eb45d70
I20260503 07:52:59.480791 1175 ts_tablet_manager.cc:1916] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.480831 1173 ts_tablet_manager.cc:1950] T 9336e5b80c644ebcb75455770eb45d70 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.481683 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 466) took 1733 ms. Trace:
I20260503 07:52:59.481781 1173 rpcz_store.cc:276] 0503 07:52:57.747973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:57.748064 (+ 91us) service_pool.cc:224] Handling call
0503 07:52:59.443534 (+1695470us) ts_tablet_manager.cc:1151] Deleting tablet 9336e5b80c644ebcb75455770eb45d70
0503 07:52:59.443549 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.450064 (+ 6515us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.480202 (+ 30138us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.481606 (+ 1404us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682138}
I20260503 07:52:59.482013 1166 tablet_bootstrap.cc:492] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.482159 1166 ts_tablet_manager.cc:1403] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.083s user 0.015s sys 0.024s
I20260503 07:52:59.482972 1166 raft_consensus.cc:359] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.483141 1166 raft_consensus.cc:385] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.483230 1166 raft_consensus.cc:740] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.484025 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9336e5b80c644ebcb75455770eb45d70 (table default.Table_b5459e78eccc4416aa5499c77c631adb [id=ed4ac0ce0cf9491d82a10beef93e49da]) successfully deleted
I20260503 07:52:59.484946 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2b41c8df97b849ad837271b383157c70 (DEFAULT_TABLE table=default.Table_93b4bdecd9754df4b30241cc36c107f6 [id=7072d244da814e28869f4e9f517eb052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.485183 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2b41c8df97b849ad837271b383157c70 (DEFAULT_TABLE table=default.Table_93b4bdecd9754df4b30241cc36c107f6 [id=7072d244da814e28869f4e9f517eb052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.485337 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b41c8df97b849ad837271b383157c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.485634 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b41c8df97b849ad837271b383157c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.485843 889 tablet_service.cc:1511] Processing CreateTablet for tablet 2b41c8df97b849ad837271b383157c70 (DEFAULT_TABLE table=default.Table_93b4bdecd9754df4b30241cc36c107f6 [id=7072d244da814e28869f4e9f517eb052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.486208 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b41c8df97b849ad837271b383157c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.486325 1801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:52:59.488260 1697 raft_consensus.cc:493] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.488375 1697 raft_consensus.cc:515] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.488430 897 tablet_service.cc:1511] Processing CreateTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 (DEFAULT_TABLE table=default.Table_c165c4af7b3b4f99b92b64a3e9212fd1 [id=1430a29161994ac685768e003b642f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.488408 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 (DEFAULT_TABLE table=default.Table_c165c4af7b3b4f99b92b64a3e9212fd1 [id=1430a29161994ac685768e003b642f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.488750 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fee86632a64de9a9b8eba31e3534b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.488756 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fee86632a64de9a9b8eba31e3534b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.488998 1697 leader_election.cc:290] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.489678 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda8280b97254d1aaf3803f6b5cd223c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.489818 1173 tablet_replica.cc:333] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:52:59.490301 715 leader_election.cc:343] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.490362 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda8280b97254d1aaf3803f6b5cd223c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.490458 757 tablet_service.cc:1511] Processing CreateTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 (DEFAULT_TABLE table=default.Table_c165c4af7b3b4f99b92b64a3e9212fd1 [id=1430a29161994ac685768e003b642f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.490532 1049 raft_consensus.cc:2468] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:52:59.490780 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fee86632a64de9a9b8eba31e3534b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.490916 716 leader_election.cc:304] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.491259 1697 raft_consensus.cc:2804] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.491361 1697 raft_consensus.cc:493] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.491446 1697 raft_consensus.cc:3060] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.492415 1734 raft_consensus.cc:493] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.492551 1734 raft_consensus.cc:515] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.493101 1734 leader_election.cc:290] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.494364 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.494165 1697 raft_consensus.cc:515] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.495855 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda8280b97254d1aaf3803f6b5cd223c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:59.496315 715 leader_election.cc:343] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.497058 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda8280b97254d1aaf3803f6b5cd223c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:59.497249 1049 raft_consensus.cc:3060] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.499163 742 tablet_service.cc:1511] Processing CreateTablet for tablet f7fed679a54441b591801542b9e8dc22 (DEFAULT_TABLE table=default.Table_5f7e8f63b8a74a30b6305c5db547c630 [id=cb62ba3f64b4410da481558735a459f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.499449 1171 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.499485 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fed679a54441b591801542b9e8dc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.499583 1171 ts_tablet_manager.cc:1403] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260503 07:52:59.500140 891 tablet_service.cc:1511] Processing CreateTablet for tablet f7fed679a54441b591801542b9e8dc22 (DEFAULT_TABLE table=default.Table_5f7e8f63b8a74a30b6305c5db547c630 [id=cb62ba3f64b4410da481558735a459f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.500411 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f7fed679a54441b591801542b9e8dc22 (DEFAULT_TABLE table=default.Table_5f7e8f63b8a74a30b6305c5db547c630 [id=cb62ba3f64b4410da481558735a459f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.500500 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fed679a54441b591801542b9e8dc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.501163 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fed679a54441b591801542b9e8dc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.502535 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f53a37806e414f16aa69294c0abad10a (DEFAULT_TABLE table=default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d [id=d8750288dac94a0a90225a0b13a33942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.502862 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53a37806e414f16aa69294c0abad10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.503911 885 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9458716524bdb8658bdef4d73bbac (DEFAULT_TABLE table=default.Table_4a245aa51e4d46388849d524124ea6ea [id=9dc125cc6d1540ba9b6dceacbdf51d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.504221 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:59.504272 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9458716524bdb8658bdef4d73bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.504849 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0a269a12729549469f86e184e2ed7e86 (DEFAULT_TABLE table=default.Table_3e3a65f762f5400397093e1d1f388077 [id=37e762a5fb89480dac69e5d85a7bf2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.505132 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a269a12729549469f86e184e2ed7e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.505375 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e9b97fafa145e0a45e4d81fc9d5947" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.507871 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0a269a12729549469f86e184e2ed7e86 (DEFAULT_TABLE table=default.Table_3e3a65f762f5400397093e1d1f388077 [id=37e762a5fb89480dac69e5d85a7bf2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.508213 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a269a12729549469f86e184e2ed7e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.508455 746 tablet_service.cc:1511] Processing CreateTablet for tablet f53a37806e414f16aa69294c0abad10a (DEFAULT_TABLE table=default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d [id=d8750288dac94a0a90225a0b13a33942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.508797 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53a37806e414f16aa69294c0abad10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.510383 897 tablet_service.cc:1511] Processing CreateTablet for tablet 31864ef969e94f5e9e9a7987ed88feb6 (DEFAULT_TABLE table=default.Table_e73cb801493e4ec7a2c8914854e5d9f7 [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.510701 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864ef969e94f5e9e9a7987ed88feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.512408 1023 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9458716524bdb8658bdef4d73bbac (DEFAULT_TABLE table=default.Table_4a245aa51e4d46388849d524124ea6ea [id=9dc125cc6d1540ba9b6dceacbdf51d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.512420 750 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9458716524bdb8658bdef4d73bbac (DEFAULT_TABLE table=default.Table_4a245aa51e4d46388849d524124ea6ea [id=9dc125cc6d1540ba9b6dceacbdf51d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.512727 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9458716524bdb8658bdef4d73bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.512742 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9458716524bdb8658bdef4d73bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.512971 884 tablet_service.cc:1511] Processing CreateTablet for tablet f53a37806e414f16aa69294c0abad10a (DEFAULT_TABLE table=default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d [id=d8750288dac94a0a90225a0b13a33942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.513304 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53a37806e414f16aa69294c0abad10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.516446 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 31864ef969e94f5e9e9a7987ed88feb6 (DEFAULT_TABLE table=default.Table_e73cb801493e4ec7a2c8914854e5d9f7 [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.516742 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864ef969e94f5e9e9a7987ed88feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.516850 880 tablet_service.cc:1511] Processing CreateTablet for tablet add0275274f14ed49393a43077ec0484 (DEFAULT_TABLE table=default.Table_dbe658b698884e3ba4af466a1b26aca5 [id=4e6555020d9a436e98cd46d0d7ad62cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.517045 759 tablet_service.cc:1511] Processing CreateTablet for tablet 31864ef969e94f5e9e9a7987ed88feb6 (DEFAULT_TABLE table=default.Table_e73cb801493e4ec7a2c8914854e5d9f7 [id=a448d69588b945efb94698de1acb0565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.517163 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add0275274f14ed49393a43077ec0484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.517328 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864ef969e94f5e9e9a7987ed88feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.522380 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 0a269a12729549469f86e184e2ed7e86 (DEFAULT_TABLE table=default.Table_3e3a65f762f5400397093e1d1f388077 [id=37e762a5fb89480dac69e5d85a7bf2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.522779 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a269a12729549469f86e184e2ed7e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.526095 1033 tablet_service.cc:1511] Processing CreateTablet for tablet add0275274f14ed49393a43077ec0484 (DEFAULT_TABLE table=default.Table_dbe658b698884e3ba4af466a1b26aca5 [id=4e6555020d9a436e98cd46d0d7ad62cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.526121 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7282819c2345c0befcb18a53cbc166 (DEFAULT_TABLE table=default.Table_e238863a7ff042de954787ef849a7c9d [id=eeaf18dd7fe64739b16a6b8871991b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.526484 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7282819c2345c0befcb18a53cbc166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.526595 851 leader_election.cc:304] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.526966 1734 raft_consensus.cc:2749] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.529495 741 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7282819c2345c0befcb18a53cbc166 (DEFAULT_TABLE table=default.Table_e238863a7ff042de954787ef849a7c9d [id=eeaf18dd7fe64739b16a6b8871991b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.529847 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7282819c2345c0befcb18a53cbc166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.532346 1734 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.532532 1049 raft_consensus.cc:2468] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:59.532505 1734 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.532814 1697 leader_election.cc:290] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.532967 716 leader_election.cc:304] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.533150 1734 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.534293 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.534531 1049 raft_consensus.cc:2393] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:52:59.534725 759 tablet_service.cc:1511] Processing CreateTablet for tablet add0275274f14ed49393a43077ec0484 (DEFAULT_TABLE table=default.Table_dbe658b698884e3ba4af466a1b26aca5 [id=4e6555020d9a436e98cd46d0d7ad62cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.535066 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add0275274f14ed49393a43077ec0484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.535367 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.535601 775 raft_consensus.cc:2393] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 4a924c2134c54fa0bb164825da53bdd0 in this term.
I20260503 07:52:59.535976 851 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.536420 1734 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.489987 1173 raft_consensus.cc:2243] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.540915 1173 raft_consensus.cc:2272] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.540980 1734 raft_consensus.cc:2749] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.541160 1734 raft_consensus.cc:493] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.541266 1734 raft_consensus.cc:515] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.541507 1173 ts_tablet_manager.cc:1916] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.542230 1734 leader_election.cc:290] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.542703 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add0275274f14ed49393a43077ec0484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.550808 1166 consensus_queue.cc:260] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.551340 1166 ts_tablet_manager.cc:1434] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.069s user 0.001s sys 0.001s
I20260503 07:52:59.551649 1166 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:59.553169 854 leader_election.cc:343] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: c46873d43e1b4495a92996e07f93f918
I20260503 07:52:59.553846 1166 tablet_bootstrap.cc:654] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.558768 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2c3421b6842944b7b5a3582b8c059837
I20260503 07:52:59.559631 1173 ts_tablet_manager.cc:1929] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:59.559767 1173 log.cc:1199] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b0f7b07d945c4726a77578987c22415d
I20260503 07:52:59.560333 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 637462b45502433796daa7a9cd8586d3
I20260503 07:52:59.560779 599 catalog_manager.cc:6741] ReplaceTablet: tablet 637462b45502433796daa7a9cd8586d3 deleted and replaced by tablet e19d7eab61e24e18a1e4eb600e9d592a
I20260503 07:52:59.562064 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 637462b45502433796daa7a9cd8586d3 with delete_type TABLET_DATA_DELETED (replaced by tablet e19d7eab61e24e18a1e4eb600e9d592a) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.563282 1171 raft_consensus.cc:359] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.563532 1171 raft_consensus.cc:385] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.563617 1171 raft_consensus.cc:740] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.563864 1171 consensus_queue.cc:260] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.564234 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2627dbd840b44aaa9ee93bea935f5c4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.564891 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2627dbd840b44aaa9ee93bea935f5c4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.567296 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_faade3cbf89744b0adc4feaebb6e4acd" } new_table_name: "default.Table_d009e885880b4b4482cd169335f355d8" modify_external_catalogs: true
I20260503 07:52:59.569372 1171 ts_tablet_manager.cc:1434] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260503 07:52:59.569657 1171 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.570093 1173 ts_tablet_manager.cc:1950] T b0f7b07d945c4726a77578987c22415d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.570499 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 467) took 1360 ms. Trace:
I20260503 07:52:59.570616 1173 rpcz_store.cc:276] 0503 07:52:58.210383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.210434 (+ 51us) service_pool.cc:224] Handling call
0503 07:52:59.489742 (+1279308us) ts_tablet_manager.cc:1151] Deleting tablet b0f7b07d945c4726a77578987c22415d
0503 07:52:59.489749 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.556595 (+ 66846us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.559553 (+ 2958us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.570456 (+ 10903us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1279092}
I20260503 07:52:59.571081 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b0f7b07d945c4726a77578987c22415d (table default.Table_0e917af377654c46b51e3fea73b0f06b [id=3bf989443597494da482045acdc18f7d]) successfully deleted
I20260503 07:52:59.571751 1697 raft_consensus.cc:2804] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.572118 1697 raft_consensus.cc:697] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:59.576772 1801 hybrid_clock.cc:648] HybridClock initialized: now 1777794779576657 us; error 113 us; skew 500 ppm
I20260503 07:52:59.577378 1801 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:52:59.578560 1175 ts_tablet_manager.cc:1929] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.580030 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b269ee59036d4c2f866b6b2bf45c35cf
I20260503 07:52:59.580672 596 catalog_manager.cc:6741] ReplaceTablet: tablet b269ee59036d4c2f866b6b2bf45c35cf deleted and replaced by tablet 75872effe17740b0b322a621cb9ceb17
I20260503 07:52:59.571065 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 474) took 1261 ms. Trace:
I20260503 07:52:59.572860 916 raft_consensus.cc:3060] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.580895 1173 rpcz_store.cc:276] 0503 07:52:58.309424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.311734 (+ 2310us) service_pool.cc:224] Handling call
0503 07:52:59.570902 (+1259168us) ts_tablet_manager.cc:1151] Deleting tablet 1bf42130a55744429d2c64ed55671507
0503 07:52:59.570911 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.571033 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258899}
I20260503 07:52:59.581207 1175 log.cc:1199] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bf0f650d2efd4a5d9308952b32fa7d63
I20260503 07:52:59.581284 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 481) took 1213 ms. Trace:
I20260503 07:52:59.581386 1173 rpcz_store.cc:276] 0503 07:52:58.367648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.368037 (+ 389us) service_pool.cc:224] Handling call
0503 07:52:59.581159 (+1213122us) ts_tablet_manager.cc:1151] Deleting tablet ab33d15e70ec4856a15ed7c6175cd334
0503 07:52:59.581167 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.581248 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196472}
I20260503 07:52:59.582077 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 486) took 1184 ms. Trace:
I20260503 07:52:59.582173 1173 rpcz_store.cc:276] 0503 07:52:58.396810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.396871 (+ 61us) service_pool.cc:224] Handling call
0503 07:52:59.581593 (+1184722us) ts_tablet_manager.cc:1151] Deleting tablet 2be28ad252ff47879caa1021fdf5db66
0503 07:52:59.581601 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.581671 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1184538}
I20260503 07:52:59.579366 1171 tablet_bootstrap.cc:654] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.582500 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 485) took 1185 ms. Trace:
I20260503 07:52:59.582607 1173 rpcz_store.cc:276] 0503 07:52:58.396597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.397590 (+ 993us) service_pool.cc:224] Handling call
0503 07:52:59.582376 (+1184786us) ts_tablet_manager.cc:1151] Deleting tablet 94cd6a702c59445882a81ca2e3a0f3f6
0503 07:52:59.582383 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.582464 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165953}
I20260503 07:52:59.583035 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 488) took 1141 ms. Trace:
I20260503 07:52:59.583144 1173 rpcz_store.cc:276] 0503 07:52:58.441118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.441866 (+ 748us) service_pool.cc:224] Handling call
0503 07:52:59.582885 (+1141019us) ts_tablet_manager.cc:1151] Deleting tablet e6fcade062b24ee280d4943d3254df03
0503 07:52:59.582892 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.582984 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139682}
I20260503 07:52:59.583444 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 487) took 1166 ms. Trace:
I20260503 07:52:59.583539 1173 rpcz_store.cc:276] 0503 07:52:58.416563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.416762 (+ 199us) service_pool.cc:224] Handling call
0503 07:52:59.583334 (+1166572us) ts_tablet_manager.cc:1151] Deleting tablet c5765ff6b70046f6a46aab3f413d04f8
0503 07:52:59.583342 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.583407 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113376}
I20260503 07:52:59.583999 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3539f556a19b42f4ae64f57560d2f740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.562067 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c3421b6842944b7b5a3582b8c059837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:52:59.573064 851 leader_election.cc:343] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c46873d43e1b4495a92996e07f93f918
I20260503 07:52:59.584548 851 leader_election.cc:304] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:59.584717 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3539f556a19b42f4ae64f57560d2f740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.584995 1886 raft_consensus.cc:2749] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:59.586150 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1bf42130a55744429d2c64ed55671507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bf42130a55744429d2c64ed55671507 already in progress: creating tablet
W20260503 07:52:59.586380 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ab33d15e70ec4856a15ed7c6175cd334 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab33d15e70ec4856a15ed7c6175cd334 already in progress: creating tablet
W20260503 07:52:59.586585 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2be28ad252ff47879caa1021fdf5db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2be28ad252ff47879caa1021fdf5db66 already in progress: creating tablet
W20260503 07:52:59.586786 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 94cd6a702c59445882a81ca2e3a0f3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94cd6a702c59445882a81ca2e3a0f3f6 already in progress: creating tablet
I20260503 07:52:59.582325 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf with delete_type TABLET_DATA_DELETED (replaced by tablet 75872effe17740b0b322a621cb9ceb17) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.582049 1175 ts_tablet_manager.cc:1950] T bf0f650d2efd4a5d9308952b32fa7d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:52:59.586973 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e6fcade062b24ee280d4943d3254df03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6fcade062b24ee280d4943d3254df03 already in progress: creating tablet
W20260503 07:52:59.587203 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c5765ff6b70046f6a46aab3f413d04f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5765ff6b70046f6a46aab3f413d04f8 already in progress: creating tablet
W20260503 07:52:59.587376 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e63048335fe349ebb6001b37e63a389e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e63048335fe349ebb6001b37e63a389e already in progress: creating tablet
W20260503 07:52:59.587601 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e19e450241e44b19a038808fd4d32e66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19e450241e44b19a038808fd4d32e66 already in progress: creating tablet
I20260503 07:52:59.587638 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 504) took 1336 ms. Trace:
W20260503 07:52:59.587793 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bce8073c9aa549f3b9ee0397984c350b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bce8073c9aa549f3b9ee0397984c350b already in progress: creating tablet
I20260503 07:52:59.587719 1175 rpcz_store.cc:276] 0503 07:52:58.251377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.252304 (+ 927us) service_pool.cc:224] Handling call
0503 07:52:59.451880 (+1199576us) ts_tablet_manager.cc:1151] Deleting tablet bf0f650d2efd4a5d9308952b32fa7d63
0503 07:52:59.451889 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.575683 (+123794us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.578474 (+ 2791us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.587581 (+ 9107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199378}
I20260503 07:52:59.588111 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bf0f650d2efd4a5d9308952b32fa7d63 (table default.Table_a32643442a2541d585cec3f44840509c [id=7f8470e7e307465b8eb6fa6b1b5bf94f]) successfully deleted
I20260503 07:52:59.580617 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 637462b45502433796daa7a9cd8586d3 with delete_type TABLET_DATA_DELETED (replaced by tablet e19d7eab61e24e18a1e4eb600e9d592a) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.580693 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c3421b6842944b7b5a3582b8c059837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.589074 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf with delete_type TABLET_DATA_DELETED (replaced by tablet 75872effe17740b0b322a621cb9ceb17) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.590209 1171 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.590363 1171 ts_tablet_manager.cc:1403] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260503 07:52:59.591048 1171 raft_consensus.cc:359] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.591246 1171 raft_consensus.cc:385] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.591320 1171 raft_consensus.cc:740] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.591562 1171 consensus_queue.cc:260] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.592070 1171 ts_tablet_manager.cc:1434] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:52:59.592758 1175 tablet_replica.cc:333] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.592963 1175 raft_consensus.cc:2243] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.593148 1175 raft_consensus.cc:2272] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.593922 889 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7282819c2345c0befcb18a53cbc166 (DEFAULT_TABLE table=default.Table_e238863a7ff042de954787ef849a7c9d [id=eeaf18dd7fe64739b16a6b8871991b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.595264 1175 ts_tablet_manager.cc:1916] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:59.595458 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 053b644e68e04a80966f374883170221 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 053b644e68e04a80966f374883170221 already in progress: creating tablet
W20260503 07:52:59.596529 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e04bceb67d194f21bab9e7aa790d5a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e04bceb67d194f21bab9e7aa790d5a04 already in progress: creating tablet
W20260503 07:52:59.597962 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f5896bb71c674358957c87a347b8fb79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5896bb71c674358957c87a347b8fb79 already in progress: creating tablet
I20260503 07:52:59.598779 1173 tablet_replica.cc:333] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.599350 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b8bb85190cd94e8282eec9a1bc0efab4
I20260503 07:52:59.599398 1173 raft_consensus.cc:2243] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.599560 1173 raft_consensus.cc:2272] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.600121 1173 ts_tablet_manager.cc:1916] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.600484 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7282819c2345c0befcb18a53cbc166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.601291 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.602129 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_579d94072b504815930a2235c75efb86" } new_table_name: "default.Table_edc7f5baf03440ee9d2c4099a7371ec0" modify_external_catalogs: true
I20260503 07:52:59.603931 742 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.605000 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.605692 1171 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.611505 1171 tablet_bootstrap.cc:654] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.613324 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bd71a81efd3b40c6b96bb77f74e8a4c6
I20260503 07:52:59.614905 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.615108 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.615841 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c3421b6842944b7b5a3582b8c059837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.616364 1767 raft_consensus.cc:493] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.616530 1767 raft_consensus.cc:515] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.617106 1697 consensus_queue.cc:237] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.618332 1810 raft_consensus.cc:493] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.618336 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_af1ce7f7db0347f7a17051eb78c05dfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.618454 1810 raft_consensus.cc:515] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:59.618875 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af1ce7f7db0347f7a17051eb78c05dfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.618956 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 637462b45502433796daa7a9cd8586d3 with delete_type TABLET_DATA_DELETED (replaced by tablet e19d7eab61e24e18a1e4eb600e9d592a) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.619349 1810 leader_election.cc:290] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.620015 741 tablet_service.cc:1558] Processing DeleteTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.620566 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf with delete_type TABLET_DATA_DELETED (replaced by tablet 75872effe17740b0b322a621cb9ceb17) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.620743 1767 leader_election.cc:290] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.621048 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fcade062b24ee280d4943d3254df03" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.621709 715 leader_election.cc:343] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.621842 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fcade062b24ee280d4943d3254df03" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:59.623740 716 leader_election.cc:343] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.623867 716 leader_election.cc:304] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.624331 1810 raft_consensus.cc:2749] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.624701 1801 webserver.cc:492] Webserver started at http://127.0.105.62:39175/ using document root <none> and password file <none>
I20260503 07:52:59.624955 1830 tablet.cc:1724] T e8055ed2748e4a0e9ba1194c40afb5e2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.625759 1831 tablet.cc:1724] T e8055ed2748e4a0e9ba1194c40afb5e2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.626837 1801 fs_manager.cc:362] Metadata directory not provided
I20260503 07:52:59.626997 1801 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:52:59.630935 1848 raft_consensus.cc:493] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.631179 1848 raft_consensus.cc:515] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.631976 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.632222 1848 leader_election.cc:290] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.632488 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.632460 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.633164 988 leader_election.cc:343] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.616631 1174 ts_tablet_manager.cc:1929] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.636976 1734 raft_consensus.cc:493] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.637163 1734 raft_consensus.cc:515] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.637830 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f522dc5e8b12409eb9ed1a763d0db741
I20260503 07:52:59.637885 1734 leader_election.cc:290] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:59.638583 854 leader_election.cc:343] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:59.639216 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.639983 897 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.641350 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_72a2a09ade1d4c50b8838203b8eb121d" } new_table_name: "default.Table_75143e01c8114e2aa8465463ad2e9565" modify_external_catalogs: true
I20260503 07:52:59.642252 1175 ts_tablet_manager.cc:1929] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.643369 1848 raft_consensus.cc:493] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.646037 1848 raft_consensus.cc:515] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.646613 1848 leader_election.cc:290] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.644549 1171 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.646850 1171 ts_tablet_manager.cc:1403] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.001s
I20260503 07:52:59.647300 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.647665 1171 raft_consensus.cc:359] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.647861 1171 raft_consensus.cc:385] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.642359 1175 log.cc:1199] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8c4ec79454524d468c76fd01dec8eb1e
W20260503 07:52:59.647977 988 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.648335 1175 ts_tablet_manager.cc:1950] T 8c4ec79454524d468c76fd01dec8eb1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.650892 1165 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.652225 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 510) took 1374 ms. Trace:
W20260503 07:52:59.652390 716 leader_election.cc:343] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.652498 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.653456 1175 rpcz_store.cc:276] 0503 07:52:58.277845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.280007 (+ 2162us) service_pool.cc:224] Handling call
0503 07:52:59.592283 (+1312276us) ts_tablet_manager.cc:1151] Deleting tablet 8c4ec79454524d468c76fd01dec8eb1e
0503 07:52:59.592291 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.608819 (+ 16528us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.642169 (+ 33350us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.652162 (+ 9993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312058}
I20260503 07:52:59.653812 1175 tablet_replica.cc:333] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.653837 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8c4ec79454524d468c76fd01dec8eb1e (table default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]) successfully deleted
I20260503 07:52:59.654032 1175 raft_consensus.cc:2243] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:52:59.654249 757 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.654940 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ef30af01dc6f40b4b71f59b9cb7ffd66
I20260503 07:52:59.655367 1175 pending_rounds.cc:70] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:52:59.655576 1175 pending_rounds.cc:77] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847411078103040 op_type: NO_OP noop_request { }
I20260503 07:52:59.656024 1175 raft_consensus.cc:2889] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:52:59.656317 1175 raft_consensus.cc:2272] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.657099 1175 ts_tablet_manager.cc:1916] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.657073 897 tablet_service.cc:1558] Processing DeleteTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:52:59.657580 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.657991 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fdab6b23ab974f80b664ca7e95850925" } new_table_name: "default.Table_fc403bfa4191450b8997da247d3131c9" modify_external_catalogs: true
I20260503 07:52:59.662070 1166 tablet_bootstrap.cc:492] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.662231 1166 ts_tablet_manager.cc:1403] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.111s user 0.003s sys 0.011s
I20260503 07:52:59.662956 1166 raft_consensus.cc:359] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.663160 1166 raft_consensus.cc:385] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.663237 1166 raft_consensus.cc:740] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:52:59.666754 715 leader_election.cc:343] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.669176 1165 ts_tablet_manager.cc:1403] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.205s user 0.010s sys 0.005s
I20260503 07:52:59.670178 1175 ts_tablet_manager.cc:1929] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:52:59.670888 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:59.671285 1175 log.cc:1199] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/75dfcff75f90434caf7dc26408958a16
I20260503 07:52:59.672053 1175 ts_tablet_manager.cc:1950] T 75dfcff75f90434caf7dc26408958a16 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.672426 1166 consensus_queue.cc:260] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.672781 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_09de7b363b1a4cbd8be93baba97b150c [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 2 got 0
I20260503 07:52:59.673013 1166 ts_tablet_manager.cc:1434] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260503 07:52:59.673074 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 61e9b97fafa145e0a45e4d81fc9d5947 (table default.Table_72a2a09ade1d4c50b8838203b8eb121d [id=1e683140a3b240e5afeb636098fc51bf]). Expected version 1 got 0
I20260503 07:52:59.673287 1171 raft_consensus.cc:740] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.673610 1171 consensus_queue.cc:260] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.675021 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 516) took 1327 ms. Trace:
I20260503 07:52:59.675320 1175 rpcz_store.cc:276] 0503 07:52:58.347254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.347395 (+ 141us) service_pool.cc:224] Handling call
0503 07:52:59.653739 (+1306344us) ts_tablet_manager.cc:1151] Deleting tablet 75dfcff75f90434caf7dc26408958a16
0503 07:52:59.653747 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.664585 (+ 10838us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.670099 (+ 5514us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.674320 (+ 4221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1306146}
I20260503 07:52:59.676204 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 75dfcff75f90434caf7dc26408958a16 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
I20260503 07:52:59.676277 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 511) took 1367 ms. Trace:
I20260503 07:52:59.676909 1175 rpcz_store.cc:276] 0503 07:52:58.308956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.331801 (+ 22845us) service_pool.cc:224] Handling call
0503 07:52:59.676060 (+1344259us) ts_tablet_manager.cc:1151] Deleting tablet 1bf42130a55744429d2c64ed55671507
0503 07:52:59.676072 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.676245 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314930}
I20260503 07:52:59.677573 1175 tablet_replica.cc:333] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:59.677866 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1bf42130a55744429d2c64ed55671507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bf42130a55744429d2c64ed55671507 already in progress: creating tablet
I20260503 07:52:59.678211 715 leader_election.cc:304] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.678586 1171 ts_tablet_manager.cc:1434] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260503 07:52:59.678874 1767 raft_consensus.cc:2749] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.679031 1166 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.680663 1175 raft_consensus.cc:2243] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:52:59.680917 851 leader_election.cc:343] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:59.681090 1175 raft_consensus.cc:2272] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.681066 851 leader_election.cc:304] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.681495 1734 raft_consensus.cc:2749] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.682214 1171 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.683204 1173 ts_tablet_manager.cc:1929] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.683341 1173 log.cc:1199] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/af1b61a2548e4f3fafb4ed0982dbd9b2
I20260503 07:52:59.683702 1173 ts_tablet_manager.cc:1950] T af1b61a2548e4f3fafb4ed0982dbd9b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.682086 1175 ts_tablet_manager.cc:1916] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.685647 1166 tablet_bootstrap.cc:654] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.687539 779 raft_consensus.cc:2468] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:59.688128 986 leader_election.cc:304] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.688547 1848 raft_consensus.cc:2804] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.688639 1848 raft_consensus.cc:493] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.688760 1848 raft_consensus.cc:3060] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.691260 1848 raft_consensus.cc:515] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.692363 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:59.692409 1848 leader_election.cc:290] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:59.692905 988 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.694582 1171 tablet_bootstrap.cc:654] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.695277 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8ad4a21ffa594aa1bc6f6891bc0213cb" } new_table_name: "default.Table_2692c0bf0e5d44998c33f5f0d213500c" modify_external_catalogs: true
I20260503 07:52:59.696308 1174 log.cc:1199] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3da9549389254875b94268abc5c3bb3e
I20260503 07:52:59.696461 757 tablet_service.cc:1558] Processing DeleteTablet for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.697568 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet af1b61a2548e4f3fafb4ed0982dbd9b2 (table default.Table_624fc879976c487b82c0e5488a4aa546 [id=2ddbaf96a96442479336aac9d7da85db]) successfully deleted
I20260503 07:52:59.698238 1173 tablet_replica.cc:333] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.698772 1173 raft_consensus.cc:2243] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.700248 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:52:59.700510 776 raft_consensus.cc:2468] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:52:59.701180 986 leader_election.cc:304] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.701579 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4674c22562f744f5bce13d97ad8a52b2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.702124 1848 raft_consensus.cc:2804] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.702236 1848 raft_consensus.cc:493] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.702322 1848 raft_consensus.cc:3060] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.705554 1848 raft_consensus.cc:515] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.706446 1848 leader_election.cc:290] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.706566 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:52:59.706864 779 raft_consensus.cc:3060] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:52:59.707263 988 leader_election.cc:343] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.707608 1173 raft_consensus.cc:2272] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.708293 1173 ts_tablet_manager.cc:1916] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.709020 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:52:59.709167 776 raft_consensus.cc:3060] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.713078 1166 tablet_bootstrap.cc:492] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.713281 1166 ts_tablet_manager.cc:1403] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.002s
W20260503 07:52:59.713527 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7a65f69a6c145438e8c721fe2096080 consensus state has no leader
I20260503 07:52:59.714246 1166 raft_consensus.cc:359] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.714461 1166 raft_consensus.cc:385] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.714551 1166 raft_consensus.cc:740] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.714826 1166 consensus_queue.cc:260] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.715704 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a5cc2b29a6234b95bb78235232b7ee7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.716212 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5cc2b29a6234b95bb78235232b7ee7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.717177 776 raft_consensus.cc:2468] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.717635 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2052c845a8f54b8eaa2c48d874be5d78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.717918 986 leader_election.cc:304] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:52:59.718116 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2052c845a8f54b8eaa2c48d874be5d78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.718259 779 raft_consensus.cc:2468] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:52:59.718721 986 leader_election.cc:304] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.719177 1844 raft_consensus.cc:2804] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.719357 1844 raft_consensus.cc:697] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.719588 1165 raft_consensus.cc:359] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.719746 1165 raft_consensus.cc:385] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.719796 1165 raft_consensus.cc:740] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.719661 1844 consensus_queue.cc:237] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.719974 1165 consensus_queue.cc:260] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.720464 1165 ts_tablet_manager.cc:1434] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.051s user 0.001s sys 0.000s
I20260503 07:52:59.720829 1840 raft_consensus.cc:2804] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.720888 1165 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.720992 1840 raft_consensus.cc:697] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:52:59.721254 1840 consensus_queue.cc:237] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.723417 1165 tablet_bootstrap.cc:654] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.729565 1171 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.724479 1810 raft_consensus.cc:493] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.729773 1171 ts_tablet_manager.cc:1403] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260503 07:52:59.729759 1810 raft_consensus.cc:515] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.730304 1810 leader_election.cc:290] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.725473 1174 ts_tablet_manager.cc:1950] T 3da9549389254875b94268abc5c3bb3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.731325 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d4cfb8426c485eb7ff408e04f69141" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.731446 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3da9549389254875b94268abc5c3bb3e (table default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]) successfully deleted
I20260503 07:52:59.731724 1174 tablet_replica.cc:333] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.731897 1174 raft_consensus.cc:2243] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.732028 1174 raft_consensus.cc:2272] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:59.732327 715 leader_election.cc:343] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.732533 1174 ts_tablet_manager.cc:1916] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:52:59.733243 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d08b5135cb77444bb5ff35c5f9d68129 consensus state has no leader
I20260503 07:52:59.734337 1166 ts_tablet_manager.cc:1434] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260503 07:52:59.731994 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d4cfb8426c485eb7ff408e04f69141" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.730530 1171 raft_consensus.cc:359] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.736454 1171 raft_consensus.cc:385] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.736624 1171 raft_consensus.cc:740] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.736970 1171 consensus_queue.cc:260] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.736999 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b3764476999d489dab360b8b4bd40abe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.737407 1049 raft_consensus.cc:2468] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:52:59.737528 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3764476999d489dab360b8b4bd40abe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.738291 1174 ts_tablet_manager.cc:1929] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.738384 1174 log.cc:1199] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/656dfeb5247e4cdfaacd29690353da83
I20260503 07:52:59.738345 716 leader_election.cc:304] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.738701 1174 ts_tablet_manager.cc:1950] T 656dfeb5247e4cdfaacd29690353da83 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.738941 1810 raft_consensus.cc:2804] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:52:59.739034 1810 raft_consensus.cc:493] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:52:59.739114 1810 raft_consensus.cc:3060] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.739578 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 656dfeb5247e4cdfaacd29690353da83 (table default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]) successfully deleted
I20260503 07:52:59.742444 1810 raft_consensus.cc:515] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.744607 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d4cfb8426c485eb7ff408e04f69141" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:52:59.744854 1049 raft_consensus.cc:3060] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.747272 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7c7a9e84b78a4f2b8bb4175728a27882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.747699 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c7a9e84b78a4f2b8bb4175728a27882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.748364 1810 leader_election.cc:290] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.748515 1049 raft_consensus.cc:2468] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:52:59.748936 716 leader_election.cc:304] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:52:59.749159 1810 raft_consensus.cc:2804] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:52:59.749327 1810 raft_consensus.cc:697] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:52:59.749605 1810 consensus_queue.cc:237] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.750870 1801 fs_manager.cc:714] Time spent opening directory manager: real 0.121s user 0.005s sys 0.022s
I20260503 07:52:59.752138 1165 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.752342 1165 ts_tablet_manager.cc:1403] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.002s
I20260503 07:52:59.753213 1165 raft_consensus.cc:359] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.753434 1165 raft_consensus.cc:385] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.753535 1165 raft_consensus.cc:740] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.754082 1165 consensus_queue.cc:260] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.754587 1165 ts_tablet_manager.cc:1434] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:52:59.755159 1165 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.743571 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d4cfb8426c485eb7ff408e04f69141" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:52:59.756299 715 leader_election.cc:343] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.757251 1904 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:52:59.757555 1165 tablet_bootstrap.cc:654] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.758519 1166 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.759920 1801 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.002s sys 0.001s
I20260503 07:52:59.760125 1801 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
uuid: "65adddd546eb49779519c7f7378d0e60"
format_stamp: "Formatted at 2026-05-03 07:52:43 on dist-test-slave-xxz1"
I20260503 07:52:59.761088 1801 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 07:52:59.764920 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3724490a7ed4afc82e4f7ebc1190f76 consensus state has no leader
I20260503 07:52:59.765164 1174 tablet_replica.cc:333] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.765340 1174 raft_consensus.cc:2243] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.765488 1174 raft_consensus.cc:2272] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.766034 1174 ts_tablet_manager.cc:1916] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.768146 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d451c0ddf9b44a208ecac7810971318d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.768957 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d451c0ddf9b44a208ecac7810971318d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.768419 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b5f6d6ca26d6424889c16f51780825fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.770529 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5f6d6ca26d6424889c16f51780825fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.770694 1175 ts_tablet_manager.cc:1929] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.770840 1175 log.cc:1199] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bb96ba84739c45b7847f0c43ab4a08e7
I20260503 07:52:59.771198 1175 ts_tablet_manager.cc:1950] T bb96ba84739c45b7847f0c43ab4a08e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.771991 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 515) took 1425 ms. Trace:
I20260503 07:52:59.772750 1830 tablet.cc:1724] T 61e9b97fafa145e0a45e4d81fc9d5947 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.778434 1907 tablet.cc:1724] T 61e9b97fafa145e0a45e4d81fc9d5947 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.778731 1175 rpcz_store.cc:276] 0503 07:52:58.346246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.347098 (+ 852us) service_pool.cc:224] Handling call
0503 07:52:59.677501 (+1330403us) ts_tablet_manager.cc:1151] Deleting tablet bb96ba84739c45b7847f0c43ab4a08e7
0503 07:52:59.677512 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.694672 (+ 17160us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.770622 (+ 75950us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.771937 (+ 1315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1307408}
I20260503 07:52:59.779582 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bb96ba84739c45b7847f0c43ab4a08e7 (table default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]) successfully deleted
I20260503 07:52:59.780149 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 520) took 1422 ms. Trace:
I20260503 07:52:59.781479 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff] alter complete (version 2)
I20260503 07:52:59.781314 1831 tablet.cc:1724] T 61e9b97fafa145e0a45e4d81fc9d5947 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.783073 593 master_service.cc:954] ReplaceTablet: received request to replace tablet 3cf72d49cfd24083abee07e0d2190e3e from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.785672 1171 ts_tablet_manager.cc:1434] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.056s user 0.001s sys 0.002s
I20260503 07:52:59.785980 1171 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.786267 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.786486 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.786757 1895 raft_consensus.cc:493] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.787029 1895 raft_consensus.cc:515] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.787902 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8d392c3bb94f03819fae08fc009fbc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:52:59.788324 716 leader_election.cc:343] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.789003 1895 leader_election.cc:290] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:52:59.789098 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8d392c3bb94f03819fae08fc009fbc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.789521 715 leader_election.cc:343] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.789618 715 leader_election.cc:304] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.790597 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.790800 741 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.790943 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.790977 1171 tablet_bootstrap.cc:654] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.791100 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.792773 1895 raft_consensus.cc:2749] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.793040 1175 rpcz_store.cc:276] 0503 07:52:58.357274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.368543 (+ 11269us) service_pool.cc:224] Handling call
0503 07:52:59.779344 (+1410801us) ts_tablet_manager.cc:1151] Deleting tablet ab33d15e70ec4856a15ed7c6175cd334
0503 07:52:59.779355 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.780091 (+ 736us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400292}
W20260503 07:52:59.793890 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ab33d15e70ec4856a15ed7c6175cd334 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab33d15e70ec4856a15ed7c6175cd334 already in progress: creating tablet
I20260503 07:52:59.794086 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 524) took 1414 ms. Trace:
I20260503 07:52:59.794610 1175 rpcz_store.cc:276] 0503 07:52:58.379812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.384315 (+ 4503us) service_pool.cc:224] Handling call
0503 07:52:59.793915 (+1409600us) ts_tablet_manager.cc:1151] Deleting tablet 94cd6a702c59445882a81ca2e3a0f3f6
0503 07:52:59.793924 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.794033 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408811}
I20260503 07:52:59.794886 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b36413edc3994196a771f94ebdbade3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:52:59.795490 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b36413edc3994196a771f94ebdbade3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.795935 1175 tablet_replica.cc:333] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:52:59.796763 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 94cd6a702c59445882a81ca2e3a0f3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94cd6a702c59445882a81ca2e3a0f3f6 already in progress: creating tablet
I20260503 07:52:59.797367 1175 raft_consensus.cc:2243] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.797463 1166 tablet_bootstrap.cc:654] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.798502 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_8d86476402b74bc1b5074ad74a7f08ab [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]). Expected version 2 got 0
I20260503 07:52:59.799721 1175 raft_consensus.cc:2272] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.800573 1175 ts_tablet_manager.cc:1916] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.806566 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:52:59.811123 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cca44c2622e4f9493d71e59fc3056ae consensus state has no leader
I20260503 07:52:59.823040 1173 ts_tablet_manager.cc:1929] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.823575 1840 raft_consensus.cc:493] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.823855 1840 raft_consensus.cc:515] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.825876 1840 leader_election.cc:290] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:52:59.826309 986 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:52:59.826918 1895 raft_consensus.cc:493] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.827101 1895 raft_consensus.cc:515] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.827523 1174 ts_tablet_manager.cc:1929] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.828934 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.829568 1171 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.829739 1171 ts_tablet_manager.cc:1403] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.004s
I20260503 07:52:59.824993 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2b065666ec4f1299b47d45cd1f600b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.831331 988 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.831457 988 leader_election.cc:304] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.831782 599 master_service.cc:954] ReplaceTablet: received request to replace tablet cf24705f7d004254bf8456c063634d65 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.828601 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.832113 1840 raft_consensus.cc:2749] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.832547 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_704725dd7d6349ce9fa1159720280ae3" } modify_external_catalogs: true
I20260503 07:52:59.832718 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_704725dd7d6349ce9fa1159720280ae3" } modify_external_catalogs: true
I20260503 07:52:59.828732 1895 leader_election.cc:290] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:52:59.829399 716 leader_election.cc:343] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:52:59.834165 715 leader_election.cc:343] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.834303 1165 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.834355 715 leader_election.cc:304] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.834412 1165 ts_tablet_manager.cc:1403] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.003s
I20260503 07:52:59.834637 1810 raft_consensus.cc:2749] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.835000 1174 log.cc:1199] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/efec3cb45daf44e59132ea4d8929bd43
I20260503 07:52:59.832742 1173 log.cc:1199] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/0481b55721854d70a670a79ff2f42dd6
I20260503 07:52:59.835745 1173 ts_tablet_manager.cc:1950] T 0481b55721854d70a670a79ff2f42dd6 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.835892 1171 raft_consensus.cc:359] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.836650 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 0481b55721854d70a670a79ff2f42dd6 (table default.Table_e2bc25f5f06e49cf99dcf1f8401d66d5 [id=0fbceb4c0fd74bb0a162136215a4a5c0]) successfully deleted
I20260503 07:52:59.836925 1171 raft_consensus.cc:385] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.835076 1165 raft_consensus.cc:359] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.837621 1165 raft_consensus.cc:385] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.837707 1165 raft_consensus.cc:740] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.837833 1171 raft_consensus.cc:740] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.837966 1165 consensus_queue.cc:260] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.838301 1171 consensus_queue.cc:260] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.838694 1173 tablet_replica.cc:333] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.838413 1165 ts_tablet_manager.cc:1434] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:52:59.839368 1165 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.839617 1173 raft_consensus.cc:2243] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.842990 1171 ts_tablet_manager.cc:1434] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260503 07:52:59.843724 1165 tablet_bootstrap.cc:654] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.844038 1173 raft_consensus.cc:2272] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.844627 1174 ts_tablet_manager.cc:1950] T efec3cb45daf44e59132ea4d8929bd43 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.845945 1171 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.846750 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet efec3cb45daf44e59132ea4d8929bd43 (table default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]) successfully deleted
I20260503 07:52:59.847731 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b881a8a82a24c63acfd121516db44b8" } modify_external_catalogs: true
I20260503 07:52:59.847916 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b881a8a82a24c63acfd121516db44b8" } modify_external_catalogs: true
I20260503 07:52:59.848723 1173 ts_tablet_manager.cc:1916] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.848465 1840 raft_consensus.cc:493] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.848946 1840 raft_consensus.cc:515] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.849339 1174 tablet_replica.cc:333] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.849517 1174 raft_consensus.cc:2243] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.849521 1840 leader_election.cc:290] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.849643 1174 raft_consensus.cc:2272] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.850107 1174 ts_tablet_manager.cc:1916] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.850715 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388c63dc20da408ca3e141ada0200be6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:52:59.851181 986 leader_election.cc:343] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:52:59.852979 1171 tablet_bootstrap.cc:654] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.850087 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388c63dc20da408ca3e141ada0200be6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.857699 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3ba0569253f4fc09368055804a5dcde" } modify_external_catalogs: true
I20260503 07:52:59.857852 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f3ba0569253f4fc09368055804a5dcde" } modify_external_catalogs: true
I20260503 07:52:59.859062 1165 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.859167 1165 ts_tablet_manager.cc:1403] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260503 07:52:59.859769 1165 raft_consensus.cc:359] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.859921 1165 raft_consensus.cc:385] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.859974 1165 raft_consensus.cc:740] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.860142 1165 consensus_queue.cc:260] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.861124 1165 ts_tablet_manager.cc:1434] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:52:59.861368 1165 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.863534 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 2c3421b6842944b7b5a3582b8c059837 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.863647 1165 tablet_bootstrap.cc:654] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.865248 1166 tablet_bootstrap.cc:492] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.865450 1166 ts_tablet_manager.cc:1403] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.107s user 0.001s sys 0.004s
I20260503 07:52:59.866793 1174 ts_tablet_manager.cc:1929] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:59.853886 988 leader_election.cc:343] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.872854 988 leader_election.cc:304] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.873006 1734 raft_consensus.cc:493] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.873155 1734 raft_consensus.cc:515] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.873409 1840 raft_consensus.cc:2749] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.873756 1734 leader_election.cc:290] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.861058 1175 ts_tablet_manager.cc:1929] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.874255 1175 log.cc:1199] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c5765ff6b70046f6a46aab3f413d04f8
W20260503 07:52:59.874766 854 leader_election.cc:343] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 55eb2ad7619a4a9aabe8b8d062455390
W20260503 07:52:59.874995 851 leader_election.cc:343] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:52:59.875130 851 leader_election.cc:304] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:52:59.875200 1175 ts_tablet_manager.cc:1950] T c5765ff6b70046f6a46aab3f413d04f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.875360 1166 raft_consensus.cc:359] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.875576 1734 raft_consensus.cc:2749] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.875619 1166 raft_consensus.cc:385] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.875699 1166 raft_consensus.cc:740] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.875954 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 526) took 1468 ms. Trace:
I20260503 07:52:59.875998 1166 consensus_queue.cc:260] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.876106 1175 rpcz_store.cc:276] 0503 07:52:58.407789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.408055 (+ 266us) service_pool.cc:224] Handling call
0503 07:52:59.795861 (+1387806us) ts_tablet_manager.cc:1151] Deleting tablet c5765ff6b70046f6a46aab3f413d04f8
0503 07:52:59.795870 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.846479 (+ 50609us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.860978 (+ 14499us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.875913 (+ 14935us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376125}
I20260503 07:52:59.876588 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c5765ff6b70046f6a46aab3f413d04f8 (table default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]) successfully deleted
I20260503 07:52:59.877194 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 527) took 1463 ms. Trace:
I20260503 07:52:59.878075 1166 ts_tablet_manager.cc:1434] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20260503 07:52:59.877345 1175 rpcz_store.cc:276] 0503 07:52:58.418385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.422340 (+ 3955us) service_pool.cc:224] Handling call
0503 07:52:59.876966 (+1454626us) ts_tablet_manager.cc:1151] Deleting tablet e6fcade062b24ee280d4943d3254df03
0503 07:52:59.877069 (+ 103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.877163 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1438707}
I20260503 07:52:59.875021 1165 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.879220 1165 ts_tablet_manager.cc:1403] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:52:59.879598 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 525) took 1495 ms. Trace:
I20260503 07:52:59.879757 1174 log.cc:1199] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/388c63dc20da408ca3e141ada0200be6
I20260503 07:52:59.880090 1174 ts_tablet_manager.cc:1950] T 388c63dc20da408ca3e141ada0200be6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:52:59.880245 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e7364b796a041c1a161bdb798b5a566" } modify_external_catalogs: true
I20260503 07:52:59.880445 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e7364b796a041c1a161bdb798b5a566" } modify_external_catalogs: true
I20260503 07:52:59.880827 1165 raft_consensus.cc:359] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.880988 1165 raft_consensus.cc:385] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.881037 1165 raft_consensus.cc:740] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.881085 916 raft_consensus.cc:3060] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:52:59.881215 1165 consensus_queue.cc:260] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:52:59.882020 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e6fcade062b24ee280d4943d3254df03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6fcade062b24ee280d4943d3254df03 already in progress: creating tablet
I20260503 07:52:59.882241 1165 ts_tablet_manager.cc:1434] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:52:59.882474 1165 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.882655 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 388c63dc20da408ca3e141ada0200be6 (table default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]) successfully deleted
I20260503 07:52:59.883811 1165 tablet_bootstrap.cc:654] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.885771 1175 rpcz_store.cc:276] 0503 07:52:58.384275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.384632 (+ 357us) service_pool.cc:224] Handling call
0503 07:52:59.879477 (+1494845us) ts_tablet_manager.cc:1151] Deleting tablet 2be28ad252ff47879caa1021fdf5db66
0503 07:52:59.879485 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.879569 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1421629}
I20260503 07:52:59.886860 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_03280762d4884d6684c217c6ad942cb4" } modify_external_catalogs: true
I20260503 07:52:59.887007 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_03280762d4884d6684c217c6ad942cb4" } modify_external_catalogs: true
W20260503 07:52:59.888877 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2be28ad252ff47879caa1021fdf5db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2be28ad252ff47879caa1021fdf5db66 already in progress: creating tablet
W20260503 07:52:59.889063 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9e162006cee34182b51f97629a174509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e162006cee34182b51f97629a174509 already in progress: creating tablet
W20260503 07:52:59.889881 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b8bb85190cd94e8282eec9a1bc0efab4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8bb85190cd94e8282eec9a1bc0efab4 already in progress: creating tablet
I20260503 07:52:59.889937 1166 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:52:59.890448 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2c3421b6842944b7b5a3582b8c059837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3421b6842944b7b5a3582b8c059837 already in progress: creating tablet
W20260503 07:52:59.891006 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 637462b45502433796daa7a9cd8586d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637462b45502433796daa7a9cd8586d3 already in progress: creating tablet
W20260503 07:52:59.891624 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd71a81efd3b40c6b96bb77f74e8a4c6 already in progress: creating tablet
I20260503 07:52:59.891660 1173 ts_tablet_manager.cc:1929] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:52:59.892937 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b269ee59036d4c2f866b6b2bf45c35cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b269ee59036d4c2f866b6b2bf45c35cf already in progress: creating tablet
W20260503 07:52:59.898433 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f522dc5e8b12409eb9ed1a763d0db741 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f522dc5e8b12409eb9ed1a763d0db741 already in progress: creating tablet
W20260503 07:52:59.899137 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef30af01dc6f40b4b71f59b9cb7ffd66 already in progress: creating tablet
I20260503 07:52:59.899402 1175 tablet_replica.cc:333] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.899744 1175 raft_consensus.cc:2243] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.899878 1174 tablet_replica.cc:333] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:52:59.900104 1174 raft_consensus.cc:2243] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.900362 1174 raft_consensus.cc:2272] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.901016 1174 ts_tablet_manager.cc:1916] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.902283 1175 raft_consensus.cc:2272] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.902999 1175 ts_tablet_manager.cc:1916] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.911929 1166 tablet_bootstrap.cc:654] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.914146 1173 log.cc:1199] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c46873d43e1b4495a92996e07f93f918
I20260503 07:52:59.914556 1173 ts_tablet_manager.cc:1950] T c46873d43e1b4495a92996e07f93f918 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.915366 1173 tablet_replica.cc:333] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:52:59.916491 1173 raft_consensus.cc:2243] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.917325 1166 tablet_bootstrap.cc:492] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.917498 1166 ts_tablet_manager.cc:1403] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.003s
I20260503 07:52:59.916759 1173 raft_consensus.cc:2272] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:52:59.918238 1166 raft_consensus.cc:359] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.918486 1166 raft_consensus.cc:385] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.918632 1166 raft_consensus.cc:740] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.918787 1173 ts_tablet_manager.cc:1916] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.918915 1166 consensus_queue.cc:260] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.920032 1166 ts_tablet_manager.cc:1434] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:52:59.920485 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c46873d43e1b4495a92996e07f93f918 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
I20260503 07:52:59.920836 1166 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.923223 1166 tablet_bootstrap.cc:654] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.924968 1165 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:52:59.925103 1165 ts_tablet_manager.cc:1403] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.000s
I20260503 07:52:59.925625 1175 ts_tablet_manager.cc:1929] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.925810 1175 log.cc:1199] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e63048335fe349ebb6001b37e63a389e
I20260503 07:52:59.925932 1165 raft_consensus.cc:359] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.926105 1165 raft_consensus.cc:385] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.926162 1165 raft_consensus.cc:740] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.926308 1175 ts_tablet_manager.cc:1950] T e63048335fe349ebb6001b37e63a389e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:52:59.926348 1165 consensus_queue.cc:260] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.926477 1171 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:52:59.926772 1165 ts_tablet_manager.cc:1434] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:52:59.927227 1171 ts_tablet_manager.cc:1403] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.000s
I20260503 07:52:59.927284 1165 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:52:59.928130 1907 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:52:59.929189 1165 tablet_bootstrap.cc:654] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.929539 1166 tablet_bootstrap.cc:492] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:52:59.931943 1171 raft_consensus.cc:359] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.932200 1171 raft_consensus.cc:385] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.932299 1171 raft_consensus.cc:740] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.932550 1171 consensus_queue.cc:260] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.929749 1166 ts_tablet_manager.cc:1403] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20260503 07:52:59.938004 1171 ts_tablet_manager.cc:1434] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:52:59.938338 1171 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:52:59.940682 1166 raft_consensus.cc:359] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.940944 1166 raft_consensus.cc:385] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:52:59.941035 1166 raft_consensus.cc:740] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:52:59.941296 1166 consensus_queue.cc:260] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.942133 1166 ts_tablet_manager.cc:1434] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260503 07:52:59.944058 1166 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:52:59.946950 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 545) took 1006 ms. Trace:
I20260503 07:52:59.948428 1175 rpcz_store.cc:276] 0503 07:52:58.940360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:58.940495 (+ 135us) service_pool.cc:224] Handling call
0503 07:52:59.886681 (+946186us) ts_tablet_manager.cc:1151] Deleting tablet e63048335fe349ebb6001b37e63a389e
0503 07:52:59.886689 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:52:59.906316 (+ 19627us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.925557 (+ 19241us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:59.946901 (+ 21344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":942975}
I20260503 07:52:59.949450 1848 raft_consensus.cc:493] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.949597 1848 raft_consensus.cc:515] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:52:59.949783 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e63048335fe349ebb6001b37e63a389e (table default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]) successfully deleted
W20260503 07:52:59.950147 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e19e450241e44b19a038808fd4d32e66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19e450241e44b19a038808fd4d32e66 already in progress: creating tablet
I20260503 07:52:59.950282 1848 leader_election.cc:290] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:52:59.952028 593 catalog_manager.cc:5671] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:59.952445 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
I20260503 07:52:59.952740 593 catalog_manager.cc:5671] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:52:59.953233 593 catalog_manager.cc:5671] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:52:59.953400 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_973f93b8aa7b411798df3fbb57b4ebf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:52:59.953671 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:52:59.948112 1173 ts_tablet_manager.cc:1929] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:52:59.950839 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656dfeb5247e4cdfaacd29690353da83" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:52:59.956539 1173 log.cc:1199] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8dd0b6afae47432e9da300ba07e970e5
W20260503 07:52:59.956629 988 leader_election.cc:343] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.954881 1166 tablet_bootstrap.cc:654] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:52:59.957032 1173 ts_tablet_manager.cc:1950] T 8dd0b6afae47432e9da300ba07e970e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:52:59.957267 1175 tablet_replica.cc:333] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:52:59.957675 1175 raft_consensus.cc:2243] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:52:59.957885 1175 raft_consensus.cc:2272] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:52:59.958304 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bce8073c9aa549f3b9ee0397984c350b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bce8073c9aa549f3b9ee0397984c350b already in progress: creating tablet
W20260503 07:52:59.958398 986 leader_election.cc:343] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 656dfeb5247e4cdfaacd29690353da83
W20260503 07:52:59.958518 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 053b644e68e04a80966f374883170221 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 053b644e68e04a80966f374883170221 already in progress: creating tablet
I20260503 07:52:59.958524 986 leader_election.cc:304] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:52:59.958721 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e04bceb67d194f21bab9e7aa790d5a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e04bceb67d194f21bab9e7aa790d5a04 already in progress: creating tablet
I20260503 07:52:59.958837 1175 ts_tablet_manager.cc:1916] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:52:59.958914 1848 raft_consensus.cc:2749] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:52:59.958918 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f5896bb71c674358957c87a347b8fb79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5896bb71c674358957c87a347b8fb79 already in progress: creating tablet
I20260503 07:52:59.960757 757 tablet_service.cc:1511] Processing CreateTablet for tablet acbfff84673541929083cbc13b059398 (DEFAULT_TABLE table=default.Table_16ede9de6dc5448e981c9d7a23f0705e [id=4572a88e67e14908824b872afb505f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.960831 1015 tablet_service.cc:1511] Processing CreateTablet for tablet acbfff84673541929083cbc13b059398 (DEFAULT_TABLE table=default.Table_16ede9de6dc5448e981c9d7a23f0705e [id=4572a88e67e14908824b872afb505f79]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:52:59.960963 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973f93b8aa7b411798df3fbb57b4ebf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:52:59.961175 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbfff84673541929083cbc13b059398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.961190 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbfff84673541929083cbc13b059398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.963428 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1df4fefd52434b118e1ed016d5d629bb (DEFAULT_TABLE table=default.Table_d00be731a08f4242a005057e341dd1d7 [id=a15b9d0ea534426789c8164e658b3aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.963712 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df4fefd52434b118e1ed016d5d629bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.964823 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1df4fefd52434b118e1ed016d5d629bb (DEFAULT_TABLE table=default.Table_d00be731a08f4242a005057e341dd1d7 [id=a15b9d0ea534426789c8164e658b3aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.965161 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df4fefd52434b118e1ed016d5d629bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.968614 1895 raft_consensus.cc:493] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:52:59.968793 1895 raft_consensus.cc:515] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:52:59.969080 1801 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:52:59.969517 1895 leader_election.cc:290] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:52:59.970183 1801 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:52:59.970165 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:52:59.970460 1801 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260503 07:52:59.971199 716 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.975291 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a0e9349f195a406083c9a7e1432f1237 (DEFAULT_TABLE table=default.Table_00bf13f51cb2470783a5ec5fd0300ab5 [id=c7aaae46b8cf4ba987b73fdd96fea224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.975790 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e9349f195a406083c9a7e1432f1237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.978072 742 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec609f31b8949dba039bd52c40b9e89 (DEFAULT_TABLE table=default.Table_c72daa9502084bff9445da8f6a6715ba [id=e81f25ce7b0e4ff183ee9827607cb2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.978403 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec609f31b8949dba039bd52c40b9e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.979660 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 23eacb83c81442d4b6bfc25717fe21e8
I20260503 07:52:59.980438 757 tablet_service.cc:1511] Processing CreateTablet for tablet a328057ceb3640d1a26b773862492f04 (DEFAULT_TABLE table=default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4 [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.980752 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a328057ceb3640d1a26b773862492f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.981045 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.981319 741 tablet_service.cc:1511] Processing CreateTablet for tablet 2902de8dbab64eb79a12feed35656676 (DEFAULT_TABLE table=default.Table_f3ba0569253f4fc09368055804a5dcde [id=cc45a5ff91a64cc3a13843a6a0604649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.981602 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902de8dbab64eb79a12feed35656676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.981906 752 tablet_service.cc:1511] Processing CreateTablet for tablet a0e9349f195a406083c9a7e1432f1237 (DEFAULT_TABLE table=default.Table_00bf13f51cb2470783a5ec5fd0300ab5 [id=c7aaae46b8cf4ba987b73fdd96fea224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.981954 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec609f31b8949dba039bd52c40b9e89 (DEFAULT_TABLE table=default.Table_c72daa9502084bff9445da8f6a6715ba [id=e81f25ce7b0e4ff183ee9827607cb2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.982168 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e9349f195a406083c9a7e1432f1237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.982348 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec609f31b8949dba039bd52c40b9e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.984386 759 tablet_service.cc:1511] Processing CreateTablet for tablet 73eea699716e4873a90a01d1b17eb994 (DEFAULT_TABLE table=default.Table_8c645c5277204399a1bb940f83954890 [id=36ad7168a13748f49c72304280c446cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.984661 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73eea699716e4873a90a01d1b17eb994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.986284 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a328057ceb3640d1a26b773862492f04 (DEFAULT_TABLE table=default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4 [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.987138 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a328057ceb3640d1a26b773862492f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.987771 897 tablet_service.cc:1511] Processing CreateTablet for tablet acbfff84673541929083cbc13b059398 (DEFAULT_TABLE table=default.Table_16ede9de6dc5448e981c9d7a23f0705e [id=4572a88e67e14908824b872afb505f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.987933 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:52:59.988452 715 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:52:59.988610 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbfff84673541929083cbc13b059398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.988612 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2902de8dbab64eb79a12feed35656676
I20260503 07:52:59.988576 715 leader_election.cc:304] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:52:59.989153 1895 raft_consensus.cc:2749] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:52:59.990156 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5c30f15ad13340c89df3f5c8d65d63c7
I20260503 07:52:59.990684 592 master_service.cc:954] ReplaceTablet: received request to replace tablet bf0f650d2efd4a5d9308952b32fa7d63 from {username='slave'} at 127.0.0.1:44308
I20260503 07:52:59.991353 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.991669 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 2902de8dbab64eb79a12feed35656676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:52:59.992867 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1df4fefd52434b118e1ed016d5d629bb (DEFAULT_TABLE table=default.Table_d00be731a08f4242a005057e341dd1d7 [id=a15b9d0ea534426789c8164e658b3aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.993177 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df4fefd52434b118e1ed016d5d629bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.994123 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.994477 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.994570 896 tablet_service.cc:1511] Processing CreateTablet for tablet a0e9349f195a406083c9a7e1432f1237 (DEFAULT_TABLE table=default.Table_00bf13f51cb2470783a5ec5fd0300ab5 [id=c7aaae46b8cf4ba987b73fdd96fea224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.994894 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e9349f195a406083c9a7e1432f1237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.995157 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2902de8dbab64eb79a12feed35656676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:52:59.995426 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 73eea699716e4873a90a01d1b17eb994 (DEFAULT_TABLE table=default.Table_8c645c5277204399a1bb940f83954890 [id=36ad7168a13748f49c72304280c446cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.995857 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73eea699716e4873a90a01d1b17eb994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:52:59.998147 891 tablet_service.cc:1511] Processing CreateTablet for tablet a328057ceb3640d1a26b773862492f04 (DEFAULT_TABLE table=default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4 [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:52:59.998764 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a328057ceb3640d1a26b773862492f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.004525 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:00.004803 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:00.005878 601 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_75143e01c8114e2aa8465463ad2e9565 [id=1e683140a3b240e5afeb636098fc51bf] alter complete (version 2)
I20260503 07:53:00.005965 885 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec609f31b8949dba039bd52c40b9e89 (DEFAULT_TABLE table=default.Table_c72daa9502084bff9445da8f6a6715ba [id=e81f25ce7b0e4ff183ee9827607cb2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.006333 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec609f31b8949dba039bd52c40b9e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.007815 1173 tablet_replica.cc:333] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.007908 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.008114 884 tablet_service.cc:1511] Processing CreateTablet for tablet 2902de8dbab64eb79a12feed35656676 (DEFAULT_TABLE table=default.Table_f3ba0569253f4fc09368055804a5dcde [id=cc45a5ff91a64cc3a13843a6a0604649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.009387 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6568bda8fa9642f48f897e9baf755493" } new_table_name: "default.Table_f3a8809551a24bc48a104abfe58153f1" modify_external_catalogs: true
I20260503 07:53:00.011005 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0f5167cd18ea4da7a967e8637f5f3c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.011288 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2902de8dbab64eb79a12feed35656676 (DEFAULT_TABLE table=default.Table_f3ba0569253f4fc09368055804a5dcde [id=cc45a5ff91a64cc3a13843a6a0604649]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:00.011514 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f5167cd18ea4da7a967e8637f5f3c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.008733 742 tablet_service.cc:1511] Processing CreateTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d (DEFAULT_TABLE table=default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.012142 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e688661ecdc4ba1b8b8c0867499fe4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.013393 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_32487ae3bc8d4f6895f892ff9f1e08d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.013818 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32487ae3bc8d4f6895f892ff9f1e08d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.014911 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0479ecf60a7c44aeaa6094faa36237dc" } new_table_name: "default.Table_af4a886426b247b7ae33063090adeea5" modify_external_catalogs: true
I20260503 07:53:00.017427 1173 raft_consensus.cc:2243] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.017838 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902de8dbab64eb79a12feed35656676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.018821 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902de8dbab64eb79a12feed35656676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.020480 759 tablet_service.cc:1511] Processing CreateTablet for tablet a6050ebde3e741a1b551eecf1f704689 (DEFAULT_TABLE table=default.Table_24a0406bc2814a528e089ec908f4e841 [id=9dd295734462463e8cc97b65ef665d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.020841 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6050ebde3e741a1b551eecf1f704689. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:00.022454 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 45433.9us
I20260503 07:53:00.024953 880 tablet_service.cc:1511] Processing CreateTablet for tablet 73eea699716e4873a90a01d1b17eb994 (DEFAULT_TABLE table=default.Table_8c645c5277204399a1bb940f83954890 [id=36ad7168a13748f49c72304280c446cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.025301 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73eea699716e4873a90a01d1b17eb994. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:00.029242 1734 raft_consensus.cc:670] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260503 07:53:00.029609 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.031173 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 55eb2ad7619a4a9aabe8b8d062455390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.031965 895 tablet_service.cc:1558] Processing DeleteTablet for tablet f11c020bd0484adfa6d7dae67818f7e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6954ec38f7f742eaa7cc05af5b1432d0) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.032622 879 tablet_service.cc:1558] Processing DeleteTablet for tablet be15f49b155746d1924868d9f91e9206 with delete_type TABLET_DATA_DELETED (replaced by tablet 956600f557b84dac98be63ffe14f4e19) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.032745 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2902de8dbab64eb79a12feed35656676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.040359 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c14998ce78c64e58ac5b7f651b6b88ba
I20260503 07:53:00.041102 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cf24705f7d004254bf8456c063634d65
I20260503 07:53:00.041522 599 catalog_manager.cc:6741] ReplaceTablet: tablet cf24705f7d004254bf8456c063634d65 deleted and replaced by tablet e0fdfb3008a14b1cb18aee69c400743d
I20260503 07:53:00.042157 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd241f8b17b412e8789b0918357bf35 (DEFAULT_TABLE table=default.Table_0587fb3c8fde478f986d1a87b3f0d543 [id=98a0251aaa914c66a5a62a42fe025afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.042245 750 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.043026 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8dd0b6afae47432e9da300ba07e970e5 (table default.Table_65c6bc92985540169483b8658efddc00 [id=b72cd67d9e6a4b02a81d5c22ac0a0ad8]) successfully deleted
I20260503 07:53:00.043054 1165 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.043202 1165 ts_tablet_manager.cc:1403] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.116s user 0.000s sys 0.007s
I20260503 07:53:00.044143 1165 raft_consensus.cc:359] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.044461 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd241f8b17b412e8789b0918357bf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.044380 741 tablet_service.cc:1558] Processing DeleteTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.044401 1165 raft_consensus.cc:385] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.044523 1165 raft_consensus.cc:740] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.044808 1165 consensus_queue.cc:260] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.045497 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet daa746af69854c00af24357a0d555513
I20260503 07:53:00.046368 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d (DEFAULT_TABLE table=default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.047274 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_09de7b363b1a4cbd8be93baba97b150c [id=ed518a72e0fd490a89f83cb777747bf2] alter complete (version 2)
I20260503 07:53:00.048184 741 tablet_service.cc:1558] Processing DeleteTablet for tablet daa746af69854c00af24357a0d555513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.048591 1165 ts_tablet_manager.cc:1434] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260503 07:53:00.048725 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e688661ecdc4ba1b8b8c0867499fe4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.048969 1165 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.049779 897 tablet_service.cc:1511] Processing CreateTablet for tablet a6050ebde3e741a1b551eecf1f704689 (DEFAULT_TABLE table=default.Table_24a0406bc2814a528e089ec908f4e841 [id=9dd295734462463e8cc97b65ef665d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.050673 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_223806904cb84dcfb31434dee4a4d0e7" } new_table_name: "default.Table_42152ea98fcc4c7197cbc65c60e0a583" modify_external_catalogs: true
I20260503 07:53:00.051065 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e3a65f762f5400397093e1d1f388077" } new_table_name: "default.Table_17357aa2dbaf445da87cced040fdbc82" modify_external_catalogs: true
I20260503 07:53:00.052116 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_515e4767dbc34f0a9305add1a1151aea" } new_table_name: "default.Table_b3dad368cb764163b9d4cbc4d27a330a" modify_external_catalogs: true
I20260503 07:53:00.052264 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6050ebde3e741a1b551eecf1f704689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.052735 895 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.052899 879 tablet_service.cc:1558] Processing DeleteTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.053438 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7e13cceca5d24df38154032bd30dd8a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.053923 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e13cceca5d24df38154032bd30dd8a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.054519 1165 tablet_bootstrap.cc:654] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.055825 879 tablet_service.cc:1558] Processing DeleteTablet for tablet daa746af69854c00af24357a0d555513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.058517 742 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd241f8b17b412e8789b0918357bf35 (DEFAULT_TABLE table=default.Table_0587fb3c8fde478f986d1a87b3f0d543 [id=98a0251aaa914c66a5a62a42fe025afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.059564 1171 tablet_bootstrap.cc:654] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.060667 1166 tablet_bootstrap.cc:492] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:00.060807 1166 ts_tablet_manager.cc:1403] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.001s
I20260503 07:53:00.061143 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd241f8b17b412e8789b0918357bf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.068205 1895 raft_consensus.cc:493] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.068328 1895 raft_consensus.cc:515] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.068929 1895 leader_election.cc:290] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.071293 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb362fee7bc4f948d3a5b660e9cbd1a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.072213 715 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.074061 1166 raft_consensus.cc:359] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.074316 1166 raft_consensus.cc:385] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.074709 1166 raft_consensus.cc:740] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.074967 1166 consensus_queue.cc:260] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.076889 1166 ts_tablet_manager.cc:1434] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260503 07:53:00.080658 1173 raft_consensus.cc:2272] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.081518 1174 ts_tablet_manager.cc:1929] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.082602 1848 consensus_queue.cc:1048] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260503 07:53:00.083578 988 consensus_peers.cc:597] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:00.083659 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb362fee7bc4f948d3a5b660e9cbd1a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.084319 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.084283 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd241f8b17b412e8789b0918357bf35 (DEFAULT_TABLE table=default.Table_0587fb3c8fde478f986d1a87b3f0d543 [id=98a0251aaa914c66a5a62a42fe025afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.084797 1166 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:00.084792 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d (DEFAULT_TABLE table=default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.085562 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet daa746af69854c00af24357a0d555513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.085837 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd241f8b17b412e8789b0918357bf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.086114 1022 tablet_service.cc:1511] Processing CreateTablet for tablet a6050ebde3e741a1b551eecf1f704689 (DEFAULT_TABLE table=default.Table_24a0406bc2814a528e089ec908f4e841 [id=9dd295734462463e8cc97b65ef665d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.090449 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:00.091363 986 consensus_peers.cc:597] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3da9549389254875b94268abc5c3bb3e. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:00.096521 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6050ebde3e741a1b551eecf1f704689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.098075 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e688661ecdc4ba1b8b8c0867499fe4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.098928 1848 raft_consensus.cc:493] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.099545 1848 raft_consensus.cc:515] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.101215 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.104615 1173 ts_tablet_manager.cc:1916] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:00.085397 716 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.102851 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.108304 775 raft_consensus.cc:2468] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:00.108279 716 leader_election.cc:304] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.108485 1895 raft_consensus.cc:2749] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.110291 1174 log.cc:1199] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:00.110839 1174 ts_tablet_manager.cc:1950] T 4674c22562f744f5bce13d97ad8a52b2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.112099 1174 tablet_replica.cc:333] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.113258 1174 raft_consensus.cc:2243] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:00.114584 1174 pending_rounds.cc:70] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:00.114708 593 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d] alter complete (version 2)
I20260503 07:53:00.114864 1174 pending_rounds.cc:77] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847417314033664 op_type: NO_OP noop_request { }
I20260503 07:53:00.115015 1174 raft_consensus.cc:2889] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:00.115132 1174 raft_consensus.cc:2272] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:00.116138 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9e78eb6d2a3489dbb15806dd93867a4 consensus state has no leader
I20260503 07:53:00.119277 891 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.119604 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 4674c22562f744f5bce13d97ad8a52b2 (table default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]) successfully deleted
I20260503 07:53:00.119750 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3210d1ecd42198e080b02a8b594a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.121917 752 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 (DEFAULT_TABLE table=default.Table_7cea10a432034ea5b19576ea1448baa0 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.122251 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfc39292764a93a7cbb7c83f11e179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.122186 750 tablet_service.cc:1511] Processing CreateTablet for tablet 597c7c65f49a4811997d99a782e7b146 (DEFAULT_TABLE table=default.Table_78703a3f97e64063b89538ad0132cc85 [id=db0c3c2757034af0ba5ff3d9fc7f8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.122956 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597c7c65f49a4811997d99a782e7b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.123811 1895 raft_consensus.cc:493] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.123919 1895 raft_consensus.cc:515] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.124274 741 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.124480 1895 leader_election.cc:290] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.128052 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.128619 1734 raft_consensus.cc:493] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:00.128636 715 leader_election.cc:343] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.128763 1734 raft_consensus.cc:515] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.121948 742 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.129338 1734 leader_election.cc:290] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.129961 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.135452 896 tablet_service.cc:1511] Processing CreateTablet for tablet c51fe76096684794aac4f5f65c8de1b5 (DEFAULT_TABLE table=default.Table_55cec2a278e54eb2931506731ca04e8f [id=e5759f642ec04d1da31d098d711e8740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.135821 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51fe76096684794aac4f5f65c8de1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.140439 885 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 (DEFAULT_TABLE table=default.Table_7cea10a432034ea5b19576ea1448baa0 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.140815 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfc39292764a93a7cbb7c83f11e179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.144456 1166 tablet_bootstrap.cc:654] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.145107 1848 leader_election.cc:290] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.145252 988 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.145505 880 tablet_service.cc:1511] Processing CreateTablet for tablet 597c7c65f49a4811997d99a782e7b146 (DEFAULT_TABLE table=default.Table_78703a3f97e64063b89538ad0132cc85 [id=db0c3c2757034af0ba5ff3d9fc7f8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.145915 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597c7c65f49a4811997d99a782e7b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.152417 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:00.153257 716 leader_election.cc:343] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.153381 716 leader_election.cc:304] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.154876 1895 raft_consensus.cc:2749] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.156160 1173 ts_tablet_manager.cc:1929] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.160873 1173 log.cc:1199] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/1498486dd3db414c8062cba2d54037bb
I20260503 07:53:00.161283 1173 ts_tablet_manager.cc:1950] T 1498486dd3db414c8062cba2d54037bb P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.170568 757 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.171015 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3210d1ecd42198e080b02a8b594a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.174547 759 tablet_service.cc:1511] Processing CreateTablet for tablet c51fe76096684794aac4f5f65c8de1b5 (DEFAULT_TABLE table=default.Table_55cec2a278e54eb2931506731ca04e8f [id=e5759f642ec04d1da31d098d711e8740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.174943 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51fe76096684794aac4f5f65c8de1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.176781 1175 ts_tablet_manager.cc:1929] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.176873 1175 log.cc:1199] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/2f0489d86704462ab237e5226df1251f
I20260503 07:53:00.177162 1175 ts_tablet_manager.cc:1950] T 2f0489d86704462ab237e5226df1251f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:00.179266 1173 tablet_replica.cc:333] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.179474 1173 raft_consensus.cc:2243] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.179663 1173 raft_consensus.cc:2272] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.180248 1173 ts_tablet_manager.cc:1916] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.183367 1165 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.183528 1165 ts_tablet_manager.cc:1403] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.135s user 0.002s sys 0.007s
I20260503 07:53:00.185097 1175 tablet_replica.cc:333] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:00.185376 1175 raft_consensus.cc:2243] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.185565 1175 raft_consensus.cc:2272] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.186337 1174 ts_tablet_manager.cc:1916] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.186508 1175 ts_tablet_manager.cc:1916] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:00.187575 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet f9e78eb6d2a3489dbb15806dd93867a4 (table default.Table_af4a886426b247b7ae33063090adeea5 [id=3fb3c0ecf0204981854c6a492a3b36a3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f9e78eb6d2a3489dbb15806dd93867a4 consensus state has no leader
I20260503 07:53:00.188051 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 1498486dd3db414c8062cba2d54037bb (table default.Table_880c06e846564e03a359ab40393e5fe2 [id=45fb2a411f3f45c4867a240018396066]) successfully deleted
W20260503 07:53:00.188557 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9e162006cee34182b51f97629a174509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e162006cee34182b51f97629a174509 already in progress: creating tablet
W20260503 07:53:00.188920 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 637462b45502433796daa7a9cd8586d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637462b45502433796daa7a9cd8586d3 already in progress: creating tablet
W20260503 07:53:00.189321 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2c3421b6842944b7b5a3582b8c059837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3421b6842944b7b5a3582b8c059837 already in progress: creating tablet
W20260503 07:53:00.189615 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b269ee59036d4c2f866b6b2bf45c35cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b269ee59036d4c2f866b6b2bf45c35cf already in progress: creating tablet
W20260503 07:53:00.190135 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b8bb85190cd94e8282eec9a1bc0efab4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8bb85190cd94e8282eec9a1bc0efab4 already in progress: creating tablet
W20260503 07:53:00.190474 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd71a81efd3b40c6b96bb77f74e8a4c6 already in progress: creating tablet
W20260503 07:53:00.190798 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f522dc5e8b12409eb9ed1a763d0db741 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f522dc5e8b12409eb9ed1a763d0db741 already in progress: creating tablet
W20260503 07:53:00.191133 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef30af01dc6f40b4b71f59b9cb7ffd66 already in progress: creating tablet
W20260503 07:53:00.191458 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 23eacb83c81442d4b6bfc25717fe21e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23eacb83c81442d4b6bfc25717fe21e8 already in progress: creating tablet
W20260503 07:53:00.193013 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5c30f15ad13340c89df3f5c8d65d63c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c30f15ad13340c89df3f5c8d65d63c7 already in progress: creating tablet
I20260503 07:53:00.199024 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_977ac44bf2c24650b0c8460ae9d17673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.199752 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_977ac44bf2c24650b0c8460ae9d17673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.200191 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_210fa78803ca498faf76d6ae8dfc3e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.200341 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet e8055ed2748e4a0e9ba1194c40afb5e2 (table default.Table_09de7b363b1a4cbd8be93baba97b150c [id=ed518a72e0fd490a89f83cb777747bf2]). Expected version 2 got 0
W20260503 07:53:00.200706 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_210fa78803ca498faf76d6ae8dfc3e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.201323 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0522ad67384e44f3a5a8db16d0f3f4fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.201807 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0522ad67384e44f3a5a8db16d0f3f4fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.202137 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b0fa0d992731427699a76c1870ca3cc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.202562 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0fa0d992731427699a76c1870ca3cc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.205332 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c224dc90387c4848a5dd802d0674265d (table default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]). Expected version 1 got 0
I20260503 07:53:00.205633 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]). Expected version 2 got 0
I20260503 07:53:00.207481 601 master_service.cc:954] ReplaceTablet: received request to replace tablet d7e4ba72b51a4343be56d56f93693939 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:00.209161 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.209437 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.209932 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_45c7f14be79c49acbc82c7186b726a53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.210695 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45c7f14be79c49acbc82c7186b726a53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.211007 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.215243 1895 raft_consensus.cc:493] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.215374 1895 raft_consensus.cc:515] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.215509 1165 raft_consensus.cc:359] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.215711 1165 raft_consensus.cc:385] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.215767 1165 raft_consensus.cc:740] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.215902 1895 leader_election.cc:290] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.215997 1165 consensus_queue.cc:260] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.216563 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.216794 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c00976f3444c43618af30259f0567d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:00.217257 716 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:00.217339 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e2546e95e0f40ad99f1ba6bc512debe consensus state has no leader
W20260503 07:53:00.217860 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a269a12729549469f86e184e2ed7e86 consensus state has no leader
W20260503 07:53:00.220256 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72fc61b1b49045fbb9b6b0cb94b1d661 consensus state has no leader
I20260503 07:53:00.220116 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4ec79454524d468c76fd01dec8eb1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.220916 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.221381 715 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.221488 715 leader_election.cc:304] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.222268 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8d334082884d4c59a4de7279df62be83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.222747 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d334082884d4c59a4de7279df62be83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.222855 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]). Expected version 2 got 0
I20260503 07:53:00.223500 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_77f41fa25df44f15b60c99adfe386121" } modify_external_catalogs: true
I20260503 07:53:00.223721 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_77f41fa25df44f15b60c99adfe386121" } modify_external_catalogs: true
I20260503 07:53:00.224195 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b478d31097a4d9eb5bc3f46d259bbe1" } modify_external_catalogs: true
I20260503 07:53:00.224328 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b478d31097a4d9eb5bc3f46d259bbe1" } modify_external_catalogs: true
I20260503 07:53:00.224481 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c165c4af7b3b4f99b92b64a3e9212fd1" } modify_external_catalogs: true
I20260503 07:53:00.224710 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c165c4af7b3b4f99b92b64a3e9212fd1" } modify_external_catalogs: true
I20260503 07:53:00.232048 1895 raft_consensus.cc:2749] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.234678 1175 ts_tablet_manager.cc:1929] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.234812 1175 log.cc:1199] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:53:00.235140 1175 ts_tablet_manager.cc:1950] T fe2b065666ec4f1299b47d45cd1f600b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:00.237603 1174 ts_tablet_manager.cc:1929] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:00.238445 1175 tablet_replica.cc:333] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:00.239419 1175 raft_consensus.cc:2243] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:00.242802 1175 pending_rounds.cc:70] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:00.242887 1175 pending_rounds.cc:77] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847415099858944 op_type: NO_OP noop_request { }
I20260503 07:53:00.242991 1175 raft_consensus.cc:2889] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:00.243203 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_af1ce7f7db0347f7a17051eb78c05dfd" } modify_external_catalogs: true
I20260503 07:53:00.243259 1175 raft_consensus.cc:2272] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.243399 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_af1ce7f7db0347f7a17051eb78c05dfd" } modify_external_catalogs: true
I20260503 07:53:00.243742 1175 ts_tablet_manager.cc:1916] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.244457 1734 raft_consensus.cc:493] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.244611 1734 raft_consensus.cc:515] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.245151 1734 leader_election.cc:290] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.248314 851 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c00976f3444c43618af30259f0567d17
I20260503 07:53:00.248793 1166 tablet_bootstrap.cc:492] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:00.248996 1166 ts_tablet_manager.cc:1403] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.172s user 0.006s sys 0.000s
I20260503 07:53:00.252456 1166 raft_consensus.cc:359] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.252693 1166 raft_consensus.cc:385] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.252846 1166 raft_consensus.cc:740] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.253153 1166 consensus_queue.cc:260] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.253960 1166 ts_tablet_manager.cc:1434] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260503 07:53:00.255503 1840 raft_consensus.cc:493] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.255684 1840 raft_consensus.cc:515] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.256541 1840 leader_election.cc:290] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.257257 1166 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:00.259397 1166 tablet_bootstrap.cc:654] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.268587 1171 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:00.270150 1171 ts_tablet_manager.cc:1403] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.332s user 0.010s sys 0.001s
I20260503 07:53:00.271127 1171 raft_consensus.cc:359] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.272311 1171 raft_consensus.cc:385] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.272428 1171 raft_consensus.cc:740] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.272650 1171 consensus_queue.cc:260] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.272895 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f8c14a439a6480c8d3e6d940f811f4e" } modify_external_catalogs: true
I20260503 07:53:00.273074 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f8c14a439a6480c8d3e6d940f811f4e" } modify_external_catalogs: true
I20260503 07:53:00.274276 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fc75b63b6b0640e1a4616681196b67f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.274821 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc75b63b6b0640e1a4616681196b67f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.275460 1171 ts_tablet_manager.cc:1434] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260503 07:53:00.275715 1171 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:00.275911 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d7e4ba72b51a4343be56d56f93693939
I20260503 07:53:00.276399 601 catalog_manager.cc:6741] ReplaceTablet: tablet d7e4ba72b51a4343be56d56f93693939 deleted and replaced by tablet 56f1c40961284bf0848c93ed6a09b111
I20260503 07:53:00.277823 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e4ba72b51a4343be56d56f93693939 with delete_type TABLET_DATA_DELETED (replaced by tablet 56f1c40961284bf0848c93ed6a09b111) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.280525 880 tablet_service.cc:1558] Processing DeleteTablet for tablet f407467a0c9c406faaa657ce70a1028b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.282582 598 master_service.cc:954] ReplaceTablet: received request to replace tablet b0655ef28c1d4326b2f462ab6fd8d604 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:00.287179 1173 ts_tablet_manager.cc:1929] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.287302 1173 log.cc:1199] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/55eb2ad7619a4a9aabe8b8d062455390
I20260503 07:53:00.287690 1173 ts_tablet_manager.cc:1950] T 55eb2ad7619a4a9aabe8b8d062455390 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.288273 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 55eb2ad7619a4a9aabe8b8d062455390 (table default.Table_9b674b3ac5a442eca15573187fd35bc3 [id=2537a5b6e1f2456f9480908075da5be1]) successfully deleted
I20260503 07:53:00.238210 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.260551 1165 ts_tablet_manager.cc:1434] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.056s user 0.003s sys 0.000s
I20260503 07:53:00.277469 1767 raft_consensus.cc:493] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.288705 1767 raft_consensus.cc:515] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.288878 1165 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.289382 1767 leader_election.cc:290] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.289741 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea048c5820349d481ac54a570b57649" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:00.290213 716 leader_election.cc:343] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.290518 1165 tablet_bootstrap.cc:654] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.291572 1171 tablet_bootstrap.cc:654] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.291584 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea048c5820349d481ac54a570b57649" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.292234 715 leader_election.cc:343] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.292326 715 leader_election.cc:304] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.292723 1767 raft_consensus.cc:2749] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.293080 1174 log.cc:1199] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/cda8280b97254d1aaf3803f6b5cd223c
I20260503 07:53:00.293807 986 leader_election.cc:304] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:00.294023 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 181390us
I20260503 07:53:00.295050 1848 raft_consensus.cc:2804] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:00.295122 1848 raft_consensus.cc:493] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:00.295188 1848 raft_consensus.cc:3060] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.295286 1174 ts_tablet_manager.cc:1950] T cda8280b97254d1aaf3803f6b5cd223c P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.296077 1174 tablet_replica.cc:333] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.296276 1174 raft_consensus.cc:2243] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:00.296473 1174 pending_rounds.cc:70] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:00.296489 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8055ed2748e4a0e9ba1194c40afb5e2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.296519 1174 pending_rounds.cc:77] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847417857290240 op_type: NO_OP noop_request { }
I20260503 07:53:00.296594 1174 raft_consensus.cc:2889] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:00.296663 1174 raft_consensus.cc:2272] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.284682 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e4ba72b51a4343be56d56f93693939 with delete_type TABLET_DATA_DELETED (replaced by tablet 56f1c40961284bf0848c93ed6a09b111) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.298766 1848 raft_consensus.cc:515] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.299259 1848 leader_election.cc:290] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.299489 1174 ts_tablet_manager.cc:1916] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.303927 1173 tablet_replica.cc:333] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.304194 1173 raft_consensus.cc:2243] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.304365 1173 raft_consensus.cc:2272] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.304978 1173 ts_tablet_manager.cc:1916] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.308367 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet cda8280b97254d1aaf3803f6b5cd223c (table default.Table_ba4ac916a85e49c793f64e171c13382a [id=f77e5c2d75e54caab615fea946fb7c73]) successfully deleted
I20260503 07:53:00.310547 1174 ts_tablet_manager.cc:1929] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:00.310645 1174 log.cc:1199] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e6d4cfb8426c485eb7ff408e04f69141
I20260503 07:53:00.310989 1174 ts_tablet_manager.cc:1950] T e6d4cfb8426c485eb7ff408e04f69141 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.311908 1174 tablet_replica.cc:333] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.312086 1174 raft_consensus.cc:2243] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.313541 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e6d4cfb8426c485eb7ff408e04f69141 (table default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]) successfully deleted
I20260503 07:53:00.315822 1165 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.315938 1165 ts_tablet_manager.cc:1403] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.000s
I20260503 07:53:00.317319 1166 tablet_bootstrap.cc:492] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:00.317453 1166 ts_tablet_manager.cc:1403] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.003s
I20260503 07:53:00.317708 1165 raft_consensus.cc:359] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.317871 1165 raft_consensus.cc:385] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.317920 1165 raft_consensus.cc:740] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.318110 1165 consensus_queue.cc:260] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.318126 1166 raft_consensus.cc:359] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.318599 1165 ts_tablet_manager.cc:1434] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:00.318992 1165 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.320281 1166 raft_consensus.cc:385] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:53:00.320273 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 218553us
I20260503 07:53:00.320394 1166 raft_consensus.cc:740] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.321025 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 2f0489d86704462ab237e5226df1251f (table default.Table_f0a921f6b8344bbab898c35c3c59d1a2 [id=99ec5c91c64c44f4880574f176e882a4]) successfully deleted
W20260503 07:53:00.321332 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9e162006cee34182b51f97629a174509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e162006cee34182b51f97629a174509 already in progress: creating tablet
W20260503 07:53:00.322523 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 637462b45502433796daa7a9cd8586d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637462b45502433796daa7a9cd8586d3 already in progress: creating tablet
I20260503 07:53:00.322554 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_236b0866169c40e49811e486bed7c716" } new_table_name: "default.Table_6791ce20ae0e4ec890edbd3788dbe460" modify_external_catalogs: true
W20260503 07:53:00.322805 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2c3421b6842944b7b5a3582b8c059837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3421b6842944b7b5a3582b8c059837 already in progress: creating tablet
W20260503 07:53:00.323009 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b269ee59036d4c2f866b6b2bf45c35cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b269ee59036d4c2f866b6b2bf45c35cf already in progress: creating tablet
W20260503 07:53:00.323184 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b8bb85190cd94e8282eec9a1bc0efab4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8bb85190cd94e8282eec9a1bc0efab4 already in progress: creating tablet
W20260503 07:53:00.323479 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd71a81efd3b40c6b96bb77f74e8a4c6 already in progress: creating tablet
W20260503 07:53:00.323642 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f522dc5e8b12409eb9ed1a763d0db741 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f522dc5e8b12409eb9ed1a763d0db741 already in progress: creating tablet
I20260503 07:53:00.324594 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_783704b9e4a140a79ff78cb95c84d553" } new_table_name: "default.Table_1d33b7920244493683c5f12e1bef5a9a" modify_external_catalogs: true
I20260503 07:53:00.325197 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b0655ef28c1d4326b2f462ab6fd8d604
I20260503 07:53:00.319870 1174 raft_consensus.cc:2272] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.325295 1166 consensus_queue.cc:260] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.324995 1165 tablet_bootstrap.cc:654] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.327112 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9df8b6a13cf047c78089f111af18bd1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.328364 885 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c5dcc9832845b88577cf987d5e3144) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.329272 1166 ts_tablet_manager.cc:1434] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260503 07:53:00.329871 1166 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:00.325707 1174 ts_tablet_manager.cc:1916] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.332834 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efec3cb45daf44e59132ea4d8929bd43" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.333592 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:00.334774 1166 tablet_bootstrap.cc:654] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:00.341580 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31025296f77e431da6238360724fd60a consensus state has no leader
I20260503 07:53:00.345798 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ed95a89bf4bc4b6fa72b224f49082423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.346717 1171 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:00.346920 1171 ts_tablet_manager.cc:1403] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.000s
I20260503 07:53:00.347456 1734 raft_consensus.cc:493] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.347580 1734 raft_consensus.cc:515] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:00.348191 1734 leader_election.cc:290] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:00.348057 1171 raft_consensus.cc:359] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.348349 1171 raft_consensus.cc:385] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.348461 1171 raft_consensus.cc:740] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.349603 1948 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.349787 1948 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:00.350556 851 leader_election.cc:343] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: be15f49b155746d1924868d9f91e9206
I20260503 07:53:00.350682 1948 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.351953 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 57128us
W20260503 07:53:00.352437 854 leader_election.cc:343] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: c00976f3444c43618af30259f0567d17
I20260503 07:53:00.352542 854 leader_election.cc:304] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.352866 1734 raft_consensus.cc:2749] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.353660 854 leader_election.cc:304] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.354303 1734 raft_consensus.cc:2749] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.355199 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:00.355378 779 raft_consensus.cc:3060] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:00.356457 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26032d89839340988fce30f458e785fa consensus state has no leader
I20260503 07:53:00.358155 1174 ts_tablet_manager.cc:1929] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.358240 1174 log.cc:1199] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/67387c8aba1f4d728b3691c5da720e4d
I20260503 07:53:00.358253 779 raft_consensus.cc:2468] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:00.358498 1174 ts_tablet_manager.cc:1950] T 67387c8aba1f4d728b3691c5da720e4d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.358542 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.358754 776 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:00.359400 1174 tablet_replica.cc:333] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.359572 1174 raft_consensus.cc:2243] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.359694 1174 raft_consensus.cc:2272] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.359781 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 67387c8aba1f4d728b3691c5da720e4d (table default.Table_29f9d87b702f4f08a7d36b2f3bd2028c [id=bd345ab54d2640ab81ef3154b405dcf0]) successfully deleted
I20260503 07:53:00.360730 1173 ts_tablet_manager.cc:1929] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:53:00.324522 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ef30af01dc6f40b4b71f59b9cb7ffd66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef30af01dc6f40b4b71f59b9cb7ffd66 already in progress: creating tablet
I20260503 07:53:00.361939 598 catalog_manager.cc:6741] ReplaceTablet: tablet b0655ef28c1d4326b2f462ab6fd8d604 deleted and replaced by tablet b9c5dcc9832845b88577cf987d5e3144
W20260503 07:53:00.362308 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9df8b6a13cf047c78089f111af18bd1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.364096 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c5dcc9832845b88577cf987d5e3144) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.361465 1173 log.cc:1199] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f11c020bd0484adfa6d7dae67818f7e5
I20260503 07:53:00.365092 1174 ts_tablet_manager.cc:1916] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:00.365811 986 leader_election.cc:343] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: efec3cb45daf44e59132ea4d8929bd43
I20260503 07:53:00.366529 1173 ts_tablet_manager.cc:1950] T f11c020bd0484adfa6d7dae67818f7e5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.366978 1840 consensus_queue.cc:1048] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:00.367589 986 leader_election.cc:304] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:00.368151 1840 raft_consensus.cc:2804] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:00.368292 1840 raft_consensus.cc:697] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:00.368503 1840 consensus_queue.cc:237] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.368716 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f11c020bd0484adfa6d7dae67818f7e5 (table default.Table_8ce2b0ef0031470695ebd84edbc7a458 [id=cdcb91932dd64c69918923dcd386bc62]) successfully deleted
I20260503 07:53:00.369743 1173 tablet_replica.cc:333] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.370939 1173 raft_consensus.cc:2243] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.371759 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.371838 1173 raft_consensus.cc:2272] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.372946 1173 ts_tablet_manager.cc:1916] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.375371 1174 ts_tablet_manager.cc:1929] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.375458 1174 log.cc:1199] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e6fcade062b24ee280d4943d3254df03
I20260503 07:53:00.375751 1174 ts_tablet_manager.cc:1950] T e6fcade062b24ee280d4943d3254df03 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.362367 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet fe2b065666ec4f1299b47d45cd1f600b (table default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]) successfully deleted
I20260503 07:53:00.385324 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e6fcade062b24ee280d4943d3254df03 (table default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]) successfully deleted
I20260503 07:53:00.385802 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c51fe76096684794aac4f5f65c8de1b5 (DEFAULT_TABLE table=default.Table_55cec2a278e54eb2931506731ca04e8f [id=e5759f642ec04d1da31d098d711e8740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.386318 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51fe76096684794aac4f5f65c8de1b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:00.386998 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 23eacb83c81442d4b6bfc25717fe21e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23eacb83c81442d4b6bfc25717fe21e8 already in progress: creating tablet
I20260503 07:53:00.395345 1173 ts_tablet_manager.cc:1929] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:53:00.396896 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5c30f15ad13340c89df3f5c8d65d63c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c30f15ad13340c89df3f5c8d65d63c7 already in progress: creating tablet
W20260503 07:53:00.397571 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2902de8dbab64eb79a12feed35656676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2902de8dbab64eb79a12feed35656676 already in progress: creating tablet
I20260503 07:53:00.397869 1767 raft_consensus.cc:493] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.398049 1767 raft_consensus.cc:515] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:00.398214 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cf24705f7d004254bf8456c063634d65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf24705f7d004254bf8456c063634d65 already in progress: creating tablet
I20260503 07:53:00.398836 1767 leader_election.cc:290] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:00.398870 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c14998ce78c64e58ac5b7f651b6b88ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c14998ce78c64e58ac5b7f651b6b88ba already in progress: creating tablet
W20260503 07:53:00.399484 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet daa746af69854c00af24357a0d555513 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa746af69854c00af24357a0d555513 already in progress: creating tablet
I20260503 07:53:00.399662 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f99c7855a4485b3523b68b0ea24c1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.399791 1174 tablet_replica.cc:333] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.400024 1174 raft_consensus.cc:2243] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.400240 1174 raft_consensus.cc:2272] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:00.400543 716 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.400869 1174 ts_tablet_manager.cc:1916] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.401222 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f99c7855a4485b3523b68b0ea24c1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.401863 715 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.401973 715 leader_election.cc:304] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.402398 1767 raft_consensus.cc:2749] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.405172 1165 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.405334 1165 ts_tablet_manager.cc:1403] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.086s user 0.022s sys 0.006s
I20260503 07:53:00.406140 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.406112 1165 raft_consensus.cc:359] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.406486 1165 raft_consensus.cc:385] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.406473 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.406590 1165 raft_consensus.cc:740] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.406843 1165 consensus_queue.cc:260] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.406985 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.407558 986 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:00.407768 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f58999eb7cdc4655bc0919470038f1bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.408412 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f58999eb7cdc4655bc0919470038f1bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.409359 1165 ts_tablet_manager.cc:1434] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:53:00.409682 1165 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.411825 1174 ts_tablet_manager.cc:1929] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.411932 1174 log.cc:1199] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ac8d392c3bb94f03819fae08fc009fbc
I20260503 07:53:00.412714 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.413093 1165 tablet_bootstrap.cc:654] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.417789 1957 raft_consensus.cc:2804] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:53:00.417893 1957 raft_consensus.cc:493] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:00.417994 1957 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:53:00.420061 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7cea10a432034ea5b19576ea1448baa0" } new_table_name: "default.Table_94433405f3d44e7f871bbc04f66d0033" modify_external_catalogs: true
I20260503 07:53:00.421419 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_66fac03a66604b56b59ac48cbec5670b" } new_table_name: "default.Table_a7c5e2fc2ee44029bc64a302a042a3fc" modify_external_catalogs: true
I20260503 07:53:00.423380 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.423834 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_666b4a99d24544c2a0a8f2e466eda7c1" } new_table_name: "default.Table_80720e11ba684edfa953a24b59778ead" modify_external_catalogs: true
I20260503 07:53:00.424365 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.424647 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.424644 1957 raft_consensus.cc:515] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.425119 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.425161 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6f0e040673b44e9a8cb82f7db332d604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.425297 1957 leader_election.cc:290] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 2 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.425465 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3210d1ecd42198e080b02a8b594a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:00.425724 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f0e040673b44e9a8cb82f7db332d604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.430246 1174 ts_tablet_manager.cc:1950] T ac8d392c3bb94f03819fae08fc009fbc P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.432014 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ac8d392c3bb94f03819fae08fc009fbc (table default.Table_f325744f54204131b4a076e2a2712261 [id=a95805f323654a5a9355c882cda4d708]) successfully deleted
I20260503 07:53:00.432435 1174 tablet_replica.cc:333] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.432699 1174 raft_consensus.cc:2243] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.432922 1174 raft_consensus.cc:2272] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:00.432922 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3cfc39292764a93a7cbb7c83f11e179 consensus state has no leader
I20260503 07:53:00.433549 1174 ts_tablet_manager.cc:1916] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.435904 1175 ts_tablet_manager.cc:1929] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:00.436007 1175 log.cc:1199] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/3da9549389254875b94268abc5c3bb3e
I20260503 07:53:00.436378 1175 ts_tablet_manager.cc:1950] T 3da9549389254875b94268abc5c3bb3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:00.437935 1175 tablet_replica.cc:333] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:00.438004 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5a872bc917154006876df6f9b6971f13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.438479 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f4446badf064ecabc01b330f3babde2 consensus state has no leader
W20260503 07:53:00.438588 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a872bc917154006876df6f9b6971f13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:00.440524 854 leader_election.cc:343] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: be15f49b155746d1924868d9f91e9206
I20260503 07:53:00.440696 854 leader_election.cc:304] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:00.440943 854 raft_consensus.cc:2686] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:53:00.442734 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:00.442916 776 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:53:00.445973 776 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 2.
I20260503 07:53:00.453540 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.453744 917 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:00.456920 1174 ts_tablet_manager.cc:1929] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.457090 1174 log.cc:1199] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/eea048c5820349d481ac54a570b57649
I20260503 07:53:00.457403 1174 ts_tablet_manager.cc:1950] T eea048c5820349d481ac54a570b57649 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.458240 1174 tablet_replica.cc:333] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.458294 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet eea048c5820349d481ac54a570b57649 (table default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]) successfully deleted
I20260503 07:53:00.458416 1174 raft_consensus.cc:2243] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.458527 1174 raft_consensus.cc:2272] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.458982 1174 ts_tablet_manager.cc:1916] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.461165 1173 log.cc:1199] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/be15f49b155746d1924868d9f91e9206
I20260503 07:53:00.463202 1173 ts_tablet_manager.cc:1950] T be15f49b155746d1924868d9f91e9206 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.463953 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet be15f49b155746d1924868d9f91e9206 (table default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
I20260503 07:53:00.464306 1166 tablet_bootstrap.cc:492] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:00.464735 1166 ts_tablet_manager.cc:1403] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.135s user 0.007s sys 0.012s
I20260503 07:53:00.465435 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f86609fc7b4007ab4c730002918613" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:00.465615 917 raft_consensus.cc:3060] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:53:00.465788 1166 raft_consensus.cc:359] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:00.465987 1166 raft_consensus.cc:385] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.466076 1166 raft_consensus.cc:740] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:00.466586 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2902de8dbab64eb79a12feed35656676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2902de8dbab64eb79a12feed35656676 already in progress: creating tablet
W20260503 07:53:00.467340 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cf24705f7d004254bf8456c063634d65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf24705f7d004254bf8456c063634d65 already in progress: creating tablet
I20260503 07:53:00.467568 1895 raft_consensus.cc:493] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.467690 1895 raft_consensus.cc:515] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.468191 1895 leader_election.cc:290] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.468711 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c224dc90387c4848a5dd802d0674265d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.469503 715 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.469978 917 raft_consensus.cc:2468] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 2.
I20260503 07:53:00.473759 597 master_service.cc:954] ReplaceTablet: received request to replace tablet bae9ff227c8a49e8b9a85635ec59c805 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:00.475096 1767 raft_consensus.cc:493] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.475257 1767 raft_consensus.cc:515] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.475775 1767 leader_election.cc:290] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.476570 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 3da9549389254875b94268abc5c3bb3e (table default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]) successfully deleted
W20260503 07:53:00.476956 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5c30f15ad13340c89df3f5c8d65d63c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c30f15ad13340c89df3f5c8d65d63c7 already in progress: creating tablet
W20260503 07:53:00.477324 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 23eacb83c81442d4b6bfc25717fe21e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23eacb83c81442d4b6bfc25717fe21e8 already in progress: creating tablet
W20260503 07:53:00.477665 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2902de8dbab64eb79a12feed35656676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2902de8dbab64eb79a12feed35656676 already in progress: creating tablet
W20260503 07:53:00.478099 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet daa746af69854c00af24357a0d555513 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa746af69854c00af24357a0d555513 already in progress: creating tablet
W20260503 07:53:00.478628 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cf24705f7d004254bf8456c063634d65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf24705f7d004254bf8456c063634d65 already in progress: creating tablet
W20260503 07:53:00.479131 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c14998ce78c64e58ac5b7f651b6b88ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c14998ce78c64e58ac5b7f651b6b88ba already in progress: creating tablet
I20260503 07:53:00.479172 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f291c68785bb4b6fb522386089fb2af3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.479614 715 leader_election.cc:343] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.482074 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e7b94e6fd936496f9e4747169db37800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.482806 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7b94e6fd936496f9e4747169db37800 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.484869 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b0c49496026246f0a3c123d009c9c27e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.485303 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0c49496026246f0a3c123d009c9c27e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.486724 1174 ts_tablet_manager.cc:1929] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.486822 1174 log.cc:1199] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:00.487083 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_53fadf3ed012466e9ea3f5abc1a02cdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.487553 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53fadf3ed012466e9ea3f5abc1a02cdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.488960 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7a18e996eff14728ba6aeb72590c4f6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.489473 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a18e996eff14728ba6aeb72590c4f6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.490083 1174 ts_tablet_manager.cc:1950] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.490911 1174 tablet_replica.cc:333] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.491395 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (table default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]) successfully deleted
I20260503 07:53:00.493680 1174 raft_consensus.cc:2243] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.494592 1174 raft_consensus.cc:2272] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.495862 1174 ts_tablet_manager.cc:1916] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:00.498275 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c14998ce78c64e58ac5b7f651b6b88ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c14998ce78c64e58ac5b7f651b6b88ba already in progress: creating tablet
W20260503 07:53:00.499210 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet daa746af69854c00af24357a0d555513 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa746af69854c00af24357a0d555513 already in progress: creating tablet
I20260503 07:53:00.500069 1173 tablet_replica.cc:333] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.501047 1166 consensus_queue.cc:260] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:00.501474 1173 raft_consensus.cc:2243] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.506580 1173 raft_consensus.cc:2272] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.507186 1173 ts_tablet_manager.cc:1916] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.507771 1964 tablet.cc:1724] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:00.510358 1166 ts_tablet_manager.cc:1434] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260503 07:53:00.512435 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b84d41bdf374871a096d1dc30dd3543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.515798 1166 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:00.520696 1175 raft_consensus.cc:2243] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.520895 1175 raft_consensus.cc:2272] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.521035 1165 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.521193 1165 ts_tablet_manager.cc:1403] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.112s user 0.019s sys 0.020s
I20260503 07:53:00.521974 1165 raft_consensus.cc:359] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.522624 1165 raft_consensus.cc:385] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.447388 986 leader_election.cc:304] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:00.522907 1165 raft_consensus.cc:740] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:53:00.522923 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 75561.2us
I20260503 07:53:00.447530 1948 consensus_queue.cc:1048] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260503 07:53:00.524446 1948 raft_consensus.cc:2804] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:53:00.524395 1165 consensus_queue.cc:260] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.524542 1948 raft_consensus.cc:697] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:00.524729 1948 consensus_queue.cc:237] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.524854 1165 ts_tablet_manager.cc:1434] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260503 07:53:00.451378 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 597c7c65f49a4811997d99a782e7b146 (DEFAULT_TABLE table=default.Table_78703a3f97e64063b89538ad0132cc85 [id=db0c3c2757034af0ba5ff3d9fc7f8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.526382 776 raft_consensus.cc:1275] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:53:00.526451 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597c7c65f49a4811997d99a782e7b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.526767 1175 ts_tablet_manager.cc:1916] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.452419 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e4ba72b51a4343be56d56f93693939 with delete_type TABLET_DATA_DELETED (replaced by tablet 56f1c40961284bf0848c93ed6a09b111) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.452688 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655ef28c1d4326b2f462ab6fd8d604 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c5dcc9832845b88577cf987d5e3144) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.530222 1174 ts_tablet_manager.cc:1929] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.530368 1174 log.cc:1199] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9c19ad357f7845fc8389cb5b923bc253
I20260503 07:53:00.530694 1174 ts_tablet_manager.cc:1950] T 9c19ad357f7845fc8389cb5b923bc253 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.348886 1171 consensus_queue.cc:260] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.469125 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c224dc90387c4848a5dd802d0674265d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.476701 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f291c68785bb4b6fb522386089fb2af3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.531948 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9c19ad357f7845fc8389cb5b923bc253 (table default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]) successfully deleted
W20260503 07:53:00.532366 716 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.533519 1171 ts_tablet_manager.cc:1434] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.187s user 0.002s sys 0.000s
I20260503 07:53:00.533811 1171 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:00.534214 1957 consensus_queue.cc:1048] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:00.535444 1174 tablet_replica.cc:333] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.535964 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_12549670f6814397948d9ba1037b63f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.536790 885 tablet_service.cc:1511] Processing CreateTablet for tablet 73d5d6444bbf415ca5feb27ca96ebcd5 (DEFAULT_TABLE table=default.Table_a5cc2b29a6234b95bb78235232b7ee7c [id=1be2c93b89594f6c8d03fef2849411b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.537304 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d5d6444bbf415ca5feb27ca96ebcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.537593 1171 tablet_bootstrap.cc:654] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.538398 880 tablet_service.cc:1511] Processing CreateTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b (DEFAULT_TABLE table=default.Table_3539f556a19b42f4ae64f57560d2f740 [id=17d27bbcfa154e9dadd95f343a49f79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.538682 716 leader_election.cc:304] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.538810 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e681a9fdf64f42a947b2cbc6b47b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.543550 1734 raft_consensus.cc:493] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.543733 1734 raft_consensus.cc:515] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.544772 1734 leader_election.cc:290] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.545888 854 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: f407467a0c9c406faaa657ce70a1028b
W20260503 07:53:00.546643 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12549670f6814397948d9ba1037b63f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.550480 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0522ad67384e44f3a5a8db16d0f3f4fb" } new_table_name: "default.Table_111a40676ee248ce8d4529d3f152246b" modify_external_catalogs: true
I20260503 07:53:00.552254 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_95acba54e2b94b8886d748f6ffa87d7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.552958 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95acba54e2b94b8886d748f6ffa87d7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.496227 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 (DEFAULT_TABLE table=default.Table_7cea10a432034ea5b19576ea1448baa0 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.553942 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfc39292764a93a7cbb7c83f11e179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.558398 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6c97b8139543495bb90b3b23194b8ad8" } new_table_name: "default.Table_00a5ff003ba74e7b93006dc720605b27" modify_external_catalogs: true
I20260503 07:53:00.559140 1166 tablet_bootstrap.cc:654] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.562054 757 tablet_service.cc:1511] Processing CreateTablet for tablet 73d5d6444bbf415ca5feb27ca96ebcd5 (DEFAULT_TABLE table=default.Table_a5cc2b29a6234b95bb78235232b7ee7c [id=1be2c93b89594f6c8d03fef2849411b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:00.562264 851 leader_election.cc:343] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f407467a0c9c406faaa657ce70a1028b
I20260503 07:53:00.562455 851 leader_election.cc:304] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.562937 1734 raft_consensus.cc:2749] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:00.504815 988 leader_election.cc:343] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.563760 988 leader_election.cc:304] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:00.564143 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 59335.9us
I20260503 07:53:00.504942 1840 raft_consensus.cc:493] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.564671 1840 raft_consensus.cc:515] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.565338 1840 leader_election.cc:290] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.565510 1840 raft_consensus.cc:2749] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:00.565222 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 45109.4us
I20260503 07:53:00.508917 1965 tablet.cc:1724] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:00.564474 988 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:00.572747 988 consensus_peers.cc:597] T 3be42428a60142ca99f48e592a29070f P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:00.573324 988 consensus_peers.cc:597] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:00.578238 891 tablet_service.cc:1511] Processing CreateTablet for tablet efeecf8029c8464089a5a64e4457c9c5 (DEFAULT_TABLE table=default.Table_2627dbd840b44aaa9ee93bea935f5c4b [id=2232dd072b9d47469e5532439fece09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.578677 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeecf8029c8464089a5a64e4457c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.579730 897 tablet_service.cc:1511] Processing CreateTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 (DEFAULT_TABLE table=default.Table_7c7a9e84b78a4f2b8bb4175728a27882 [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.580216 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d7b172bb1d4ad1ba81e08748db4ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.584415 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2fb82179b8b845da88125aa9f32bb9fd
I20260503 07:53:00.586756 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_aac5c556de2b4e90b839a1466013cd86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.587419 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aac5c556de2b4e90b839a1466013cd86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.588387 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 40fee86632a64de9a9b8eba31e3534b8
I20260503 07:53:00.590013 1173 ts_tablet_manager.cc:1929] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.590176 1173 log.cc:1199] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c00976f3444c43618af30259f0567d17
I20260503 07:53:00.590564 1173 ts_tablet_manager.cc:1950] T c00976f3444c43618af30259f0567d17 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.591068 1173 tablet_replica.cc:333] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.591333 1173 raft_consensus.cc:2243] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.591403 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 405e2bbca5c54234a80f23d9399df765
I20260503 07:53:00.591547 1173 raft_consensus.cc:2272] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.592139 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet acb2026ec07045f6b38c86f1d5d22462
I20260503 07:53:00.593403 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 405e2bbca5c54234a80f23d9399df765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.593828 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d5d6444bbf415ca5feb27ca96ebcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.594292 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.594475 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.595264 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4721396a62ab4c8f8c26ab6a676d17a3
I20260503 07:53:00.593149 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c00976f3444c43618af30259f0567d17 (table default.Table_d937bc608e824591965885933c947fb9 [id=212b8c5069e546c2ae19245429fcecc1]) successfully deleted
I20260503 07:53:00.596664 880 tablet_service.cc:1558] Processing DeleteTablet for tablet acb2026ec07045f6b38c86f1d5d22462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:00.597146 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 has no consensus state
I20260503 07:53:00.597159 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:00.597956 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 399acb90cf124fcf8a75bf936e3e426f consensus state has no leader
I20260503 07:53:00.600073 1175 ts_tablet_manager.cc:1929] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.600540 598 catalog_manager.cc:5671] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:00.601112 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:00.601568 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67387c8aba1f4d728b3691c5da720e4d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.603612 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bae9ff227c8a49e8b9a85635ec59c805
I20260503 07:53:00.604000 597 catalog_manager.cc:6741] ReplaceTablet: tablet bae9ff227c8a49e8b9a85635ec59c805 deleted and replaced by tablet bba8ad1d86a146e2a1e2b7da8974ada1
I20260503 07:53:00.608366 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 with delete_type TABLET_DATA_DELETED (replaced by tablet bba8ad1d86a146e2a1e2b7da8974ada1) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.609159 1174 raft_consensus.cc:2243] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.616565 1986 tablet.cc:1724] T b15b6a7760684f1b8785370065e82e77 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:00.620112 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e96ff4a649144108e63254466c613e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.621134 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e96ff4a649144108e63254466c613e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.621807 1767 raft_consensus.cc:2749] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.632164 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 (DEFAULT_TABLE table=default.Table_af1ce7f7db0347f7a17051eb78c05dfd [id=548ec860188a43eaad55c7ef8f91f535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.632984 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4721396a62ab4c8f8c26ab6a676d17a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.634449 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ea61c565e9a54e118c4b0f1b52179e39" } new_table_name: "default.Table_f42176dafce6410f81a5b5258b4f6511" modify_external_catalogs: true
I20260503 07:53:00.636626 885 tablet_service.cc:1511] Processing CreateTablet for tablet a5c352cb206d4523b282873e8a42a467 (DEFAULT_TABLE table=default.Table_b36413edc3994196a771f94ebdbade3b [id=e7a735f688b440d5b3e0176948f74f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.637164 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c352cb206d4523b282873e8a42a467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.642650 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c7a9e84b78a4f2b8bb4175728a27882" } new_table_name: "default.Table_64c5d856a21646c3a6f8ab060173488d" modify_external_catalogs: true
I20260503 07:53:00.644855 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_75bbce4e47d24750b0b81dc1ba0ee08a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.645502 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75bbce4e47d24750b0b81dc1ba0ee08a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.647526 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_16ede9de6dc5448e981c9d7a23f0705e" } new_table_name: "default.Table_32929eb0a40141398dfd93b0b6bddacf" modify_external_catalogs: true
I20260503 07:53:00.650110 759 tablet_service.cc:1511] Processing CreateTablet for tablet efeecf8029c8464089a5a64e4457c9c5 (DEFAULT_TABLE table=default.Table_2627dbd840b44aaa9ee93bea935f5c4b [id=2232dd072b9d47469e5532439fece09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.657063 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_21181bc56266453cb0d0e66c438426ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.657716 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21181bc56266453cb0d0e66c438426ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.613548 1024 tablet_service.cc:1511] Processing CreateTablet for tablet efeecf8029c8464089a5a64e4457c9c5 (DEFAULT_TABLE table=default.Table_2627dbd840b44aaa9ee93bea935f5c4b [id=2232dd072b9d47469e5532439fece09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.658151 1166 tablet_bootstrap.cc:492] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:00.658294 1166 ts_tablet_manager.cc:1403] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.143s user 0.004s sys 0.003s
I20260503 07:53:00.658358 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeecf8029c8464089a5a64e4457c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.659087 1166 raft_consensus.cc:359] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.659258 1166 raft_consensus.cc:385] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.659345 1166 raft_consensus.cc:740] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.659559 1166 consensus_queue.cc:260] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.613936 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.661355 1165 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.614192 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.614717 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.615475 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 with delete_type TABLET_DATA_DELETED (replaced by tablet bba8ad1d86a146e2a1e2b7da8974ada1) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.615429 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b (DEFAULT_TABLE table=default.Table_3539f556a19b42f4ae64f57560d2f740 [id=17d27bbcfa154e9dadd95f343a49f79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.661931 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e681a9fdf64f42a947b2cbc6b47b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.661996 1166 ts_tablet_manager.cc:1434] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:53:00.662271 1166 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:00.663635 1948 raft_consensus.cc:493] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.663753 1948 raft_consensus.cc:515] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.665047 1948 leader_election.cc:290] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.665172 1734 raft_consensus.cc:493] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.665335 1734 raft_consensus.cc:515] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.665814 1734 leader_election.cc:290] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.666793 854 leader_election.cc:343] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:53:00.615589 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 405e2bbca5c54234a80f23d9399df765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.615716 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet acb2026ec07045f6b38c86f1d5d22462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.615995 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 73d5d6444bbf415ca5feb27ca96ebcd5 (DEFAULT_TABLE table=default.Table_a5cc2b29a6234b95bb78235232b7ee7c [id=1be2c93b89594f6c8d03fef2849411b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.667647 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d5d6444bbf415ca5feb27ca96ebcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.668769 1175 log.cc:1199] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/cda8280b97254d1aaf3803f6b5cd223c
I20260503 07:53:00.669302 1175 ts_tablet_manager.cc:1950] T cda8280b97254d1aaf3803f6b5cd223c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:00.670619 1175 tablet_replica.cc:333] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:00.670924 1175 raft_consensus.cc:2243] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.671168 1175 raft_consensus.cc:2272] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:00.641249 988 consensus_peers.cc:597] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:00.671681 988 leader_election.cc:343] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.672111 1175 ts_tablet_manager.cc:1916] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.673313 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet cda8280b97254d1aaf3803f6b5cd223c (table default.Table_ba4ac916a85e49c793f64e171c13382a [id=f77e5c2d75e54caab615fea946fb7c73]) successfully deleted
I20260503 07:53:00.676349 1020 tablet_service.cc:1511] Processing CreateTablet for tablet a5c352cb206d4523b282873e8a42a467 (DEFAULT_TABLE table=default.Table_b36413edc3994196a771f94ebdbade3b [id=e7a735f688b440d5b3e0176948f74f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.676349 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 (DEFAULT_TABLE table=default.Table_7c7a9e84b78a4f2b8bb4175728a27882 [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.676542 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.676720 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c352cb206d4523b282873e8a42a467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.676915 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d7b172bb1d4ad1ba81e08748db4ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.679934 1174 raft_consensus.cc:2272] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:00.681738 851 leader_election.cc:343] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:53:00.681882 851 leader_election.cc:304] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.682305 1734 raft_consensus.cc:2749] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:00.682050 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08d7b172bb1d4ad1ba81e08748db4ae2 consensus state has no leader
I20260503 07:53:00.682607 750 tablet_service.cc:1511] Processing CreateTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b (DEFAULT_TABLE table=default.Table_3539f556a19b42f4ae64f57560d2f740 [id=17d27bbcfa154e9dadd95f343a49f79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.682984 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeecf8029c8464089a5a64e4457c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.683490 601 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_f3a8809551a24bc48a104abfe58153f1 [id=5d95591c963f409394dba581d655aadf] alter complete (version 1)
I20260503 07:53:00.683652 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:00.684044 988 leader_election.cc:343] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.684391 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.686973 1174 ts_tablet_manager.cc:1916] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.646135 1965 tablet.cc:1724] T b15b6a7760684f1b8785370065e82e77 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:00.649706 1171 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:00.688182 1171 ts_tablet_manager.cc:1403] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.154s user 0.008s sys 0.002s
I20260503 07:53:00.689028 1171 raft_consensus.cc:359] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.689321 1171 raft_consensus.cc:385] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.689558 1171 raft_consensus.cc:740] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.690047 1171 consensus_queue.cc:260] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.690557 1983 raft_consensus.cc:493] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.692536 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e681a9fdf64f42a947b2cbc6b47b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.692806 1171 ts_tablet_manager.cc:1434] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:53:00.698066 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fee86632a64de9a9b8eba31e3534b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.690701 1983 raft_consensus.cc:515] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.698089 592 catalog_manager.cc:5671] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 2, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 2 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:00.698624 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:00.699240 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58deacb99c643d89a6641ef09b026ba" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.701924 1983 leader_election.cc:290] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:00.702057 715 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.702221 742 tablet_service.cc:1558] Processing DeleteTablet for tablet acb2026ec07045f6b38c86f1d5d22462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.702903 741 tablet_service.cc:1511] Processing CreateTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 (DEFAULT_TABLE table=default.Table_7c7a9e84b78a4f2b8bb4175728a27882 [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.703423 1171 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:00.704330 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 405e2bbca5c54234a80f23d9399df765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.706012 752 tablet_service.cc:1558] Processing DeleteTablet for tablet bae9ff227c8a49e8b9a85635ec59c805 with delete_type TABLET_DATA_DELETED (replaced by tablet bba8ad1d86a146e2a1e2b7da8974ada1) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:00.706244 986 leader_election.cc:343] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 67387c8aba1f4d728b3691c5da720e4d
I20260503 07:53:00.706346 986 leader_election.cc:304] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.710577 1952 raft_consensus.cc:2749] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.592131 1173 ts_tablet_manager.cc:1916] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.711925 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.712193 777 raft_consensus.cc:2468] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:00.712391 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d7b172bb1d4ad1ba81e08748db4ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.714767 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.715965 599 master_service.cc:954] ReplaceTablet: received request to replace tablet d79067c0c8594d50aa458d47b31d99af from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:00.718647 1165 tablet_bootstrap.cc:654] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.719614 757 tablet_service.cc:1511] Processing CreateTablet for tablet a5c352cb206d4523b282873e8a42a467 (DEFAULT_TABLE table=default.Table_b36413edc3994196a771f94ebdbade3b [id=e7a735f688b440d5b3e0176948f74f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.720129 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c352cb206d4523b282873e8a42a467. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:00.720407 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet acbfff84673541929083cbc13b059398 consensus state has no leader
I20260503 07:53:00.721885 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2f75ae8c8a4b48739be336c8ea8840cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.722504 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f75ae8c8a4b48739be336c8ea8840cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.726192 1983 raft_consensus.cc:493] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.726738 1983 raft_consensus.cc:515] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.727341 1983 leader_election.cc:290] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.729337 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:00.730389 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_50eb48ad04f5421c81bbebf096035b97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.731182 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50eb48ad04f5421c81bbebf096035b97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.732640 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.733021 715 leader_election.cc:343] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:00.733240 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.733484 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 (DEFAULT_TABLE table=default.Table_af1ce7f7db0347f7a17051eb78c05dfd [id=548ec860188a43eaad55c7ef8f91f535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.735733 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8787cb7c35ba4884a630ad89181b7728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.736353 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8787cb7c35ba4884a630ad89181b7728 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.740312 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4721396a62ab4c8f8c26ab6a676d17a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.751083 880 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf90c30f7a2499a9764cbc4ec85317d (DEFAULT_TABLE table=default.Table_b5f6d6ca26d6424889c16f51780825fe [id=62c72312df904c6f8450e3dd0940e768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.751703 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf90c30f7a2499a9764cbc4ec85317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.757254 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:00.714126 986 leader_election.cc:304] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:00.763975 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 49871.1us
I20260503 07:53:00.764837 1840 raft_consensus.cc:2804] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:00.764925 1840 raft_consensus.cc:493] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:00.764992 1840 raft_consensus.cc:3060] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.767537 1840 raft_consensus.cc:515] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.768378 1948 raft_consensus.cc:493] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.768489 1948 raft_consensus.cc:515] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.768939 1840 leader_election.cc:290] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.772439 916 raft_consensus.cc:3060] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.773342 1984 tablet.cc:1724] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:00.785799 1948 leader_election.cc:290] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:00.785938 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 178133us
I20260503 07:53:00.787115 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:00.788064 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.788864 988 leader_election.cc:343] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:00.789121 988 leader_election.cc:343] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.792137 891 tablet_service.cc:1511] Processing CreateTablet for tablet e0fdfb3008a14b1cb18aee69c400743d (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.792555 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0fdfb3008a14b1cb18aee69c400743d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.794047 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1c047f13d94420949c1288b12725a5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:00.794240 777 raft_consensus.cc:3060] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.722642 1171 tablet_bootstrap.cc:654] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.798944 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e] alter complete (version 1)
I20260503 07:53:00.745839 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 4721396a62ab4c8f8c26ab6a676d17a3 (DEFAULT_TABLE table=default.Table_af1ce7f7db0347f7a17051eb78c05dfd [id=548ec860188a43eaad55c7ef8f91f535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.800590 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4721396a62ab4c8f8c26ab6a676d17a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.802697 777 raft_consensus.cc:2468] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:00.803356 742 tablet_service.cc:1511] Processing CreateTablet for tablet e0fdfb3008a14b1cb18aee69c400743d (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.803695 986 leader_election.cc:304] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.804126 1952 raft_consensus.cc:2804] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:53:00.804136 716 leader_election.cc:343] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.804322 1952 raft_consensus.cc:697] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:00.804416 1983 raft_consensus.cc:493] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.804548 1983 raft_consensus.cc:515] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.804564 1952 consensus_queue.cc:237] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.805533 1983 leader_election.cc:290] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:00.805999 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79067c0c8594d50aa458d47b31d99af" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:00.806614 715 leader_election.cc:343] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.807466 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0fdfb3008a14b1cb18aee69c400743d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.808260 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_12c9b352df284d9d9fc74382fdae7380" } modify_external_catalogs: true
I20260503 07:53:00.808449 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_12c9b352df284d9d9fc74382fdae7380" } modify_external_catalogs: true
I20260503 07:53:00.809866 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_82fb22ed1c684680a97c28c1b3a4cc59" } modify_external_catalogs: true
I20260503 07:53:00.810003 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_82fb22ed1c684680a97c28c1b3a4cc59" } modify_external_catalogs: true
I20260503 07:53:00.811350 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b72eae732be40028547d86f3928b0e8" } modify_external_catalogs: true
I20260503 07:53:00.811408 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_de299b56284b4d058540082977ad7f6d" } modify_external_catalogs: true
I20260503 07:53:00.811488 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b72eae732be40028547d86f3928b0e8" } modify_external_catalogs: true
I20260503 07:53:00.811578 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_de299b56284b4d058540082977ad7f6d" } modify_external_catalogs: true
I20260503 07:53:00.813011 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f42176dafce6410f81a5b5258b4f6511" } new_table_name: "default.Table_640cca1d1d6b403b83ee91f29f629f22" modify_external_catalogs: true
I20260503 07:53:00.813141 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_305020fe316f4e3b97eb80ada2fdef86" } modify_external_catalogs: true
I20260503 07:53:00.813302 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_305020fe316f4e3b97eb80ada2fdef86" } modify_external_catalogs: true
I20260503 07:53:00.814198 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_973f93b8aa7b411798df3fbb57b4ebf3" } new_table_name: "default.Table_6311928e941a4a47ba696d70491ab3d1" modify_external_catalogs: true
I20260503 07:53:00.815459 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f5377c86cbac41cf89ac902aee58a630"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.815932 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5377c86cbac41cf89ac902aee58a630 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.817118 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_46cc52c214964d73bdb77e4c421fa90f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:00.817660 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46cc52c214964d73bdb77e4c421fa90f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.818233 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.819396 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf90c30f7a2499a9764cbc4ec85317d (DEFAULT_TABLE table=default.Table_b5f6d6ca26d6424889c16f51780825fe [id=62c72312df904c6f8450e3dd0940e768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.819868 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf90c30f7a2499a9764cbc4ec85317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.823577 716 leader_election.cc:304] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.823911 1166 tablet_bootstrap.cc:700] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Time spent opening tablet: real 0.161s user 0.001s sys 0.001s
I20260503 07:53:00.824287 1166 tablet_bootstrap.cc:654] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.825690 1964 tablet.cc:1724] T b15b6a7760684f1b8785370065e82e77 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:00.832248 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.832485 1174 ts_tablet_manager.cc:1929] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.832693 1174 log.cc:1199] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f291c68785bb4b6fb522386089fb2af3
I20260503 07:53:00.833101 1174 ts_tablet_manager.cc:1950] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.833323 741 tablet_service.cc:1511] Processing CreateTablet for tablet 75872effe17740b0b322a621cb9ceb17 (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.833707 1174 tablet_replica.cc:333] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.835151 880 tablet_service.cc:1511] Processing CreateTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.835638 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19d7eab61e24e18a1e4eb600e9d592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.833782 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75872effe17740b0b322a621cb9ceb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.838335 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e0fdfb3008a14b1cb18aee69c400743d (DEFAULT_TABLE table=default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.838668 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0fdfb3008a14b1cb18aee69c400743d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.838769 1166 tablet_bootstrap.cc:492] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
W20260503 07:53:00.834034 716 raft_consensus.cc:2686] T f291c68785bb4b6fb522386089fb2af3 P 4a924c2134c54fa0bb164825da53bdd0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260503 07:53:00.839987 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 53709.1us
I20260503 07:53:00.841948 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58deacb99c643d89a6641ef09b026ba" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.842638 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.843381 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79067c0c8594d50aa458d47b31d99af" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.844309 776 raft_consensus.cc:2468] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:00.844638 986 leader_election.cc:304] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.844780 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.845038 1948 raft_consensus.cc:2804] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:00.845109 1948 raft_consensus.cc:493] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:00.845156 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19d7eab61e24e18a1e4eb600e9d592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.845286 1964 tablet.cc:1724] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:00.840446 1986 tablet.cc:1724] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:00.849262 1166 ts_tablet_manager.cc:1403] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.187s user 0.001s sys 0.003s
I20260503 07:53:00.850054 1166 raft_consensus.cc:359] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.850229 1166 raft_consensus.cc:385] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.850308 1166 raft_consensus.cc:740] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.852139 1171 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:00.852284 1171 ts_tablet_manager.cc:1403] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.001s
I20260503 07:53:00.852928 1171 raft_consensus.cc:359] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.853072 1171 raft_consensus.cc:385] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.853133 1171 raft_consensus.cc:740] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.853312 1171 consensus_queue.cc:260] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.845168 1948 raft_consensus.cc:3060] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.854974 916 raft_consensus.cc:3060] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.849619 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf90c30f7a2499a9764cbc4ec85317d (DEFAULT_TABLE table=default.Table_b5f6d6ca26d6424889c16f51780825fe [id=62c72312df904c6f8450e3dd0940e768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.856647 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf90c30f7a2499a9764cbc4ec85317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.861835 1948 raft_consensus.cc:515] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.862919 1948 leader_election.cc:290] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.834739 1165 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.834146 750 tablet_service.cc:1511] Processing CreateTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.863704 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19d7eab61e24e18a1e4eb600e9d592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.864387 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:00.864606 776 raft_consensus.cc:3060] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:00.867892 1165 ts_tablet_manager.cc:1403] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.247s user 0.007s sys 0.005s
I20260503 07:53:00.869073 1165 raft_consensus.cc:359] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.869334 1165 raft_consensus.cc:385] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.869441 1165 raft_consensus.cc:740] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.869760 1165 consensus_queue.cc:260] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:00.873862 716 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.874091 716 leader_election.cc:304] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.874416 1983 raft_consensus.cc:2749] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:00.874892 716 leader_election.cc:343] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.875146 716 leader_election.cc:304] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.875491 1983 raft_consensus.cc:2749] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:00.875945 716 leader_election.cc:343] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.876148 716 leader_election.cc:304] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.876494 1983 raft_consensus.cc:2749] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.882756 1165 ts_tablet_manager.cc:1434] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260503 07:53:00.884236 1174 raft_consensus.cc:2243] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.884676 1165 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.888692 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262678b948bd46b6886277f8dd790441" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:00.889104 1984 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:00.889626 1965 tablet.cc:1724] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:00.896849 1986 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:00.898254 776 raft_consensus.cc:2468] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:00.899729 1173 ts_tablet_manager.cc:1929] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.899876 1173 log.cc:1199] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8c4ec79454524d468c76fd01dec8eb1e
I20260503 07:53:00.900069 1174 raft_consensus.cc:2272] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.900277 1173 ts_tablet_manager.cc:1950] T 8c4ec79454524d468c76fd01dec8eb1e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:00.900871 1174 ts_tablet_manager.cc:1916] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.900897 1173 tablet_replica.cc:333] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:00.901088 1173 raft_consensus.cc:2243] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.901227 1173 raft_consensus.cc:2272] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.901695 1173 ts_tablet_manager.cc:1916] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:00.902530 988 leader_election.cc:343] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:00.903165 1734 raft_consensus.cc:493] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.903276 1734 raft_consensus.cc:515] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:00.903760 1734 leader_election.cc:290] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:00.904807 854 leader_election.cc:343] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8b84d41bdf374871a096d1dc30dd3543
W20260503 07:53:00.905524 851 leader_election.cc:343] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8b84d41bdf374871a096d1dc30dd3543
I20260503 07:53:00.905643 851 leader_election.cc:304] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.905980 1734 raft_consensus.cc:2749] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.906864 986 leader_election.cc:304] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:00.907220 1848 consensus_queue.cc:1048] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:00.907537 1848 raft_consensus.cc:2804] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:00.907629 1848 raft_consensus.cc:697] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:00.907819 1848 consensus_queue.cc:237] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:00.912134 988 consensus_peers.cc:597] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:00.919098 1171 ts_tablet_manager.cc:1434] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20260503 07:53:00.904767 1964 tablet.cc:1724] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260503 07:53:00.921471 986 consensus_peers.cc:597] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4674c22562f744f5bce13d97ad8a52b2. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:00.927450 1171 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:00.928783 1175 ts_tablet_manager.cc:1929] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.928952 1175 log.cc:1199] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/388c63dc20da408ca3e141ada0200be6
I20260503 07:53:00.929157 1171 tablet_bootstrap.cc:654] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.923202 1165 tablet_bootstrap.cc:654] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.931663 1984 tablet.cc:1719] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:53:00.936756 2008 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:00.939165 1986 tablet.cc:1724] T e8055ed2748e4a0e9ba1194c40afb5e2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:00.941311 1175 ts_tablet_manager.cc:1950] T 388c63dc20da408ca3e141ada0200be6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:00.952124 1165 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.952360 1165 ts_tablet_manager.cc:1403] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.002s
I20260503 07:53:00.953398 1165 raft_consensus.cc:359] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.953917 1165 raft_consensus.cc:385] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.954037 1165 raft_consensus.cc:740] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.954370 1165 consensus_queue.cc:260] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.954780 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c224dc90387c4848a5dd802d0674265d
I20260503 07:53:00.955982 1171 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:00.956110 1171 ts_tablet_manager.cc:1403] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260503 07:53:00.956828 1171 raft_consensus.cc:359] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.956979 1171 raft_consensus.cc:385] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.957027 1171 raft_consensus.cc:740] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.957257 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f291c68785bb4b6fb522386089fb2af3 (table default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]) successfully deleted
I20260503 07:53:00.957296 1165 ts_tablet_manager.cc:1434] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260503 07:53:00.957387 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 123382us
I20260503 07:53:00.961165 1174 ts_tablet_manager.cc:1929] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:00.961498 1171 consensus_queue.cc:260] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.962566 1171 ts_tablet_manager.cc:1434] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260503 07:53:00.962590 588 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 112977us
I20260503 07:53:00.964008 1174 log.cc:1199] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:00.963315 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c224dc90387c4848a5dd802d0674265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.964470 1174 ts_tablet_manager.cc:1950] T 0e5f99c7855a4485b3523b68b0ea24c1 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:00.964813 1171 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:00.965095 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8c4ec79454524d468c76fd01dec8eb1e (table default.Table_a97bcefe82d749c2a7578520c988d3e9 [id=f420e72eca6f4b51a1f40bf3cbaa2285]) successfully deleted
W20260503 07:53:00.965366 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet d7e4ba72b51a4343be56d56f93693939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e4ba72b51a4343be56d56f93693939 already in progress: creating tablet
I20260503 07:53:00.965945 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 336e5470149f41819b25e1f774cc7229
I20260503 07:53:00.966467 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]). Expected version 2 got 0
I20260503 07:53:00.968086 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bde1352924a446178bff9a5fae5564f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:00.968990 757 tablet_service.cc:1558] Processing DeleteTablet for tablet c224dc90387c4848a5dd802d0674265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:00.970669 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 336e5470149f41819b25e1f774cc7229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.970902 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 388c63dc20da408ca3e141ada0200be6 (table default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]) successfully deleted
W20260503 07:53:00.971413 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bde1352924a446178bff9a5fae5564f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:00.972389 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 336e5470149f41819b25e1f774cc7229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.973101 1165 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.973373 1175 tablet_replica.cc:333] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:00.973634 1175 raft_consensus.cc:2243] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:00.973932 1175 pending_rounds.cc:70] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:00.974336 885 tablet_service.cc:1511] Processing CreateTablet for tablet 75872effe17740b0b322a621cb9ceb17 (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.974378 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 75872effe17740b0b322a621cb9ceb17 (DEFAULT_TABLE table=default.Table_70a08a7d21814abd8119d3980268f54f [id=07bab04461974a1088917f8c34d18388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.974828 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75872effe17740b0b322a621cb9ceb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.974932 1165 tablet_bootstrap.cc:654] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.975322 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75872effe17740b0b322a621cb9ceb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.975950 2008 tablet.cc:1719] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:53:00.978142 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c11304c2f96f4518bedc07c23af81f50
I20260503 07:53:00.979373 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c11304c2f96f4518bedc07c23af81f50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.981401 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet c11304c2f96f4518bedc07c23af81f50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:00.982605 1174 tablet_replica.cc:333] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:00.982824 1174 raft_consensus.cc:2243] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:00.983028 1174 raft_consensus.cc:2272] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.983434 1171 tablet_bootstrap.cc:654] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.984133 1174 ts_tablet_manager.cc:1916] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.984661 1734 raft_consensus.cc:493] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:00.984809 1734 raft_consensus.cc:515] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.985431 1734 leader_election.cc:290] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:00.986109 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:00.986462 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655ef28c1d4326b2f462ab6fd8d604" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:00.986852 885 tablet_service.cc:1511] Processing CreateTablet for tablet 5496029ab2c94cb48425f18df4fd6497 (DEFAULT_TABLE table=default.Table_2052c845a8f54b8eaa2c48d874be5d78 [id=5633557c281b46238cd87d625b6fb5be]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:00.987067 851 leader_election.cc:343] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:53:00.987156 851 leader_election.cc:304] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:00.987211 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496029ab2c94cb48425f18df4fd6497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.987551 1734 raft_consensus.cc:2749] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:00.988628 1165 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:00.988795 1165 ts_tablet_manager.cc:1403] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260503 07:53:00.989135 1175 pending_rounds.cc:77] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847417740128256 op_type: NO_OP noop_request { }
I20260503 07:53:00.989251 1175 raft_consensus.cc:2889] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:00.989342 1175 raft_consensus.cc:2272] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:00.989662 1165 raft_consensus.cc:359] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.989843 1175 ts_tablet_manager.cc:1916] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:00.989890 1165 raft_consensus.cc:385] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:00.990028 1165 raft_consensus.cc:740] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:00.990243 1165 consensus_queue.cc:260] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:00.990833 1165 ts_tablet_manager.cc:1434] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:00.991096 1165 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:00.992300 880 tablet_service.cc:1558] Processing DeleteTablet for tablet c224dc90387c4848a5dd802d0674265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:00.995746 1165 tablet_bootstrap.cc:654] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:00.997057 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 5496029ab2c94cb48425f18df4fd6497 (DEFAULT_TABLE table=default.Table_2052c845a8f54b8eaa2c48d874be5d78 [id=5633557c281b46238cd87d625b6fb5be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:00.997460 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496029ab2c94cb48425f18df4fd6497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:00.998273 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 52e5486a610142e0af6406d328ece5e5
I20260503 07:53:00.999225 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_90d9a9ab35a342249d6de77c4e08d223" } new_table_name: "default.Table_15dd029cb53247c6811a9dd3788b7b68" modify_external_catalogs: true
I20260503 07:53:00.999441 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
I20260503 07:53:01.001708 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 0e5f99c7855a4485b3523b68b0ea24c1 (table default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]) successfully deleted
W20260503 07:53:01.002081 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d7e4ba72b51a4343be56d56f93693939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e4ba72b51a4343be56d56f93693939 already in progress: creating tablet
I20260503 07:53:01.002580 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_afc1e4ba984b4535aacfca7a13f3a0f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.006434 1174 ts_tablet_manager.cc:1929] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:01.007222 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_89fd388c703543638201c6d69055cb8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.007539 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e5486a610142e0af6406d328ece5e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.007838 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e5486a610142e0af6406d328ece5e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:01.008041 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d41561b867914a1aabe5f015176d54c7 consensus state has no leader
I20260503 07:53:01.008433 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b2dff38f4b794cd6a9f8449b7576447d" } new_table_name: "default.Table_1a7c4a465cba4f08bf124f943b9de29d" modify_external_catalogs: true
W20260503 07:53:01.010681 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89fd388c703543638201c6d69055cb8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.011143 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5a9cbb39e64c4133b32390723e5fc5de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.011236 1984 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260503 07:53:01.011734 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a9cbb39e64c4133b32390723e5fc5de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.012542 1174 log.cc:1199] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b0655ef28c1d4326b2f462ab6fd8d604
I20260503 07:53:01.013265 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4e1c047f13d94420949c1288b12725a5
I20260503 07:53:01.014339 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.014460 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e1c047f13d94420949c1288b12725a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:01.014780 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.010470 1165 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.015316 1165 ts_tablet_manager.cc:1403] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260503 07:53:01.015578 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 54dbfadef15548ec95e4db3725560ca9 (table default.Table_640cca1d1d6b403b83ee91f29f629f22 [id=0a3183eb2a7d4d9ebe87627bc031f95c]). Expected version 5 got 4
I20260503 07:53:01.016258 1165 raft_consensus.cc:359] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.016402 1165 raft_consensus.cc:385] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.016391 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e1c047f13d94420949c1288b12725a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.016453 1165 raft_consensus.cc:740] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.016685 1165 consensus_queue.cc:260] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.017150 1986 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260503 07:53:01.017239 1165 ts_tablet_manager.cc:1434] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260503 07:53:01.017328 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc1e4ba984b4535aacfca7a13f3a0f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.017495 1165 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.013137 1174 ts_tablet_manager.cc:1950] T b0655ef28c1d4326b2f462ab6fd8d604 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.018307 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_111a40676ee248ce8d4529d3f152246b" } new_table_name: "default.Table_3a454390260a4bd3a83bf082ce3c43b6" modify_external_catalogs: true
I20260503 07:53:01.018678 1174 tablet_replica.cc:333] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.020531 1174 raft_consensus.cc:2243] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.020889 597 master_service.cc:954] ReplaceTablet: received request to replace tablet bae9ff227c8a49e8b9a85635ec59c805 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.020951 1174 raft_consensus.cc:2272] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.021493 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d7ed646c9f5d4a579cc52a8c314ed388"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.021965 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7ed646c9f5d4a579cc52a8c314ed388 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.022284 1174 ts_tablet_manager.cc:1916] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.026587 897 tablet_service.cc:1511] Processing CreateTablet for tablet d41561b867914a1aabe5f015176d54c7 (DEFAULT_TABLE table=default.Table_6311928e941a4a47ba696d70491ab3d1 [id=5d9698616b4c4fe7bf0ed1091c6f7520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.027035 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41561b867914a1aabe5f015176d54c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.027915 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5963a9665ae24475a6510b9aa2541706"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.028383 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5963a9665ae24475a6510b9aa2541706 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.029138 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c330e729d4314ae8d312b321992a6 (DEFAULT_TABLE table=default.Table_32487ae3bc8d4f6895f892ff9f1e08d4 [id=7643b5dd76b440468618c1204d59377f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.029467 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c330e729d4314ae8d312b321992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.030614 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a0ee731928df4482a308e4cbc95906ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.031054 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0ee731928df4482a308e4cbc95906ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.033461 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 (DEFAULT_TABLE table=default.Table_d451c0ddf9b44a208ecac7810971318d [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.033789 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb7486acc6a49dba0295ee26ac68724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.036698 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0f87f5ea057349b7a940bfe36a55183d (DEFAULT_TABLE table=default.Table_b3764476999d489dab360b8b4bd40abe [id=f0b27c72ae2241bd900adb45bd3a4aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.036995 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f87f5ea057349b7a940bfe36a55183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.037225 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 (DEFAULT_TABLE table=default.Table_d451c0ddf9b44a208ecac7810971318d [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.037276 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 0f87f5ea057349b7a940bfe36a55183d (DEFAULT_TABLE table=default.Table_b3764476999d489dab360b8b4bd40abe [id=f0b27c72ae2241bd900adb45bd3a4aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.037585 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb7486acc6a49dba0295ee26ac68724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.037727 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f87f5ea057349b7a940bfe36a55183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.043231 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d41561b867914a1aabe5f015176d54c7 (DEFAULT_TABLE table=default.Table_6311928e941a4a47ba696d70491ab3d1 [id=5d9698616b4c4fe7bf0ed1091c6f7520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.043632 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41561b867914a1aabe5f015176d54c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.048591 880 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c330e729d4314ae8d312b321992a6 (DEFAULT_TABLE table=default.Table_32487ae3bc8d4f6895f892ff9f1e08d4 [id=7643b5dd76b440468618c1204d59377f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.049010 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c330e729d4314ae8d312b321992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.049664 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5496029ab2c94cb48425f18df4fd6497 (DEFAULT_TABLE table=default.Table_2052c845a8f54b8eaa2c48d874be5d78 [id=5633557c281b46238cd87d625b6fb5be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.050069 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496029ab2c94cb48425f18df4fd6497. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:01.050068 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 031f91b3b3ca4bca856d3c3ee99e9e3a consensus state has no leader
I20260503 07:53:01.052140 593 catalog_manager.cc:5671] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:01.053992 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:01.055759 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 336e5470149f41819b25e1f774cc7229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.056013 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e5486a610142e0af6406d328ece5e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.056365 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e1c047f13d94420949c1288b12725a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.056823 742 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c330e729d4314ae8d312b321992a6 (DEFAULT_TABLE table=default.Table_32487ae3bc8d4f6895f892ff9f1e08d4 [id=7643b5dd76b440468618c1204d59377f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.057139 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c330e729d4314ae8d312b321992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.057497 1173 ts_tablet_manager.cc:1929] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.057605 1173 log.cc:1199] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f407467a0c9c406faaa657ce70a1028b
W20260503 07:53:01.057557 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 has no consensus state
I20260503 07:53:01.057919 1173 ts_tablet_manager.cc:1950] T f407467a0c9c406faaa657ce70a1028b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.058527 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f407467a0c9c406faaa657ce70a1028b (table default.Table_98bf34009bfe4112bc02fc3b4688a1f6 [id=2d52f50c360c42b9a8e1d679998e3478]) successfully deleted
W20260503 07:53:01.058969 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd492fb40d4944e0bb1e1e7019570778 consensus state has no leader
I20260503 07:53:01.060755 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0f87f5ea057349b7a940bfe36a55183d (DEFAULT_TABLE table=default.Table_b3764476999d489dab360b8b4bd40abe [id=f0b27c72ae2241bd900adb45bd3a4aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.060891 741 tablet_service.cc:1558] Processing DeleteTablet for tablet c11304c2f96f4518bedc07c23af81f50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.061156 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f87f5ea057349b7a940bfe36a55183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.061794 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]) successfully deleted
I20260503 07:53:01.064648 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 (DEFAULT_TABLE table=default.Table_d451c0ddf9b44a208ecac7810971318d [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.064954 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb7486acc6a49dba0295ee26ac68724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.066740 1964 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260503 07:53:01.068421 757 tablet_service.cc:1511] Processing CreateTablet for tablet d41561b867914a1aabe5f015176d54c7 (DEFAULT_TABLE table=default.Table_6311928e941a4a47ba696d70491ab3d1 [id=5d9698616b4c4fe7bf0ed1091c6f7520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.070717 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41561b867914a1aabe5f015176d54c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.019937 1165 tablet_bootstrap.cc:654] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.076556 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b028017b7cc74ef6a199d6b9e0ba6e14 (table default.Table_569d7dd42684487a89c9749674c78b1a [id=1773e021ed7c489aa09d73e171b34837]). Expected version 1 got 0
I20260503 07:53:01.076939 1171 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.077085 1171 ts_tablet_manager.cc:1403] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.112s user 0.003s sys 0.006s
I20260503 07:53:01.077908 1171 raft_consensus.cc:359] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.078083 1171 raft_consensus.cc:385] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.078141 1171 raft_consensus.cc:740] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.078341 1171 consensus_queue.cc:260] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.078835 1171 ts_tablet_manager.cc:1434] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:01.079120 1171 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.084926 593 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8] alter complete (version 2)
I20260503 07:53:01.090994 1165 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.091141 1165 ts_tablet_manager.cc:1403] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.000s
I20260503 07:53:01.091329 1175 ts_tablet_manager.cc:1929] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:01.091428 1175 log.cc:1199] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:01.091733 1175 ts_tablet_manager.cc:1950] T 4674c22562f744f5bce13d97ad8a52b2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.092624 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 4674c22562f744f5bce13d97ad8a52b2 (table default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]) successfully deleted
I20260503 07:53:01.094000 1171 tablet_bootstrap.cc:654] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.094547 592 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_640cca1d1d6b403b83ee91f29f629f22 [id=0a3183eb2a7d4d9ebe87627bc031f95c] alter complete (version 5)
I20260503 07:53:01.091894 1165 raft_consensus.cc:359] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.096342 1165 raft_consensus.cc:385] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.096398 1165 raft_consensus.cc:740] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.097043 1165 consensus_queue.cc:260] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.100272 1165 ts_tablet_manager.cc:1434] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260503 07:53:01.100692 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.101045 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.101392 742 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.105727 742 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.106248 1165 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.109687 1174 ts_tablet_manager.cc:1929] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.109817 1174 log.cc:1199] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d79067c0c8594d50aa458d47b31d99af
I20260503 07:53:01.110112 1174 ts_tablet_manager.cc:1950] T d79067c0c8594d50aa458d47b31d99af P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.110955 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d79067c0c8594d50aa458d47b31d99af (table default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]) successfully deleted
I20260503 07:53:01.113718 1165 tablet_bootstrap.cc:654] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.114002 1173 tablet_replica.cc:333] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.114184 1173 raft_consensus.cc:2243] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.114317 1173 raft_consensus.cc:2272] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.121177 1174 tablet_replica.cc:333] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.121378 1174 raft_consensus.cc:2243] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.121527 1174 raft_consensus.cc:2272] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.124718 1174 ts_tablet_manager.cc:1916] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.125023 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 4e1c047f13d94420949c1288b12725a5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:00.862509 1166 consensus_queue.cc:260] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.131048 1173 ts_tablet_manager.cc:1916] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.131835 1165 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.132395 1165 ts_tablet_manager.cc:1403] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260503 07:53:01.135594 1165 raft_consensus.cc:359] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.139429 1165 raft_consensus.cc:385] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.139536 1165 raft_consensus.cc:740] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.143414 1171 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.143544 1171 ts_tablet_manager.cc:1403] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.004s
I20260503 07:53:01.143723 1165 consensus_queue.cc:260] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.144261 1165 ts_tablet_manager.cc:1434] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260503 07:53:01.144778 1165 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.149820 1165 tablet_bootstrap.cc:654] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.150547 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.153615 1174 ts_tablet_manager.cc:1929] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.154122 1171 raft_consensus.cc:359] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.154383 1171 raft_consensus.cc:385] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.154490 1171 raft_consensus.cc:740] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.154647 1174 log.cc:1199] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:01.154922 1171 consensus_queue.cc:260] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.155411 1174 ts_tablet_manager.cc:1950] T d58deacb99c643d89a6641ef09b026ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.158186 1171 ts_tablet_manager.cc:1434] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260503 07:53:01.159574 1171 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.160580 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d58deacb99c643d89a6641ef09b026ba (table default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]) successfully deleted
I20260503 07:53:01.161034 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5377c86cbac41cf89ac902aee58a630" } modify_external_catalogs: true
I20260503 07:53:01.161201 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5377c86cbac41cf89ac902aee58a630" } modify_external_catalogs: true
W20260503 07:53:01.161743 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2fb82179b8b845da88125aa9f32bb9fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fb82179b8b845da88125aa9f32bb9fd already in progress: creating tablet
W20260503 07:53:01.162530 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 40fee86632a64de9a9b8eba31e3534b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40fee86632a64de9a9b8eba31e3534b8 already in progress: creating tablet
W20260503 07:53:01.163268 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet acb2026ec07045f6b38c86f1d5d22462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acb2026ec07045f6b38c86f1d5d22462 already in progress: creating tablet
I20260503 07:53:01.163815 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:01.164014 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 405e2bbca5c54234a80f23d9399df765 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 405e2bbca5c54234a80f23d9399df765 already in progress: creating tablet
I20260503 07:53:01.164204 1175 tablet_replica.cc:333] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.164417 1175 raft_consensus.cc:2243] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.164597 1175 raft_consensus.cc:2272] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:01.164814 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bae9ff227c8a49e8b9a85635ec59c805 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bae9ff227c8a49e8b9a85635ec59c805 already in progress: creating tablet
I20260503 07:53:01.165243 1175 ts_tablet_manager.cc:1916] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.165455 1174 tablet_replica.cc:333] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.166021 1174 raft_consensus.cc:2243] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:01.166175 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 4721396a62ab4c8f8c26ab6a676d17a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4721396a62ab4c8f8c26ab6a676d17a3 already in progress: creating tablet
I20260503 07:53:01.166512 1174 raft_consensus.cc:2272] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.170245 1171 tablet_bootstrap.cc:654] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.170900 1174 ts_tablet_manager.cc:1916] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.172508 1173 ts_tablet_manager.cc:1929] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.172627 1173 log.cc:1199] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b0655ef28c1d4326b2f462ab6fd8d604
I20260503 07:53:01.172981 1173 ts_tablet_manager.cc:1950] T b0655ef28c1d4326b2f462ab6fd8d604 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.173116 1983 raft_consensus.cc:493] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.173312 1983 raft_consensus.cc:515] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.173692 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]) successfully deleted
I20260503 07:53:01.173959 1173 tablet_replica.cc:333] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.173959 1983 leader_election.cc:290] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:01.174136 1173 raft_consensus.cc:2243] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.175119 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.175886 1165 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.176007 1165 ts_tablet_manager.cc:1403] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260503 07:53:01.176765 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.177125 716 leader_election.cc:343] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:01.177242 715 leader_election.cc:343] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.177351 1166 ts_tablet_manager.cc:1434] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.328s user 0.016s sys 0.001s
I20260503 07:53:01.177348 715 leader_election.cc:304] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.177564 1166 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.177659 1983 raft_consensus.cc:2749] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.178699 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0489d86704462ab237e5226df1251f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.179044 1165 raft_consensus.cc:359] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.179260 1165 raft_consensus.cc:385] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.179363 1165 raft_consensus.cc:740] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.179632 1165 consensus_queue.cc:260] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.182608 1171 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.183070 1171 ts_tablet_manager.cc:1403] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260503 07:53:01.183674 1165 ts_tablet_manager.cc:1434] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260503 07:53:01.183658 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f4045fcdcb741b6b5d95f46965d854a" } modify_external_catalogs: true
I20260503 07:53:01.183866 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f4045fcdcb741b6b5d95f46965d854a" } modify_external_catalogs: true
I20260503 07:53:01.184144 1165 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.186044 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_569d7dd42684487a89c9749674c78b1a" } modify_external_catalogs: true
I20260503 07:53:01.186241 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_569d7dd42684487a89c9749674c78b1a" } modify_external_catalogs: true
I20260503 07:53:01.189419 1166 tablet_bootstrap.cc:654] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.190601 1983 raft_consensus.cc:493] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.190726 1983 raft_consensus.cc:515] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.191277 1983 leader_election.cc:290] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:01.191941 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028017b7cc74ef6a199d6b9e0ba6e14" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.192322 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028017b7cc74ef6a199d6b9e0ba6e14" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.192480 716 leader_election.cc:343] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:01.192770 715 leader_election.cc:343] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.192862 715 leader_election.cc:304] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.194314 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7b4116cc31d640ac826520b41d7d3cf9
I20260503 07:53:01.195020 1175 ts_tablet_manager.cc:1929] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.195115 1175 log.cc:1199] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e6d4cfb8426c485eb7ff408e04f69141
I20260503 07:53:01.195323 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.195380 1175 ts_tablet_manager.cc:1950] T e6d4cfb8426c485eb7ff408e04f69141 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.195654 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.196236 1983 raft_consensus.cc:2749] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.197211 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 72fc61b1b49045fbb9b6b0cb94b1d661 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.183789 1171 raft_consensus.cc:359] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.197381 1171 raft_consensus.cc:385] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.197450 1171 raft_consensus.cc:740] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.198256 1171 consensus_queue.cc:260] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.198762 1171 ts_tablet_manager.cc:1434] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260503 07:53:01.201403 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b4116cc31d640ac826520b41d7d3cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.202301 1983 raft_consensus.cc:493] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.202405 1983 raft_consensus.cc:515] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.202557 1165 tablet_bootstrap.cc:654] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.202888 1983 leader_election.cc:290] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:01.203712 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b0329a61dd4476bc0a65e90404efb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.203974 1171 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.204219 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b0329a61dd4476bc0a65e90404efb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.204530 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet ab5cd04df830423489b9ff027d7cd5f5 (table default.Table_3a454390260a4bd3a83bf082ce3c43b6 [id=e20bd840c43f47beb6e1f3b3ecc9d2c2], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 has no consensus state
W20260503 07:53:01.205127 716 leader_election.cc:343] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.205212 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_80eafe625685447b916b4021b04e45a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.205708 715 leader_election.cc:343] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.205789 715 leader_election.cc:304] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:01.205961 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80eafe625685447b916b4021b04e45a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.207501 1171 tablet_bootstrap.cc:654] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.207885 1983 raft_consensus.cc:2749] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.211380 1174 ts_tablet_manager.cc:1929] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.211462 1174 log.cc:1199] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c224dc90387c4848a5dd802d0674265d
I20260503 07:53:01.211571 1173 raft_consensus.cc:2272] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.211723 1174 ts_tablet_manager.cc:1950] T c224dc90387c4848a5dd802d0674265d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.212090 1173 ts_tablet_manager.cc:1916] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.212594 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c224dc90387c4848a5dd802d0674265d (table default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]) successfully deleted
I20260503 07:53:01.214190 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.214848 1171 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.214954 1171 ts_tablet_manager.cc:1403] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260503 07:53:01.215344 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1b897d165d7c42a79a3da9e23142bd98" } modify_external_catalogs: true
I20260503 07:53:01.215514 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1b897d165d7c42a79a3da9e23142bd98" } modify_external_catalogs: true
I20260503 07:53:01.216159 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4508ceed865c41f29f88fef0b32bc938"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.216686 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4508ceed865c41f29f88fef0b32bc938 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.216934 1171 raft_consensus.cc:359] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.217065 1171 raft_consensus.cc:385] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.217120 1171 raft_consensus.cc:740] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.217871 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0587fb3c8fde478f986d1a87b3f0d543" } new_table_name: "default.Table_b9564d16fb3e4357babd5755073826cf" modify_external_catalogs: true
W20260503 07:53:01.218515 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 336e5470149f41819b25e1f774cc7229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 336e5470149f41819b25e1f774cc7229 already in progress: creating tablet
I20260503 07:53:01.218792 1171 consensus_queue.cc:260] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.219180 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d91a5ae8b64743dcb9114fd581458903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.219312 1171 ts_tablet_manager.cc:1434] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260503 07:53:01.219640 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d91a5ae8b64743dcb9114fd581458903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:01.219934 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 52e5486a610142e0af6406d328ece5e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e5486a610142e0af6406d328ece5e5 already in progress: creating tablet
I20260503 07:53:01.220414 1174 tablet_replica.cc:333] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.220575 1174 raft_consensus.cc:2243] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.220709 1174 raft_consensus.cc:2272] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.222201 1174 ts_tablet_manager.cc:1916] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.225682 1171 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.227097 1175 tablet_replica.cc:333] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.227265 1175 raft_consensus.cc:2243] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.227392 1175 raft_consensus.cc:2272] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.227759 1175 ts_tablet_manager.cc:1916] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.228785 1173 ts_tablet_manager.cc:1929] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.228869 1173 log.cc:1199] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ed95a89bf4bc4b6fa72b224f49082423
I20260503 07:53:01.229153 1173 ts_tablet_manager.cc:1950] T ed95a89bf4bc4b6fa72b224f49082423 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.230135 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ed95a89bf4bc4b6fa72b224f49082423 (table default.Table_ee191e245f1a48b4ba2ef0bf938bfbd0 [id=e81fc1ae01f140a99ffc1eeaef5b87e0]) successfully deleted
I20260503 07:53:01.231786 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e6d4cfb8426c485eb7ff408e04f69141 (table default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]) successfully deleted
I20260503 07:53:01.232213 1173 tablet_replica.cc:333] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.232388 1173 raft_consensus.cc:2243] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.232539 1173 raft_consensus.cc:2272] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.232676 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b36413edc3994196a771f94ebdbade3b" } new_table_name: "default.Table_db761e72b3364c65948225fd9c13e0c4" modify_external_catalogs: true
I20260503 07:53:01.232985 1173 ts_tablet_manager.cc:1916] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:01.241564 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dd241f8b17b412e8789b0918357bf35 consensus state has no leader
I20260503 07:53:01.246268 594 master_service.cc:954] ReplaceTablet: received request to replace tablet b0655ef28c1d4326b2f462ab6fd8d604 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.247018 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78703a3f97e64063b89538ad0132cc85" } modify_external_catalogs: true
I20260503 07:53:01.247197 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78703a3f97e64063b89538ad0132cc85" } modify_external_catalogs: true
W20260503 07:53:01.250609 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5c352cb206d4523b282873e8a42a467 consensus state has no leader
I20260503 07:53:01.251413 1166 tablet_bootstrap.cc:492] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.251554 1166 ts_tablet_manager.cc:1403] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.074s user 0.006s sys 0.002s
I20260503 07:53:01.252259 1166 raft_consensus.cc:359] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.252436 1166 raft_consensus.cc:385] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.252496 1166 raft_consensus.cc:740] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.252702 1166 consensus_queue.cc:260] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.255328 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]). Expected version 1 got 0
I20260503 07:53:01.255451 1166 ts_tablet_manager.cc:1434] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:53:01.256162 1166 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.257805 1166 tablet_bootstrap.cc:654] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.261024 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_70a08a7d21814abd8119d3980268f54f" } new_table_name: "default.Table_f758e269b4d74a1a93e7c2e458442f35" modify_external_catalogs: true
I20260503 07:53:01.260124 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e306b43052074e12b84b9ee8974a1001"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.264459 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e306b43052074e12b84b9ee8974a1001 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.265808 1171 tablet_bootstrap.cc:654] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.267735 1948 consensus_queue.cc:1048] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:01.270887 1173 ts_tablet_manager.cc:1929] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.270990 1173 log.cc:1199] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8b84d41bdf374871a096d1dc30dd3543
I20260503 07:53:01.271310 1173 ts_tablet_manager.cc:1950] T 8b84d41bdf374871a096d1dc30dd3543 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.275230 1175 ts_tablet_manager.cc:1929] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.275674 1175 log.cc:1199] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/656dfeb5247e4cdfaacd29690353da83
I20260503 07:53:01.271920 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8b84d41bdf374871a096d1dc30dd3543 (table default.Table_39e289dea2d0425e8f661ed42d89b6e5 [id=a9918f1b338c4f53977f19872d9e309d]) successfully deleted
I20260503 07:53:01.276471 1175 ts_tablet_manager.cc:1950] T 656dfeb5247e4cdfaacd29690353da83 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:01.279245 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75872effe17740b0b322a621cb9ceb17 consensus state has no leader
I20260503 07:53:01.279582 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5f18b90648844a81aabc4f524cd4bc85" } new_table_name: "default.Table_9674018b68e444bea48fcba2fbc2616b" modify_external_catalogs: true
I20260503 07:53:01.280671 1175 tablet_replica.cc:333] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.280690 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_edc7f5baf03440ee9d2c4099a7371ec0" } new_table_name: "default.Table_ff000c9c4ffa4a9fa3c562a60af5c3e0" modify_external_catalogs: true
I20260503 07:53:01.280838 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 656dfeb5247e4cdfaacd29690353da83 (table default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]) successfully deleted
I20260503 07:53:01.287022 1175 raft_consensus.cc:2243] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.288211 1175 raft_consensus.cc:2272] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.289682 1174 ts_tablet_manager.cc:1929] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:53:01.292595 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d08b5135cb77444bb5ff35c5f9d68129 consensus state has no leader
I20260503 07:53:01.292876 1171 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.293048 1171 ts_tablet_manager.cc:1403] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.004s
I20260503 07:53:01.292960 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_962c8fef109e45ac9f1eb915b5645c2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.294494 1171 raft_consensus.cc:359] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.294754 1171 raft_consensus.cc:385] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.294826 1171 raft_consensus.cc:740] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.295163 1171 consensus_queue.cc:260] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.296327 1175 ts_tablet_manager.cc:1916] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.299978 1171 ts_tablet_manager.cc:1434] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260503 07:53:01.302148 1171 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.303583 1173 tablet_replica.cc:333] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:53:01.304358 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3be0ae78ada34cd88debca569b77d24a consensus state has no leader
I20260503 07:53:01.304883 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e3fd6ab7214941de9e623fcb64c4f23f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.305117 1173 raft_consensus.cc:2243] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.306531 1173 raft_consensus.cc:2272] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:01.284935 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 405e2bbca5c54234a80f23d9399df765 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 405e2bbca5c54234a80f23d9399df765 already in progress: creating tablet
W20260503 07:53:01.308648 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 40fee86632a64de9a9b8eba31e3534b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40fee86632a64de9a9b8eba31e3534b8 already in progress: creating tablet
W20260503 07:53:01.308873 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2fb82179b8b845da88125aa9f32bb9fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fb82179b8b845da88125aa9f32bb9fd already in progress: creating tablet
I20260503 07:53:01.308838 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]). Expected version 1 got 0
W20260503 07:53:01.309074 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet acb2026ec07045f6b38c86f1d5d22462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acb2026ec07045f6b38c86f1d5d22462 already in progress: creating tablet
W20260503 07:53:01.309266 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4721396a62ab4c8f8c26ab6a676d17a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4721396a62ab4c8f8c26ab6a676d17a3 already in progress: creating tablet
W20260503 07:53:01.309439 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bae9ff227c8a49e8b9a85635ec59c805 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bae9ff227c8a49e8b9a85635ec59c805 already in progress: creating tablet
W20260503 07:53:01.309579 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 336e5470149f41819b25e1f774cc7229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 336e5470149f41819b25e1f774cc7229 already in progress: creating tablet
W20260503 07:53:01.309742 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c11304c2f96f4518bedc07c23af81f50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c11304c2f96f4518bedc07c23af81f50 already in progress: creating tablet
W20260503 07:53:01.309975 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c224dc90387c4848a5dd802d0674265d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c224dc90387c4848a5dd802d0674265d already in progress: creating tablet
W20260503 07:53:01.310173 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 52e5486a610142e0af6406d328ece5e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e5486a610142e0af6406d328ece5e5 already in progress: creating tablet
I20260503 07:53:01.303272 1983 raft_consensus.cc:493] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:01.310381 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4e1c047f13d94420949c1288b12725a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e1c047f13d94420949c1288b12725a5 already in progress: creating tablet
I20260503 07:53:01.310348 1983 raft_consensus.cc:515] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.310313 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8e89fe8f004d494f95ef3b0d648251be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.310570 1948 raft_consensus.cc:493] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.310679 1948 raft_consensus.cc:515] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:01.310892 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e89fe8f004d494f95ef3b0d648251be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.311013 1983 leader_election.cc:290] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:01.311282 1948 leader_election.cc:290] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.311820 1173 ts_tablet_manager.cc:1916] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:01.311924 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3fd6ab7214941de9e623fcb64c4f23f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.311872 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ccdf187eb4cae9688ff4929f3e95e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.312249 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8d392c3bb94f03819fae08fc009fbc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:01.312279 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ccdf187eb4cae9688ff4929f3e95e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.312675 988 leader_election.cc:343] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:01.312999 986 leader_election.cc:343] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ac8d392c3bb94f03819fae08fc009fbc
W20260503 07:53:01.313001 716 leader_election.cc:343] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.313081 986 leader_election.cc:304] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:01.313387 1948 raft_consensus.cc:2749] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:01.313369 715 leader_election.cc:343] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.313465 715 leader_election.cc:304] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.314014 1978 raft_consensus.cc:2749] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:01.314749 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_962c8fef109e45ac9f1eb915b5645c2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.315565 1174 log.cc:1199] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/4e1c047f13d94420949c1288b12725a5
I20260503 07:53:01.316962 1174 ts_tablet_manager.cc:1950] T 4e1c047f13d94420949c1288b12725a5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.325075 1171 tablet_bootstrap.cc:654] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.327204 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 4e1c047f13d94420949c1288b12725a5 (table default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]) successfully deleted
I20260503 07:53:01.327247 1174 tablet_replica.cc:333] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.327412 1174 raft_consensus.cc:2243] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.327553 1174 raft_consensus.cc:2272] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:01.327778 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c11304c2f96f4518bedc07c23af81f50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c11304c2f96f4518bedc07c23af81f50 already in progress: creating tablet
I20260503 07:53:01.328064 1174 ts_tablet_manager.cc:1916] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.329726 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.330482 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.337715 1948 raft_consensus.cc:493] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.337847 1948 raft_consensus.cc:515] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.338363 1175 ts_tablet_manager.cc:1929] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.338450 1948 leader_election.cc:290] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.339358 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fcade062b24ee280d4943d3254df03" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.339478 986 leader_election.cc:343] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e6fcade062b24ee280d4943d3254df03
W20260503 07:53:01.339857 988 leader_election.cc:343] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.339954 988 leader_election.cc:304] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:01.340580 1948 raft_consensus.cc:2749] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.343082 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d454384a9da4ca3ae6089eac78d92a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.344141 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d454384a9da4ca3ae6089eac78d92a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.347678 1174 ts_tablet_manager.cc:1929] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.338459 1175 log.cc:1199] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/efec3cb45daf44e59132ea4d8929bd43
I20260503 07:53:01.349586 1171 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.349786 1171 ts_tablet_manager.cc:1403] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.004s
I20260503 07:53:01.350828 1171 raft_consensus.cc:359] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.351282 1171 raft_consensus.cc:385] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.351442 1171 raft_consensus.cc:740] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.351745 1171 consensus_queue.cc:260] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.352450 1171 ts_tablet_manager.cc:1434] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:01.353245 1171 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.354431 1175 ts_tablet_manager.cc:1950] T efec3cb45daf44e59132ea4d8929bd43 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.358596 1171 tablet_bootstrap.cc:654] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.358879 1173 ts_tablet_manager.cc:1929] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.359117 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet efec3cb45daf44e59132ea4d8929bd43 (table default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]) successfully deleted
W20260503 07:53:01.359452 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d7e4ba72b51a4343be56d56f93693939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e4ba72b51a4343be56d56f93693939 already in progress: creating tablet
I20260503 07:53:01.359056 1175 tablet_replica.cc:333] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.359932 1175 raft_consensus.cc:2243] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:01.360337 1175 raft_consensus.cc:2272] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.360594 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ad22db3dd7be4ad6857b954e72ad22f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.360828 1173 log.cc:1199] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/2f0489d86704462ab237e5226df1251f
I20260503 07:53:01.361231 1173 ts_tablet_manager.cc:1950] T 2f0489d86704462ab237e5226df1251f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:53:01.361563 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad22db3dd7be4ad6857b954e72ad22f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.363775 1173 tablet_replica.cc:333] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.363940 1173 raft_consensus.cc:2243] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.364116 1173 raft_consensus.cc:2272] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.364606 1173 ts_tablet_manager.cc:1916] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.365944 1174 log.cc:1199] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:01.361750 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 2f0489d86704462ab237e5226df1251f (table default.Table_f0a921f6b8344bbab898c35c3c59d1a2 [id=99ec5c91c64c44f4880574f176e882a4]) successfully deleted
I20260503 07:53:01.365589 595 master_service.cc:954] ReplaceTablet: received request to replace tablet feb88812c6b0459d86bd441926f57ecf from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.366809 1174 ts_tablet_manager.cc:1950] T e16d225dde3247d1b61a03cf14b21d63 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.365770 598 master_service.cc:954] ReplaceTablet: received request to replace tablet b2ef0e849f4d4eb299726b2b094a1dc3 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.370436 1165 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.371718 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e16d225dde3247d1b61a03cf14b21d63 (table default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]) successfully deleted
I20260503 07:53:01.371814 1165 ts_tablet_manager.cc:1403] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.188s user 0.003s sys 0.019s
I20260503 07:53:01.372398 1175 ts_tablet_manager.cc:1916] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.372625 1165 raft_consensus.cc:359] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.374907 1165 raft_consensus.cc:385] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.375234 1165 raft_consensus.cc:740] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.371516 1174 tablet_replica.cc:333] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.375790 1174 raft_consensus.cc:2243] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.375993 1174 raft_consensus.cc:2272] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.376708 1174 ts_tablet_manager.cc:1916] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.382778 1174 ts_tablet_manager.cc:1929] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.385140 1171 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.385342 1171 ts_tablet_manager.cc:1403] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.002s
I20260503 07:53:01.385203 1166 tablet_bootstrap.cc:492] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.385953 1166 ts_tablet_manager.cc:1403] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.130s user 0.014s sys 0.008s
I20260503 07:53:01.386194 1171 raft_consensus.cc:359] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.386375 1171 raft_consensus.cc:385] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.386469 1171 raft_consensus.cc:740] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.386781 1171 consensus_queue.cc:260] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.386793 1166 raft_consensus.cc:359] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.387070 1166 raft_consensus.cc:385] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.387176 1166 raft_consensus.cc:740] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.387440 1166 consensus_queue.cc:260] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.389407 1166 ts_tablet_manager.cc:1434] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:01.392035 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 75dfcff75f90434caf7dc26408958a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.394491 1948 raft_consensus.cc:493] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.394615 1948 raft_consensus.cc:515] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.394958 1171 ts_tablet_manager.cc:1434] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260503 07:53:01.395140 1948 leader_election.cc:290] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.396289 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.396580 988 consensus_peers.cc:597] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:01.396521 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e89fe8f004d494f95ef3b0d648251be" } modify_external_catalogs: true
I20260503 07:53:01.396694 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e89fe8f004d494f95ef3b0d648251be" } modify_external_catalogs: true
W20260503 07:53:01.396947 988 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.398970 1171 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.400913 1171 tablet_bootstrap.cc:654] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.404070 1173 ts_tablet_manager.cc:1929] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:01.404346 1166 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.406440 1166 tablet_bootstrap.cc:654] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.406478 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 23a4cfddb56d47a692b9226bb5af14c1
I20260503 07:53:01.407505 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.409504 598 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet b6ed43f96b4b4410b5bddb3142bdfaf1
I20260503 07:53:01.410989 1166 tablet_bootstrap.cc:492] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.411113 1166 ts_tablet_manager.cc:1403] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260503 07:53:01.411782 1166 raft_consensus.cc:359] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.411942 1166 raft_consensus.cc:385] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.411995 1166 raft_consensus.cc:740] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.412287 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.385360 1165 consensus_queue.cc:260] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.395780 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:01.412592 780 raft_consensus.cc:2468] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:01.408427 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.413389 1165 ts_tablet_manager.cc:1434] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20260503 07:53:01.413640 1165 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.414052 986 leader_election.cc:304] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.414705 1948 raft_consensus.cc:2804] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:01.414808 1948 raft_consensus.cc:493] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:01.414870 1948 raft_consensus.cc:3060] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:01.416010 1165 tablet_bootstrap.cc:654] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.417402 1948 raft_consensus.cc:515] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.419133 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:01.419701 988 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.421808 1948 leader_election.cc:290] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.421859 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:01.422017 780 raft_consensus.cc:3060] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:01.425307 780 raft_consensus.cc:2468] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:01.426011 986 leader_election.cc:304] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.426522 1948 raft_consensus.cc:2804] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:01.426522 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 5e2c6d9dd87646ed9d1f86761f13f628 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.426641 916 raft_consensus.cc:1275] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:53:01.427197 1952 consensus_queue.cc:1048] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:01.427858 1948 raft_consensus.cc:697] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:01.428100 1948 consensus_queue.cc:237] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.428869 1175 ts_tablet_manager.cc:1929] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:01.428969 1175 log.cc:1199] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b0655ef28c1d4326b2f462ab6fd8d604
I20260503 07:53:01.429348 1175 ts_tablet_manager.cc:1950] T b0655ef28c1d4326b2f462ab6fd8d604 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.430295 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]) successfully deleted
I20260503 07:53:01.430902 1175 tablet_replica.cc:333] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:53:01.431022 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2fb82179b8b845da88125aa9f32bb9fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fb82179b8b845da88125aa9f32bb9fd already in progress: creating tablet
I20260503 07:53:01.431092 1175 raft_consensus.cc:2243] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.431213 1175 raft_consensus.cc:2272] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:01.431219 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 40fee86632a64de9a9b8eba31e3534b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40fee86632a64de9a9b8eba31e3534b8 already in progress: creating tablet
W20260503 07:53:01.431416 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 4721396a62ab4c8f8c26ab6a676d17a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4721396a62ab4c8f8c26ab6a676d17a3 already in progress: creating tablet
W20260503 07:53:01.431588 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bae9ff227c8a49e8b9a85635ec59c805 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bae9ff227c8a49e8b9a85635ec59c805 already in progress: creating tablet
I20260503 07:53:01.431665 1175 ts_tablet_manager.cc:1916] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:01.431805 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 405e2bbca5c54234a80f23d9399df765 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 405e2bbca5c54234a80f23d9399df765 already in progress: creating tablet
W20260503 07:53:01.432305 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet acb2026ec07045f6b38c86f1d5d22462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acb2026ec07045f6b38c86f1d5d22462 already in progress: creating tablet
I20260503 07:53:01.433302 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 56f1c40961284bf0848c93ed6a09b111
I20260503 07:53:01.434652 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.436249 1173 log.cc:1199] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/7b4116cc31d640ac826520b41d7d3cf9
I20260503 07:53:01.436636 1173 ts_tablet_manager.cc:1950] T 7b4116cc31d640ac826520b41d7d3cf9 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.437522 1174 log.cc:1199] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d8b0329a61dd4476bc0a65e90404efb4
I20260503 07:53:01.438210 1174 ts_tablet_manager.cc:1950] T d8b0329a61dd4476bc0a65e90404efb4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.438436 1173 tablet_replica.cc:333] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.438591 1173 raft_consensus.cc:2243] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.438701 1173 raft_consensus.cc:2272] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.440500 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:01.441341 1165 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.441442 1165 ts_tablet_manager.cc:1403] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.004s
I20260503 07:53:01.441972 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d8b0329a61dd4476bc0a65e90404efb4 (table default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]) successfully deleted
I20260503 07:53:01.441936 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.442076 1165 raft_consensus.cc:359] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.442215 1165 raft_consensus.cc:385] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.442276 1165 raft_consensus.cc:740] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.442463 1165 consensus_queue.cc:260] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.442898 1165 ts_tablet_manager.cc:1434] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:01.443176 1165 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.444331 1166 consensus_queue.cc:260] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.445156 1166 ts_tablet_manager.cc:1434] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260503 07:53:01.446873 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_397f26889e7d46759abaaeb160796c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.445408 1166 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.452020 1174 tablet_replica.cc:333] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:01.452239 1174 raft_consensus.cc:2243] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.452333 1165 tablet_bootstrap.cc:654] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.454286 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f4fac070ce05432a81a7eb6efaee5edc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.455199 1166 tablet_bootstrap.cc:654] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.456146 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6ef064db41c4038af67e0d8bc00e797" } new_table_name: "default.Table_8310072bf9824acdb7236d1153b75434" modify_external_catalogs: true
I20260503 07:53:01.452419 1174 raft_consensus.cc:2272] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.457955 1174 ts_tablet_manager.cc:1916] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.459367 1175 ts_tablet_manager.cc:1929] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.460909 1165 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.461278 1173 ts_tablet_manager.cc:1916] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.439137 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
W20260503 07:53:01.464272 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.464437 1175 log.cc:1199] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/67387c8aba1f4d728b3691c5da720e4d
I20260503 07:53:01.464744 1175 ts_tablet_manager.cc:1950] T 67387c8aba1f4d728b3691c5da720e4d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:01.465629 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_397f26889e7d46759abaaeb160796c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.467626 1165 ts_tablet_manager.cc:1403] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260503 07:53:01.467749 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6f865a421e104d8a8631dc2cd65327de" } new_table_name: "default.Table_e8f4280c32e84d2e88e8941066dae78d" modify_external_catalogs: true
I20260503 07:53:01.468465 1165 raft_consensus.cc:359] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.468679 1175 tablet_replica.cc:333] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.469159 1175 raft_consensus.cc:2243] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.469295 1165 raft_consensus.cc:385] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.469430 1165 raft_consensus.cc:740] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.469555 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.469769 1175 raft_consensus.cc:2272] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.470064 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 67387c8aba1f4d728b3691c5da720e4d (table default.Table_29f9d87b702f4f08a7d36b2f3bd2028c [id=bd345ab54d2640ab81ef3154b405dcf0]) successfully deleted
I20260503 07:53:01.470243 1166 tablet_bootstrap.cc:492] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.470242 1175 ts_tablet_manager.cc:1916] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.470352 1166 ts_tablet_manager.cc:1403] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260503 07:53:01.470994 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.471036 1166 raft_consensus.cc:359] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.471174 1166 raft_consensus.cc:385] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.471230 1166 raft_consensus.cc:740] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.471431 1166 consensus_queue.cc:260] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.474151 1948 raft_consensus.cc:493] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.474359 1948 raft_consensus.cc:515] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.475069 1948 leader_election.cc:290] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.469723 1165 consensus_queue.cc:260] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.475281 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.475790 988 leader_election.cc:343] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.476513 1165 ts_tablet_manager.cc:1434] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
W20260503 07:53:01.474840 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4fac070ce05432a81a7eb6efaee5edc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.476796 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:01.477559 780 raft_consensus.cc:2468] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:01.477963 1165 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.479063 1175 ts_tablet_manager.cc:1929] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.481405 1166 ts_tablet_manager.cc:1434] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260503 07:53:01.481658 1166 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.482088 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:01.483186 1166 tablet_bootstrap.cc:654] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.486586 1165 tablet_bootstrap.cc:654] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.487072 1173 ts_tablet_manager.cc:1929] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.486636 656 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 56f1c40961284bf0848c93ed6a09b111
I20260503 07:53:01.487869 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.489049 656 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 23a4cfddb56d47a692b9226bb5af14c1
I20260503 07:53:01.479218 1948 raft_consensus.cc:493] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.479473 986 leader_election.cc:304] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.489895 1948 raft_consensus.cc:515] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.489027 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.490331 1952 raft_consensus.cc:2804] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:01.490396 1952 raft_consensus.cc:493] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:01.490450 1952 raft_consensus.cc:3060] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:01.490463 1948 leader_election.cc:290] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.490851 1175 log.cc:1199] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e6fcade062b24ee280d4943d3254df03
I20260503 07:53:01.491261 1175 ts_tablet_manager.cc:1950] T e6fcade062b24ee280d4943d3254df03 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.491273 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.492919 1952 raft_consensus.cc:515] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.493386 1952 leader_election.cc:290] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.493794 780 raft_consensus.cc:1275] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 2 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:53:01.494134 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.494354 1174 ts_tablet_manager.cc:1929] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.494933 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:01.495026 1174 log.cc:1199] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:01.495064 779 raft_consensus.cc:3060] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:01.495296 1174 ts_tablet_manager.cc:1950] T aaaeda1a5d6d436292cd1688f8a4d467 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:01.496256 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet aaaeda1a5d6d436292cd1688f8a4d467 (table default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]) successfully deleted
I20260503 07:53:01.488339 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 56f1c40961284bf0848c93ed6a09b111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.489711 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.491011 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c224dc90387c4848a5dd802d0674265d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:01.494746 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:01.496865 1175 tablet_replica.cc:333] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.496585 1173 log.cc:1199] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/75dfcff75f90434caf7dc26408958a16
I20260503 07:53:01.497013 1175 raft_consensus.cc:2243] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.497124 1175 raft_consensus.cc:2272] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.497308 1173 ts_tablet_manager.cc:1950] T 75dfcff75f90434caf7dc26408958a16 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.497570 1175 ts_tablet_manager.cc:1916] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.497581 779 raft_consensus.cc:2468] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:01.497797 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 75dfcff75f90434caf7dc26408958a16 (table default.Table_f5f99ea98c214f3681e6ffa4ff664cea [id=390b75998b794df0b857383e0b1171bb]) successfully deleted
I20260503 07:53:01.498342 986 leader_election.cc:304] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:01.498638 986 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c224dc90387c4848a5dd802d0674265d
I20260503 07:53:01.498934 1948 consensus_queue.cc:1048] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:01.499374 1948 raft_consensus.cc:2804] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:01.499491 1948 raft_consensus.cc:697] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:01.499675 1948 consensus_queue.cc:237] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:01.500799 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because the tablet was not found. No further retry: Not found: Tablet not found: 23a4cfddb56d47a692b9226bb5af14c1
I20260503 07:53:01.501793 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e6fcade062b24ee280d4943d3254df03 (table default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]) successfully deleted
W20260503 07:53:01.501852 988 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:01.502374 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because the tablet was not found. No further retry: Not found: Tablet not found: 56f1c40961284bf0848c93ed6a09b111
I20260503 07:53:01.502363 988 leader_election.cc:304] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:01.502521 988 raft_consensus.cc:2686] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260503 07:53:01.502856 988 leader_election.cc:343] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.503229 1174 tablet_replica.cc:333] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:01.503738 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because the tablet was not found. No further retry: Not found: Tablet not found: 56f1c40961284bf0848c93ed6a09b111
W20260503 07:53:01.504966 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because the tablet was not found. No further retry: Not found: Tablet not found: 23a4cfddb56d47a692b9226bb5af14c1
I20260503 07:53:01.505275 1174 raft_consensus.cc:2243] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.506356 1174 raft_consensus.cc:2272] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.513341 1166 tablet_bootstrap.cc:492] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.514969 1174 ts_tablet_manager.cc:1916] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.517889 1175 ts_tablet_manager.cc:1929] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.525938 1175 log.cc:1199] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c224dc90387c4848a5dd802d0674265d
I20260503 07:53:01.526412 1175 ts_tablet_manager.cc:1950] T c224dc90387c4848a5dd802d0674265d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.526944 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c985db4e8c1d4435b9d3eab3a950f6b4 (DEFAULT_TABLE table=default.Table_bde1352924a446178bff9a5fae5564f2 [id=c6208d726a7f4bd4bf09a334bdedc890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.527290 1171 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.527405 1171 ts_tablet_manager.cc:1403] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.128s user 0.014s sys 0.011s
I20260503 07:53:01.527935 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 597c7c65f49a4811997d99a782e7b146
I20260503 07:53:01.528049 1171 raft_consensus.cc:359] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.528221 1171 raft_consensus.cc:385] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.528272 1171 raft_consensus.cc:740] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.528447 1171 consensus_queue.cc:260] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.529124 1171 ts_tablet_manager.cc:1434] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:01.529506 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985db4e8c1d4435b9d3eab3a950f6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.526525 885 tablet_service.cc:1511] Processing CreateTablet for tablet c985db4e8c1d4435b9d3eab3a950f6b4 (DEFAULT_TABLE table=default.Table_bde1352924a446178bff9a5fae5564f2 [id=c6208d726a7f4bd4bf09a334bdedc890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.531117 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985db4e8c1d4435b9d3eab3a950f6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.531409 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 597c7c65f49a4811997d99a782e7b146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.529008 918 raft_consensus.cc:3060] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:01.529527 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 597c7c65f49a4811997d99a782e7b146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.541877 1175 tablet_replica.cc:333] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.542546 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_93b4bdecd9754df4b30241cc36c107f6" } new_table_name: "default.Table_835ad5589ec34d0ea5e2fa9aae40af8f" modify_external_catalogs: true
W20260503 07:53:01.543661 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 597c7c65f49a4811997d99a782e7b146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597c7c65f49a4811997d99a782e7b146 already in progress: creating tablet
I20260503 07:53:01.542176 1171 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.545610 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_123af1899c15436d972ab19727e939b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.546231 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_123af1899c15436d972ab19727e939b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.546592 1171 tablet_bootstrap.cc:654] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.547246 1175 raft_consensus.cc:2243] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:01.547442 1175 pending_rounds.cc:70] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:01.547484 1175 pending_rounds.cc:77] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847422177562624 op_type: NO_OP noop_request { }
I20260503 07:53:01.547554 1175 raft_consensus.cc:2889] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:01.547610 1175 raft_consensus.cc:2272] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.548308 1166 ts_tablet_manager.cc:1403] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.003s
I20260503 07:53:01.549407 1166 raft_consensus.cc:359] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.549577 1166 raft_consensus.cc:385] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.549638 1166 raft_consensus.cc:740] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.549985 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:01.551079 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_46cc52c214964d73bdb77e4c421fa90f" } new_table_name: "default.Table_3a3671670c294045b91a9e1d2641ae68" modify_external_catalogs: true
I20260503 07:53:01.553400 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c224dc90387c4848a5dd802d0674265d (table default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]) successfully deleted
W20260503 07:53:01.553617 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 336e5470149f41819b25e1f774cc7229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 336e5470149f41819b25e1f774cc7229 already in progress: creating tablet
W20260503 07:53:01.553800 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c11304c2f96f4518bedc07c23af81f50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c11304c2f96f4518bedc07c23af81f50 already in progress: creating tablet
W20260503 07:53:01.553977 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 52e5486a610142e0af6406d328ece5e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e5486a610142e0af6406d328ece5e5 already in progress: creating tablet
W20260503 07:53:01.554611 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5776840523f54e6bb18d674815d3b447 consensus state has no leader
I20260503 07:53:01.556205 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4508ceed865c41f29f88fef0b32bc938" } new_table_name: "default.Table_50de55ae9d5940d08b84f37e93bb41fc" modify_external_catalogs: true
I20260503 07:53:01.556561 1175 ts_tablet_manager.cc:1916] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.557365 885 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765ff6b70046f6a46aab3f413d04f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.521485 1165 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.529677 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 597c7c65f49a4811997d99a782e7b146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.558797 1165 ts_tablet_manager.cc:1403] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.001s
I20260503 07:53:01.559571 1165 raft_consensus.cc:359] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.559741 1165 raft_consensus.cc:385] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.559815 1165 raft_consensus.cc:740] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.560043 1165 consensus_queue.cc:260] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.560534 1165 ts_tablet_manager.cc:1434] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:01.560915 1165 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.562644 1165 tablet_bootstrap.cc:654] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.567154 1171 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.567276 1171 ts_tablet_manager.cc:1403] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.006s
I20260503 07:53:01.568001 1171 raft_consensus.cc:359] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.568151 1171 raft_consensus.cc:385] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.568217 1171 raft_consensus.cc:740] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.568398 1171 consensus_queue.cc:260] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.569373 1175 ts_tablet_manager.cc:1929] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:01.569458 1175 log.cc:1199] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/4e1c047f13d94420949c1288b12725a5
I20260503 07:53:01.569765 1175 ts_tablet_manager.cc:1950] T 4e1c047f13d94420949c1288b12725a5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.572387 1171 ts_tablet_manager.cc:1434] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260503 07:53:01.572980 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 4e1c047f13d94420949c1288b12725a5 (table default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]) successfully deleted
I20260503 07:53:01.574193 885 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4ff2b0fe14e2fba3de7873b03f49a (DEFAULT_TABLE table=default.Table_50eb48ad04f5421c81bbebf096035b97 [id=249573c671d940c4a9e68264f860c381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.574338 1175 tablet_replica.cc:333] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.574615 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4ff2b0fe14e2fba3de7873b03f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.576054 1952 raft_consensus.cc:493] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.576169 1952 raft_consensus.cc:515] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.576750 1952 leader_election.cc:290] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.577035 1171 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.577137 757 tablet_service.cc:1511] Processing CreateTablet for tablet c985db4e8c1d4435b9d3eab3a950f6b4 (DEFAULT_TABLE table=default.Table_bde1352924a446178bff9a5fae5564f2 [id=c6208d726a7f4bd4bf09a334bdedc890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.577502 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985db4e8c1d4435b9d3eab3a950f6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.577762 1175 raft_consensus.cc:2243] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.577958 1175 raft_consensus.cc:2272] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.578383 1171 tablet_bootstrap.cc:654] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.580210 1175 ts_tablet_manager.cc:1916] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.580742 2062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.62:44841 every 8 connection(s)
I20260503 07:53:01.538496 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:01.585788 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
W20260503 07:53:01.586171 986 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:01.587222 600 catalog_manager.cc:5671] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:01.587644 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:01.587936 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:01.592737 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.593078 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4ff2b0fe14e2fba3de7873b03f49a (DEFAULT_TABLE table=default.Table_50eb48ad04f5421c81bbebf096035b97 [id=249573c671d940c4a9e68264f860c381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.593416 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4ff2b0fe14e2fba3de7873b03f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.593703 880 tablet_service.cc:1511] Processing CreateTablet for tablet e089f31390f84a00ac71ed5cf31fefd5 (DEFAULT_TABLE table=default.Table_2f75ae8c8a4b48739be336c8ea8840cf [id=992857d5fa554d50998fd615a47ea796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.593721 742 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4ff2b0fe14e2fba3de7873b03f49a (DEFAULT_TABLE table=default.Table_50eb48ad04f5421c81bbebf096035b97 [id=249573c671d940c4a9e68264f860c381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.594064 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4ff2b0fe14e2fba3de7873b03f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.594060 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e089f31390f84a00ac71ed5cf31fefd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.596268 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.596451 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.600201 1171 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.600363 1171 ts_tablet_manager.cc:1403] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.002s
I20260503 07:53:01.601082 1171 raft_consensus.cc:359] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.601265 1171 raft_consensus.cc:385] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.601339 1171 raft_consensus.cc:740] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.601567 1171 consensus_queue.cc:260] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.605329 1171 ts_tablet_manager.cc:1434] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260503 07:53:01.605981 1175 ts_tablet_manager.cc:1929] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.606156 1175 log.cc:1199] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f291c68785bb4b6fb522386089fb2af3
I20260503 07:53:01.606470 1175 ts_tablet_manager.cc:1950] T f291c68785bb4b6fb522386089fb2af3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.607991 880 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac9db54171c456ca30c0cc65984d36c (DEFAULT_TABLE table=default.Table_21181bc56266453cb0d0e66c438426ce [id=6dbd8a27eda04f6db26e294412e4ed33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.608834 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e089f31390f84a00ac71ed5cf31fefd5 (DEFAULT_TABLE table=default.Table_2f75ae8c8a4b48739be336c8ea8840cf [id=992857d5fa554d50998fd615a47ea796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.609169 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e089f31390f84a00ac71ed5cf31fefd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.609354 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac9db54171c456ca30c0cc65984d36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.615326 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f291c68785bb4b6fb522386089fb2af3 (table default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]) successfully deleted
I20260503 07:53:01.615621 1175 tablet_replica.cc:333] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.615787 1175 raft_consensus.cc:2243] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.615912 1175 raft_consensus.cc:2272] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.616532 1963 raft_consensus.cc:493] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.616636 1963 raft_consensus.cc:515] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.617183 1963 leader_election.cc:290] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.617786 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c19ad357f7845fc8389cb5b923bc253" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.618237 988 leader_election.cc:343] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.618547 1171 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.619839 1171 tablet_bootstrap.cc:654] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:01.623104 986 leader_election.cc:343] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9c19ad357f7845fc8389cb5b923bc253
I20260503 07:53:01.623207 986 leader_election.cc:304] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:01.623593 1963 raft_consensus.cc:2749] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.624543 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac9db54171c456ca30c0cc65984d36c (DEFAULT_TABLE table=default.Table_21181bc56266453cb0d0e66c438426ce [id=6dbd8a27eda04f6db26e294412e4ed33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.624933 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac9db54171c456ca30c0cc65984d36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.625262 742 tablet_service.cc:1511] Processing CreateTablet for tablet e089f31390f84a00ac71ed5cf31fefd5 (DEFAULT_TABLE table=default.Table_2f75ae8c8a4b48739be336c8ea8840cf [id=992857d5fa554d50998fd615a47ea796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.626130 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e089f31390f84a00ac71ed5cf31fefd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.627578 897 tablet_service.cc:1511] Processing CreateTablet for tablet 73d6ba74596e4f85bf0cecd0cc3f0286 (DEFAULT_TABLE table=default.Table_75bbce4e47d24750b0b81dc1ba0ee08a [id=f463494555404ece97709045503da3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.627965 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d6ba74596e4f85bf0cecd0cc3f0286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.628655 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac9db54171c456ca30c0cc65984d36c (DEFAULT_TABLE table=default.Table_21181bc56266453cb0d0e66c438426ce [id=6dbd8a27eda04f6db26e294412e4ed33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.629005 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac9db54171c456ca30c0cc65984d36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.635710 1165 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.636106 1165 ts_tablet_manager.cc:1403] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.075s user 0.005s sys 0.004s
I20260503 07:53:01.637104 1165 raft_consensus.cc:359] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.637326 1165 raft_consensus.cc:385] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.637423 1165 raft_consensus.cc:740] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.637691 1165 consensus_queue.cc:260] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.638204 1165 ts_tablet_manager.cc:1434] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:01.638550 1165 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.638863 1173 tablet_replica.cc:333] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.639062 1173 raft_consensus.cc:2243] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.639232 1173 raft_consensus.cc:2272] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.640336 1165 tablet_bootstrap.cc:654] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.640448 1175 ts_tablet_manager.cc:1916] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.644070 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 73d6ba74596e4f85bf0cecd0cc3f0286 (DEFAULT_TABLE table=default.Table_75bbce4e47d24750b0b81dc1ba0ee08a [id=f463494555404ece97709045503da3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.644479 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d6ba74596e4f85bf0cecd0cc3f0286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.646454 1175 ts_tablet_manager.cc:1929] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.646533 1175 log.cc:1199] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/eea048c5820349d481ac54a570b57649
I20260503 07:53:01.646795 1175 ts_tablet_manager.cc:1950] T eea048c5820349d481ac54a570b57649 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.649220 1173 ts_tablet_manager.cc:1916] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.650647 1171 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.650775 1171 ts_tablet_manager.cc:1403] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.002s
I20260503 07:53:01.651464 1171 raft_consensus.cc:359] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.651607 1171 raft_consensus.cc:385] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.651652 1171 raft_consensus.cc:740] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.651851 1171 consensus_queue.cc:260] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.652364 1171 ts_tablet_manager.cc:1434] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:53:01.652940 750 tablet_service.cc:1511] Processing CreateTablet for tablet 73d6ba74596e4f85bf0cecd0cc3f0286 (DEFAULT_TABLE table=default.Table_75bbce4e47d24750b0b81dc1ba0ee08a [id=f463494555404ece97709045503da3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.653327 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d6ba74596e4f85bf0cecd0cc3f0286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.656810 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb362fee7bc4f948d3a5b660e9cbd1a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:01.658413 885 tablet_service.cc:1511] Processing CreateTablet for tablet dd06852d500a41c881103e1ab742029b (DEFAULT_TABLE table=default.Table_3e96ff4a649144108e63254466c613e2 [id=6eaca7d0b7604f0490c4012289c194b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.659085 1801 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.62:44841
I20260503 07:53:01.659547 1171 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.660593 1024 tablet_service.cc:1511] Processing CreateTablet for tablet dd06852d500a41c881103e1ab742029b (DEFAULT_TABLE table=default.Table_3e96ff4a649144108e63254466c613e2 [id=6eaca7d0b7604f0490c4012289c194b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.660946 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd06852d500a41c881103e1ab742029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.661572 1801 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-0/data/info.pb
I20260503 07:53:01.661729 1175 tablet_replica.cc:333] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.661907 1175 raft_consensus.cc:2243] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:01.661875 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet eea048c5820349d481ac54a570b57649 (table default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]) successfully deleted
I20260503 07:53:01.662191 1175 raft_consensus.cc:2272] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.662674 1175 ts_tablet_manager.cc:1916] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:01.663146 988 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.663276 988 leader_election.cc:304] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:01.663585 1963 raft_consensus.cc:2749] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.663874 1171 tablet_bootstrap.cc:654] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.669080 750 tablet_service.cc:1511] Processing CreateTablet for tablet dd06852d500a41c881103e1ab742029b (DEFAULT_TABLE table=default.Table_3e96ff4a649144108e63254466c613e2 [id=6eaca7d0b7604f0490c4012289c194b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.669431 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 1801
I20260503 07:53:01.669476 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd06852d500a41c881103e1ab742029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.669826 1174 ts_tablet_manager.cc:1929] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.679329 880 tablet_service.cc:1511] Processing CreateTablet for tablet 801e48526d634222875678f56ce00cfe (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.683388 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79d43ae066e6411896c490f7c0b11180 consensus state has no leader
I20260503 07:53:01.684744 1166 consensus_queue.cc:260] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.685184 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 72fc61b1b49045fbb9b6b0cb94b1d661
I20260503 07:53:01.685715 592 catalog_manager.cc:6741] ReplaceTablet: tablet 72fc61b1b49045fbb9b6b0cb94b1d661 deleted and replaced by tablet 2f9a23702aa5493ea8712f904af96755
I20260503 07:53:01.686354 1175 ts_tablet_manager.cc:1929] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:01.686384 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b028017b7cc74ef6a199d6b9e0ba6e14
I20260503 07:53:01.686451 1175 log.cc:1199] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/7b4116cc31d640ac826520b41d7d3cf9
I20260503 07:53:01.686781 1175 ts_tablet_manager.cc:1950] T 7b4116cc31d640ac826520b41d7d3cf9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.687247 1734 raft_consensus.cc:493] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.687397 1734 raft_consensus.cc:515] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.687654 1171 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.687767 1171 ts_tablet_manager.cc:1403] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260503 07:53:01.688253 1734 leader_election.cc:290] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:01.688517 1171 raft_consensus.cc:359] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.688653 1171 raft_consensus.cc:385] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.688702 1171 raft_consensus.cc:740] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:01.688958 854 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:53:01.688911 1171 consensus_queue.cc:260] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.689260 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.689361 1171 ts_tablet_manager.cc:1434] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:01.689719 1171 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.691006 741 tablet_service.cc:1558] Processing DeleteTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.691577 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.691774 1171 tablet_bootstrap.cc:654] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.691773 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9a23702aa5493ea8712f904af96755) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.693118 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
I20260503 07:53:01.693164 1175 tablet_replica.cc:333] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.693322 1175 raft_consensus.cc:2243] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.693522 1175 raft_consensus.cc:2272] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.694010 1175 ts_tablet_manager.cc:1916] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.698566 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd06852d500a41c881103e1ab742029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.699096 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801e48526d634222875678f56ce00cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.700886 1171 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.701016 1171 ts_tablet_manager.cc:1403] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260503 07:53:01.702361 1171 raft_consensus.cc:359] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.702510 1171 raft_consensus.cc:385] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.702556 1171 raft_consensus.cc:740] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.702859 1978 raft_consensus.cc:493] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.702888 1171 consensus_queue.cc:260] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.703312 1171 ts_tablet_manager.cc:1434] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:01.703536 1171 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.705083 1171 tablet_bootstrap.cc:654] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.706634 1173 ts_tablet_manager.cc:1929] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.706838 1173 log.cc:1199] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c5765ff6b70046f6a46aab3f413d04f8
I20260503 07:53:01.707314 1173 ts_tablet_manager.cc:1950] T c5765ff6b70046f6a46aab3f413d04f8 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.709468 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 801e48526d634222875678f56ce00cfe (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.709801 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801e48526d634222875678f56ce00cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.714608 741 tablet_service.cc:1511] Processing CreateTablet for tablet 801e48526d634222875678f56ce00cfe (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.715930 1175 ts_tablet_manager.cc:1929] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.716138 1175 log.cc:1199] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ac8d392c3bb94f03819fae08fc009fbc
I20260503 07:53:01.716291 1174 log.cc:1199] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/568ccdf187eb4cae9688ff4929f3e95e
I20260503 07:53:01.716517 1175 ts_tablet_manager.cc:1950] T ac8d392c3bb94f03819fae08fc009fbc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.717303 1171 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.717463 1171 ts_tablet_manager.cc:1403] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.002s
I20260503 07:53:01.718152 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 (DEFAULT_TABLE table=default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0 [id=e4a625df543647fc8a3645132dcfcc10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.718504 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63ee58b76a24cdc9b701f44aad4d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.718389 1978 raft_consensus.cc:515] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.718564 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9a23702aa5493ea8712f904af96755) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.719276 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9a23702aa5493ea8712f904af96755) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.719445 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801e48526d634222875678f56ce00cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.721374 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5896bb71c674358957c87a347b8fb79" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.721789 1171 raft_consensus.cc:359] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.721923 1171 raft_consensus.cc:385] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.721975 1171 raft_consensus.cc:740] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.722148 1171 consensus_queue.cc:260] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.722599 1174 ts_tablet_manager.cc:1950] T 568ccdf187eb4cae9688ff4929f3e95e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:01.724217 716 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.724278 1171 ts_tablet_manager.cc:1434] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:53:01.724366 759 tablet_service.cc:1511] Processing CreateTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 (DEFAULT_TABLE table=default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0 [id=e4a625df543647fc8a3645132dcfcc10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.724505 1171 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.724685 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63ee58b76a24cdc9b701f44aad4d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.726039 1171 tablet_bootstrap.cc:654] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.728188 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ac8d392c3bb94f03819fae08fc009fbc (table default.Table_f325744f54204131b4a076e2a2712261 [id=a95805f323654a5a9355c882cda4d708]) successfully deleted
W20260503 07:53:01.728428 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because the tablet was not found. No further retry: Not found: Tablet not found: 23a4cfddb56d47a692b9226bb5af14c1
W20260503 07:53:01.728629 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because the tablet was not found. No further retry: Not found: Tablet not found: 56f1c40961284bf0848c93ed6a09b111
W20260503 07:53:01.728837 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because the tablet was not found. No further retry: Not found: Tablet not found: 56f1c40961284bf0848c93ed6a09b111
W20260503 07:53:01.729035 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because the tablet was not found. No further retry: Not found: Tablet not found: 23a4cfddb56d47a692b9226bb5af14c1
W20260503 07:53:01.729228 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 597c7c65f49a4811997d99a782e7b146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597c7c65f49a4811997d99a782e7b146 already in progress: creating tablet
W20260503 07:53:01.729449 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b028017b7cc74ef6a199d6b9e0ba6e14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b028017b7cc74ef6a199d6b9e0ba6e14 already in progress: creating tablet
W20260503 07:53:01.729653 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72fc61b1b49045fbb9b6b0cb94b1d661 already in progress: creating tablet
W20260503 07:53:01.731992 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b41c8df97b849ad837271b383157c70 consensus state has no leader
W20260503 07:53:01.734611 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d93d5f6df3349588b9f1d5e0e24a1db consensus state has no leader
W20260503 07:53:01.737795 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb8e3c37b65a4f3b8fb3d6357af50325 has no consensus state
I20260503 07:53:01.739122 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2f9dd118b5dc4939baed5ff4f8b624e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.739704 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f9dd118b5dc4939baed5ff4f8b624e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.741115 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fadf876a1e6c4d0b98eec1b009f15056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.741587 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fadf876a1e6c4d0b98eec1b009f15056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.742961 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a2f4f64a80a0412fbaecc20893120f76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.743502 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2f4f64a80a0412fbaecc20893120f76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.744861 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_18c1b7fdcbb24350ab6e740fd46f6fb5" } modify_external_catalogs: true
I20260503 07:53:01.745044 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_18c1b7fdcbb24350ab6e740fd46f6fb5" } modify_external_catalogs: true
I20260503 07:53:01.746181 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cd3761aae67d400e9781b631dc57766b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.746712 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd3761aae67d400e9781b631dc57766b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.747983 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2c4f599d97c14121ab590982ded7da24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.749821 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:01.750051 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:01.752895 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 4721396a62ab4c8f8c26ab6a676d17a3 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.753683 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_17f168c46dea4d82a0beacb34d4387a1" } modify_external_catalogs: true
I20260503 07:53:01.715233 897 tablet_service.cc:1511] Processing CreateTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 (DEFAULT_TABLE table=default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0 [id=e4a625df543647fc8a3645132dcfcc10]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.716905 851 leader_election.cc:343] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:53:01.753996 851 leader_election.cc:304] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:01.754786 896 tablet_service.cc:1511] Processing CreateTablet for tablet c1f5a6143d1e440d96a9281ab55387bb (DEFAULT_TABLE table=default.Table_12549670f6814397948d9ba1037b63f7 [id=5db007dd7007440c970e142a5a5d3a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.755978 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_17f168c46dea4d82a0beacb34d4387a1" } modify_external_catalogs: true
W20260503 07:53:01.755838 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c4f599d97c14121ab590982ded7da24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.757797 2090 tablet.cc:1724] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:01.758916 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4a245aa51e4d46388849d524124ea6ea" } modify_external_catalogs: true
I20260503 07:53:01.759080 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4a245aa51e4d46388849d524124ea6ea" } modify_external_catalogs: true
I20260503 07:53:01.760584 2082 raft_consensus.cc:2749] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.729142 1166 ts_tablet_manager.cc:1434] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.180s user 0.001s sys 0.002s
I20260503 07:53:01.761090 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_beba5c7824814c2c9032f691c03cfe49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.761698 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_beba5c7824814c2c9032f691c03cfe49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.766752 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e96ff4a649144108e63254466c613e2" } modify_external_catalogs: true
I20260503 07:53:01.766923 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e96ff4a649144108e63254466c613e2" } modify_external_catalogs: true
I20260503 07:53:01.772313 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.772315 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.772351 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.772595 1175 tablet_replica.cc:333] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.772758 1175 raft_consensus.cc:2243] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.775300 1175 raft_consensus.cc:2272] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.776016 1175 ts_tablet_manager.cc:1916] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.777262 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ad3393d69e914af6bc8c5f82b09418ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.777710 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad3393d69e914af6bc8c5f82b09418ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.779520 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bec8690e29ea4e8382846d3c96263603"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.780123 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bec8690e29ea4e8382846d3c96263603 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.781908 1175 ts_tablet_manager.cc:1929] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.782039 1175 log.cc:1199] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9c19ad357f7845fc8389cb5b923bc253
I20260503 07:53:01.782358 1175 ts_tablet_manager.cc:1950] T 9c19ad357f7845fc8389cb5b923bc253 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.782665 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:01.783004 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:01.783313 1175 tablet_replica.cc:333] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.783469 1175 raft_consensus.cc:2243] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.783293 599 catalog_manager.cc:5671] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:01.783589 1175 raft_consensus.cc:2272] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.783645 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:01.784353 1175 ts_tablet_manager.cc:1916] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.784351 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9c19ad357f7845fc8389cb5b923bc253 (table default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]) successfully deleted
I20260503 07:53:01.786178 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:01.787663 1983 raft_consensus.cc:493] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.796607 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0422b379bbf34a8e8773541f2336f477
I20260503 07:53:01.797418 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_962c8fef109e45ac9f1eb915b5645c2c" } new_table_name: "default.Table_bf3c0bef71dd4cbb95e968ab52972f4a" modify_external_catalogs: true
I20260503 07:53:01.799068 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0422b379bbf34a8e8773541f2336f477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.802086 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0422b379bbf34a8e8773541f2336f477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.802239 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c1f5a6143d1e440d96a9281ab55387bb (DEFAULT_TABLE table=default.Table_12549670f6814397948d9ba1037b63f7 [id=5db007dd7007440c970e142a5a5d3a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.802606 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f5a6143d1e440d96a9281ab55387bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.802838 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93d5f6df3349588b9f1d5e0e24a1db (DEFAULT_TABLE table=default.Table_3a3671670c294045b91a9e1d2641ae68 [id=19b4cec22a884b289ec478592a49d071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.804664 892 tablet_service.cc:1511] Processing CreateTablet for tablet 828b428484254b5a9de88d5cffd824f6 (DEFAULT_TABLE table=default.Table_53fadf3ed012466e9ea3f5abc1a02cdd [id=c6ba017071ec49498bedd7291df0000c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.806345 894 tablet_service.cc:1511] Processing CreateTablet for tablet ff3e4f5644114ee1ace177a0bcb69e36 (DEFAULT_TABLE table=default.Table_9df8b6a13cf047c78089f111af18bd1d [id=ec26414ee28f49dd86860912e749565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.807768 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5896bb71c674358957c87a347b8fb79" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:01.809322 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93d5f6df3349588b9f1d5e0e24a1db (DEFAULT_TABLE table=default.Table_3a3671670c294045b91a9e1d2641ae68 [id=19b4cec22a884b289ec478592a49d071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.809725 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93d5f6df3349588b9f1d5e0e24a1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.811565 1024 tablet_service.cc:1511] Processing CreateTablet for tablet ff3e4f5644114ee1ace177a0bcb69e36 (DEFAULT_TABLE table=default.Table_9df8b6a13cf047c78089f111af18bd1d [id=ec26414ee28f49dd86860912e749565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.811878 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3e4f5644114ee1ace177a0bcb69e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.812595 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 828b428484254b5a9de88d5cffd824f6 (DEFAULT_TABLE table=default.Table_53fadf3ed012466e9ea3f5abc1a02cdd [id=c6ba017071ec49498bedd7291df0000c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.812906 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b428484254b5a9de88d5cffd824f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.815817 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63ee58b76a24cdc9b701f44aad4d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.816064 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c5765ff6b70046f6a46aab3f413d04f8 (table default.Table_564e5157ad4c4635936c429658c6c64b [id=0ffe90a4ac0f4f50acb8803f20fe985b]) successfully deleted
I20260503 07:53:01.816460 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f5a6143d1e440d96a9281ab55387bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.820458 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3e4f5644114ee1ace177a0bcb69e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.824427 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b428484254b5a9de88d5cffd824f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.825016 1175 ts_tablet_manager.cc:1929] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.825557 1175 log.cc:1199] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:01.826932 1175 ts_tablet_manager.cc:1950] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.830518 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93d5f6df3349588b9f1d5e0e24a1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.830646 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (table default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]) successfully deleted
I20260503 07:53:01.831072 1175 tablet_replica.cc:333] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.831797 1175 raft_consensus.cc:2243] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.832304 1175 raft_consensus.cc:2272] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.833263 1983 raft_consensus.cc:515] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.834000 1983 leader_election.cc:290] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:01.834075 1175 ts_tablet_manager.cc:1916] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.834847 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.836570 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f (DEFAULT_TABLE table=default.Table_210fa78803ca498faf76d6ae8dfc3e1a [id=42f5ca0d25fd459da8684e6e073c6e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.837092 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3b5589aeb4d8399c415b361cacf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.728101 1978 leader_election.cc:290] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:01.838239 897 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f (DEFAULT_TABLE table=default.Table_210fa78803ca498faf76d6ae8dfc3e1a [id=42f5ca0d25fd459da8684e6e073c6e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.838573 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3b5589aeb4d8399c415b361cacf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.838570 1165 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:01.839862 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 (DEFAULT_TABLE table=default.Table_8787cb7c35ba4884a630ad89181b7728 [id=43cf4026fdb9429c9f3783eccc7a7801]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.840090 715 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.840685 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0422b379bbf34a8e8773541f2336f477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.841102 746 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93d5f6df3349588b9f1d5e0e24a1db (DEFAULT_TABLE table=default.Table_3a3671670c294045b91a9e1d2641ae68 [id=19b4cec22a884b289ec478592a49d071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.841446 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93d5f6df3349588b9f1d5e0e24a1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.841615 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.841665 752 tablet_service.cc:1511] Processing CreateTablet for tablet c1f5a6143d1e440d96a9281ab55387bb (DEFAULT_TABLE table=default.Table_12549670f6814397948d9ba1037b63f7 [id=5db007dd7007440c970e142a5a5d3a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.841980 761 tablet_service.cc:1511] Processing CreateTablet for tablet ff3e4f5644114ee1ace177a0bcb69e36 (DEFAULT_TABLE table=default.Table_9df8b6a13cf047c78089f111af18bd1d [id=ec26414ee28f49dd86860912e749565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.842465 743 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 (DEFAULT_TABLE table=default.Table_8787cb7c35ba4884a630ad89181b7728 [id=43cf4026fdb9429c9f3783eccc7a7801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.842988 758 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f (DEFAULT_TABLE table=default.Table_210fa78803ca498faf76d6ae8dfc3e1a [id=42f5ca0d25fd459da8684e6e073c6e15]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.843554 716 leader_election.cc:343] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.843866 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.841990 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.844798 880 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.845178 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.846397 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f5a6143d1e440d96a9281ab55387bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.846470 715 leader_election.cc:304] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.849045 1166 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:01.849817 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:01.850706 1166 tablet_bootstrap.cc:654] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:01.851920 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b028017b7cc74ef6a199d6b9e0ba6e14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b028017b7cc74ef6a199d6b9e0ba6e14 already in progress: creating tablet
I20260503 07:53:01.851626 896 tablet_service.cc:1511] Processing CreateTablet for tablet dcfa5158cbc74dbbb34ec16f398afbee (DEFAULT_TABLE table=default.Table_5a872bc917154006876df6f9b6971f13 [id=c162ed3b75674518b3114f3a3821f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.852382 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfa5158cbc74dbbb34ec16f398afbee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:01.852527 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72fc61b1b49045fbb9b6b0cb94b1d661 already in progress: creating tablet
W20260503 07:53:01.852767 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0422b379bbf34a8e8773541f2336f477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0422b379bbf34a8e8773541f2336f477 already in progress: creating tablet
I20260503 07:53:01.852989 1978 raft_consensus.cc:2749] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.855988 750 tablet_service.cc:1511] Processing CreateTablet for tablet 828b428484254b5a9de88d5cffd824f6 (DEFAULT_TABLE table=default.Table_53fadf3ed012466e9ea3f5abc1a02cdd [id=c6ba017071ec49498bedd7291df0000c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.857085 1032 tablet_service.cc:1511] Processing CreateTablet for tablet dcfa5158cbc74dbbb34ec16f398afbee (DEFAULT_TABLE table=default.Table_5a872bc917154006876df6f9b6971f13 [id=c162ed3b75674518b3114f3a3821f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.857205 1165 ts_tablet_manager.cc:1403] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.201s user 0.000s sys 0.003s
I20260503 07:53:01.857482 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfa5158cbc74dbbb34ec16f398afbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.857686 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3e4f5644114ee1ace177a0bcb69e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.860110 892 tablet_service.cc:1511] Processing CreateTablet for tablet 437d8b148ade443790f5c42c7d955f48 (DEFAULT_TABLE table=default.Table_0f5167cd18ea4da7a967e8637f5f3c59 [id=b575764fb8c140b4937403629794052c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.860282 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b428484254b5a9de88d5cffd824f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.860432 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437d8b148ade443790f5c42c7d955f48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:01.865602 715 leader_election.cc:343] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.866374 715 leader_election.cc:304] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.866807 1978 raft_consensus.cc:2749] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:01.867003 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.867635 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3b5589aeb4d8399c415b361cacf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.867857 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 437d8b148ade443790f5c42c7d955f48 (DEFAULT_TABLE table=default.Table_0f5167cd18ea4da7a967e8637f5f3c59 [id=b575764fb8c140b4937403629794052c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.868363 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437d8b148ade443790f5c42c7d955f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.869542 752 tablet_service.cc:1511] Processing CreateTablet for tablet dcfa5158cbc74dbbb34ec16f398afbee (DEFAULT_TABLE table=default.Table_5a872bc917154006876df6f9b6971f13 [id=c162ed3b75674518b3114f3a3821f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.870101 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfa5158cbc74dbbb34ec16f398afbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.870399 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]). Expected version 1 got 0
I20260503 07:53:01.871464 759 tablet_service.cc:1511] Processing CreateTablet for tablet 437d8b148ade443790f5c42c7d955f48 (DEFAULT_TABLE table=default.Table_0f5167cd18ea4da7a967e8637f5f3c59 [id=b575764fb8c140b4937403629794052c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.871560 880 tablet_service.cc:1511] Processing CreateTablet for tablet 56f1c40961284bf0848c93ed6a09b111 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.871610 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.871788 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437d8b148ade443790f5c42c7d955f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.871867 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f1c40961284bf0848c93ed6a09b111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.871925 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.872406 1015 tablet_service.cc:1511] Processing CreateTablet for tablet cda1c9b4239240029bac8ee192ef5cfb (DEFAULT_TABLE table=default.Table_977ac44bf2c24650b0c8460ae9d17673 [id=52cfe62200bb4f3a9cc506e158ea99f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.872725 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda1c9b4239240029bac8ee192ef5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.879667 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 56f1c40961284bf0848c93ed6a09b111 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.880050 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f1c40961284bf0848c93ed6a09b111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.883074 896 tablet_service.cc:1511] Processing CreateTablet for tablet 431525b4f9154154890a026a4ce3755b (DEFAULT_TABLE table=default.Table_8d334082884d4c59a4de7279df62be83 [id=0e9ad4b81c184a65954f96bf6dfeb7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.883445 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431525b4f9154154890a026a4ce3755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.886386 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 431525b4f9154154890a026a4ce3755b (DEFAULT_TABLE table=default.Table_8d334082884d4c59a4de7279df62be83 [id=0e9ad4b81c184a65954f96bf6dfeb7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.886746 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431525b4f9154154890a026a4ce3755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.887568 1948 consensus_queue.cc:1048] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:01.895006 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:01.894945 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3bca06d9ad364a9e8a6f5d2a95009b36 (DEFAULT_TABLE table=default.Table_b0c49496026246f0a3c123d009c9c27e [id=acd845d8bc054bc4a6714ea38d0cec3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.895339 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca06d9ad364a9e8a6f5d2a95009b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.897941 1175 ts_tablet_manager.cc:1929] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.898640 1175 log.cc:1199] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d8b0329a61dd4476bc0a65e90404efb4
I20260503 07:53:01.900202 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3e688661ecdc4ba1b8b8c0867499fe4d
I20260503 07:53:01.900475 1175 ts_tablet_manager.cc:1950] T d8b0329a61dd4476bc0a65e90404efb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:01.900943 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eca13fd90a5d4612bf83442d4bc8e4f9" } new_table_name: "default.Table_c8fc879134dd44bcbe3691c18e4f71ec" modify_external_catalogs: true
I20260503 07:53:01.902454 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cf0fc71afa81460c80b460e39722d398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.902976 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf0fc71afa81460c80b460e39722d398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.904325 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2627dbd840b44aaa9ee93bea935f5c4b" } modify_external_catalogs: true
I20260503 07:53:01.904490 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2627dbd840b44aaa9ee93bea935f5c4b" } modify_external_catalogs: true
I20260503 07:53:01.905664 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dd06852d500a41c881103e1ab742029b
W20260503 07:53:01.908651 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 901759f5fd1b4ab9af876c76a14023ad has no consensus state
I20260503 07:53:01.909518 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d8b0329a61dd4476bc0a65e90404efb4 (table default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]) successfully deleted
I20260503 07:53:01.909627 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:01.909746 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0422b379bbf34a8e8773541f2336f477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0422b379bbf34a8e8773541f2336f477 already in progress: creating tablet
I20260503 07:53:01.910041 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.910670 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:01.911942 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dbd9458716524bdb8658bdef4d73bbac
I20260503 07:53:01.913805 884 tablet_service.cc:1558] Processing DeleteTablet for tablet dd06852d500a41c881103e1ab742029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.914013 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2c6d9dd87646ed9d1f86761f13f628 with delete_type TABLET_DATA_DELETED (replaced by tablet 75419ed8fabc4c36ae2d2b128ec4f5b5) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.914090 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 (DEFAULT_TABLE table=default.Table_8787cb7c35ba4884a630ad89181b7728 [id=43cf4026fdb9429c9f3783eccc7a7801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.914254 879 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd9458716524bdb8658bdef4d73bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.914470 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb075e64164ae1ab0c0d6b2d7cc975. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:01.915179 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet dd06852d500a41c881103e1ab742029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd06852d500a41c881103e1ab742029b already in progress: creating tablet
I20260503 07:53:01.915485 1173 tablet_replica.cc:333] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:01.915694 1173 raft_consensus.cc:2243] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.915890 1173 raft_consensus.cc:2272] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.917603 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.917872 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.918902 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 3bca06d9ad364a9e8a6f5d2a95009b36 (DEFAULT_TABLE table=default.Table_b0c49496026246f0a3c123d009c9c27e [id=acd845d8bc054bc4a6714ea38d0cec3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.919083 1173 ts_tablet_manager.cc:1916] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:01.919315 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca06d9ad364a9e8a6f5d2a95009b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.921155 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]). Expected version 2 got 0
I20260503 07:53:01.921591 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:01.921974 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:01.922562 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:01.913762 894 tablet_service.cc:1511] Processing CreateTablet for tablet cda1c9b4239240029bac8ee192ef5cfb (DEFAULT_TABLE table=default.Table_977ac44bf2c24650b0c8460ae9d17673 [id=52cfe62200bb4f3a9cc506e158ea99f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.923610 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ab0752eb4fa49a48cf521f9a072689a consensus state has no leader
I20260503 07:53:01.923754 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda1c9b4239240029bac8ee192ef5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.924093 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet dd06852d500a41c881103e1ab742029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.925349 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd9458716524bdb8658bdef4d73bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.927253 1175 tablet_replica.cc:333] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:01.927881 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet efeecf8029c8464089a5a64e4457c9c5
I20260503 07:53:01.927832 1175 raft_consensus.cc:2243] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:01.928231 1175 raft_consensus.cc:2272] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:01.929440 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.929673 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet efeecf8029c8464089a5a64e4457c9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.928607 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e688661ecdc4ba1b8b8c0867499fe4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.930342 891 tablet_service.cc:1558] Processing DeleteTablet for tablet efeecf8029c8464089a5a64e4457c9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.931813 891 tablet_service.cc:1511] Processing CreateTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 (DEFAULT_TABLE table=default.Table_f5377c86cbac41cf89ac902aee58a630 [id=c43e096e63ed4f7d8717eef7e4717f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.932214 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a4cfddb56d47a692b9226bb5af14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.935282 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cb6a510fb25541a98a4439a381cde649"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.935422 1175 ts_tablet_manager.cc:1916] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:01.935776 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb6a510fb25541a98a4439a381cde649 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.936103 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.937918 1173 ts_tablet_manager.cc:1929] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:01.938735 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_553f5ec1e276434b9442fb5e2e852eaa" } new_table_name: "default.Table_7eea345022f4468c978d09942e1140f2" modify_external_catalogs: true
I20260503 07:53:01.940681 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 6eb7486acc6a49dba0295ee26ac68724 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.943325 1171 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:01.943454 1171 ts_tablet_manager.cc:1403] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.219s user 0.015s sys 0.009s
I20260503 07:53:01.944231 1171 raft_consensus.cc:359] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.944406 1171 raft_consensus.cc:385] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.944463 1171 raft_consensus.cc:740] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.944815 1171 consensus_queue.cc:260] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.945559 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5a9cbb39e64c4133b32390723e5fc5de" } new_table_name: "default.Table_30fb89cc2aa04ab2bff3ca1557627122" modify_external_catalogs: true
I20260503 07:53:01.948304 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5a872bc917154006876df6f9b6971f13" } new_table_name: "default.Table_5e0dfcd2be7a483b85915736cf99051a" modify_external_catalogs: true
I20260503 07:53:01.948755 1171 ts_tablet_manager.cc:1434] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:01.950997 2076 sys_catalog.cc:263] Verifying existing consensus state
I20260503 07:53:01.929456 742 tablet_service.cc:1511] Processing CreateTablet for tablet 431525b4f9154154890a026a4ce3755b (DEFAULT_TABLE table=default.Table_8d334082884d4c59a4de7279df62be83 [id=0e9ad4b81c184a65954f96bf6dfeb7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.954975 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 (DEFAULT_TABLE table=default.Table_f5377c86cbac41cf89ac902aee58a630 [id=c43e096e63ed4f7d8717eef7e4717f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.955634 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a4cfddb56d47a692b9226bb5af14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.960213 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.960530 1171 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:01.960593 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b9c5dcc9832845b88577cf987d5e3144 (DEFAULT_TABLE table=default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.960632 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b437f46d00cb4950aa394df78f9fff19 (DEFAULT_TABLE table=default.Table_fc75b63b6b0640e1a4616681196b67f6 [id=c5320631815a4c04a0bf2bb4d9093661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.960923 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c5dcc9832845b88577cf987d5e3144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.961232 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bba8ad1d86a146e2a1e2b7da8974ada1 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.961557 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba8ad1d86a146e2a1e2b7da8974ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.962342 1171 tablet_bootstrap.cc:654] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:01.945855 1166 tablet_bootstrap.cc:492] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:01.946604 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:01.963897 1166 ts_tablet_manager.cc:1403] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.002s
I20260503 07:53:01.964109 1173 log.cc:1199] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/5e2c6d9dd87646ed9d1f86761f13f628
I20260503 07:53:01.964583 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6eb7486acc6a49dba0295ee26ac68724
I20260503 07:53:01.965071 601 catalog_manager.cc:6741] ReplaceTablet: tablet 6eb7486acc6a49dba0295ee26ac68724 deleted and replaced by tablet a09ff2aded174da2b6450cc2b7be28bc
W20260503 07:53:01.966285 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2938683f48cc45fca87f01e4aec9e6b9 has no consensus state
W20260503 07:53:01.966801 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dcfa5158cbc74dbbb34ec16f398afbee consensus state has no leader
I20260503 07:53:01.969619 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437f46d00cb4950aa394df78f9fff19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.973299 1165 raft_consensus.cc:359] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.973577 1165 raft_consensus.cc:385] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:01.973683 1165 raft_consensus.cc:740] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:01.973783 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 with delete_type TABLET_DATA_DELETED (replaced by tablet a09ff2aded174da2b6450cc2b7be28bc) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:01.973817 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 with delete_type TABLET_DATA_DELETED (replaced by tablet a09ff2aded174da2b6450cc2b7be28bc) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:01.973996 1165 consensus_queue.cc:260] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.975363 1166 raft_consensus.cc:359] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:01.975560 885 tablet_service.cc:1511] Processing CreateTablet for tablet bba8ad1d86a146e2a1e2b7da8974ada1 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.975947 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.976123 1165 ts_tablet_manager.cc:1434] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.119s user 0.000s sys 0.002s
I20260503 07:53:01.976468 1165 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:01.976486 880 tablet_service.cc:1511] Processing CreateTablet for tablet b9c5dcc9832845b88577cf987d5e3144 (DEFAULT_TABLE table=default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.977043 741 tablet_service.cc:1511] Processing CreateTablet for tablet 56f1c40961284bf0848c93ed6a09b111 (DEFAULT_TABLE table=default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.977698 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ca3bd12cae99485f821af37a50f557b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.977828 750 tablet_service.cc:1511] Processing CreateTablet for tablet cda1c9b4239240029bac8ee192ef5cfb (DEFAULT_TABLE table=default.Table_977ac44bf2c24650b0c8460ae9d17673 [id=52cfe62200bb4f3a9cc506e158ea99f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:01.978262 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca3bd12cae99485f821af37a50f557b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.978416 1978 raft_consensus.cc:493] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:01.978793 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431525b4f9154154890a026a4ce3755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.978745 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.979101 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbca27f54064345b374b0cea96ca1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.982688 1978 raft_consensus.cc:515] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:01.982796 2076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Bootstrap starting.
I20260503 07:53:01.983281 1173 ts_tablet_manager.cc:1950] T 5e2c6d9dd87646ed9d1f86761f13f628 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:01.981030 745 tablet_service.cc:1558] Processing DeleteTablet for tablet dd06852d500a41c881103e1ab742029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.983799 894 tablet_service.cc:1511] Processing CreateTablet for tablet b437f46d00cb4950aa394df78f9fff19 (DEFAULT_TABLE table=default.Table_fc75b63b6b0640e1a4616681196b67f6 [id=c5320631815a4c04a0bf2bb4d9093661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.983928 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f1c40961284bf0848c93ed6a09b111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.984627 595 master_service.cc:954] ReplaceTablet: received request to replace tablet f3cfc39292764a93a7cbb7c83f11e179 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:01.984864 1978 leader_election.cc:290] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:01.984910 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75419ed8fabc4c36ae2d2b128ec4f5b5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:01.985360 715 leader_election.cc:343] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:01.985392 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75419ed8fabc4c36ae2d2b128ec4f5b5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:01.985646 747 tablet_service.cc:1558] Processing DeleteTablet for tablet efeecf8029c8464089a5a64e4457c9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.985834 744 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd9458716524bdb8658bdef4d73bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:01.985769 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8feb829fa26149529dfedfed7c5679ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:01.986161 716 leader_election.cc:343] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:01.986286 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8feb829fa26149529dfedfed7c5679ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.986284 716 leader_election.cc:304] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:01.986544 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3bca06d9ad364a9e8a6f5d2a95009b36 (DEFAULT_TABLE table=default.Table_b0c49496026246f0a3c123d009c9c27e [id=acd845d8bc054bc4a6714ea38d0cec3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.987107 745 tablet_service.cc:1511] Processing CreateTablet for tablet 23a4cfddb56d47a692b9226bb5af14c1 (DEFAULT_TABLE table=default.Table_f5377c86cbac41cf89ac902aee58a630 [id=c43e096e63ed4f7d8717eef7e4717f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.987390 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1740bfbbb2834abbaf512d05db38aa19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:01.987795 1978 raft_consensus.cc:2749] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:01.987854 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1740bfbbb2834abbaf512d05db38aa19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:01.990202 879 tablet_service.cc:1511] Processing CreateTablet for tablet ab5cd04df830423489b9ff027d7cd5f5 (DEFAULT_TABLE table=default.Table_3a454390260a4bd3a83bf082ce3c43b6 [id=e20bd840c43f47beb6e1f3b3ecc9d2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.991071 1015 tablet_service.cc:1511] Processing CreateTablet for tablet ab5cd04df830423489b9ff027d7cd5f5 (DEFAULT_TABLE table=default.Table_3a454390260a4bd3a83bf082ce3c43b6 [id=e20bd840c43f47beb6e1f3b3ecc9d2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:01.991848 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5cd04df830423489b9ff027d7cd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:01.992254 889 tablet_service.cc:1511] Processing CreateTablet for tablet e36e6f971c5e4929b42bb522e91d4eba (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.000229 1020 tablet_service.cc:1511] Processing CreateTablet for tablet e36e6f971c5e4929b42bb522e91d4eba (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.000588 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36e6f971c5e4929b42bb522e91d4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.001065 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32487ae3bc8d4f6895f892ff9f1e08d4" } modify_external_catalogs: true
I20260503 07:53:02.001264 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32487ae3bc8d4f6895f892ff9f1e08d4" } modify_external_catalogs: true
I20260503 07:53:02.002759 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbca27f54064345b374b0cea96ca1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.003711 884 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee (DEFAULT_TABLE table=default.Table_45c7f14be79c49acbc82c7186b726a53 [id=09badd4799e54e8b82adf3cbff1ffc50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.004618 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.008828 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f3cfc39292764a93a7cbb7c83f11e179
I20260503 07:53:02.009337 595 catalog_manager.cc:6741] ReplaceTablet: tablet f3cfc39292764a93a7cbb7c83f11e179 deleted and replaced by tablet 37cc1d6810594735bf78bd2de7e09755
I20260503 07:53:02.009709 895 tablet_service.cc:1558] Processing DeleteTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 with delete_type TABLET_DATA_DELETED (replaced by tablet 37cc1d6810594735bf78bd2de7e09755) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.010349 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 with delete_type TABLET_DATA_DELETED (replaced by tablet 37cc1d6810594735bf78bd2de7e09755) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.013792 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda1c9b4239240029bac8ee192ef5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.014755 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee (DEFAULT_TABLE table=default.Table_45c7f14be79c49acbc82c7186b726a53 [id=09badd4799e54e8b82adf3cbff1ffc50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.015142 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.016527 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a4cfddb56d47a692b9226bb5af14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.016656 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca06d9ad364a9e8a6f5d2a95009b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.022120 884 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb85af86bc8419885107aaccfeecbe8 (DEFAULT_TABLE table=default.Table_f58999eb7cdc4655bc0919470038f1bd [id=d085710815ae4ffb9747dfd31caf3c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.022481 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb85af86bc8419885107aaccfeecbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.022733 758 tablet_service.cc:1511] Processing CreateTablet for tablet bba8ad1d86a146e2a1e2b7da8974ada1 (DEFAULT_TABLE table=default.Table_e2e01304cac44fcdaa548c6729df2050 [id=008f3d6ea9d740b7aa721c4f4090f295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.023101 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba8ad1d86a146e2a1e2b7da8974ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.023710 760 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.024478 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbca27f54064345b374b0cea96ca1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.024606 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb7486acc6a49dba0295ee26ac68724 with delete_type TABLET_DATA_DELETED (replaced by tablet a09ff2aded174da2b6450cc2b7be28bc) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.025642 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ca0c330e729d4314ae8d312b321992a6
I20260503 07:53:02.026193 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ca0c330e729d4314ae8d312b321992a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.026309 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba8ad1d86a146e2a1e2b7da8974ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.026531 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c5dcc9832845b88577cf987d5e3144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.027061 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet ca0c330e729d4314ae8d312b321992a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.027657 747 tablet_service.cc:1511] Processing CreateTablet for tablet ab5cd04df830423489b9ff027d7cd5f5 (DEFAULT_TABLE table=default.Table_3a454390260a4bd3a83bf082ce3c43b6 [id=e20bd840c43f47beb6e1f3b3ecc9d2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.030601 744 tablet_service.cc:1511] Processing CreateTablet for tablet b437f46d00cb4950aa394df78f9fff19 (DEFAULT_TABLE table=default.Table_fc75b63b6b0640e1a4616681196b67f6 [id=c5320631815a4c04a0bf2bb4d9093661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.030862 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5cd04df830423489b9ff027d7cd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.033366 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 5e2c6d9dd87646ed9d1f86761f13f628 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
W20260503 07:53:02.033943 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet dbd9458716524bdb8658bdef4d73bbac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd9458716524bdb8658bdef4d73bbac already in progress: creating tablet
W20260503 07:53:02.034528 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 3e688661ecdc4ba1b8b8c0867499fe4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e688661ecdc4ba1b8b8c0867499fe4d already in progress: creating tablet
W20260503 07:53:02.035112 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet efeecf8029c8464089a5a64e4457c9c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efeecf8029c8464089a5a64e4457c9c5 already in progress: creating tablet
W20260503 07:53:02.035655 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6eb7486acc6a49dba0295ee26ac68724 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eb7486acc6a49dba0295ee26ac68724 already in progress: creating tablet
W20260503 07:53:02.036237 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f3cfc39292764a93a7cbb7c83f11e179 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cfc39292764a93a7cbb7c83f11e179 already in progress: creating tablet
I20260503 07:53:02.037645 741 tablet_service.cc:1558] Processing DeleteTablet for tablet f3cfc39292764a93a7cbb7c83f11e179 with delete_type TABLET_DATA_DELETED (replaced by tablet 37cc1d6810594735bf78bd2de7e09755) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.037933 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.037969 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5cd04df830423489b9ff027d7cd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.039157 746 tablet_service.cc:1511] Processing CreateTablet for tablet b9c5dcc9832845b88577cf987d5e3144 (DEFAULT_TABLE table=default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.039461 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c5dcc9832845b88577cf987d5e3144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.041062 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36e6f971c5e4929b42bb522e91d4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.041118 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437f46d00cb4950aa394df78f9fff19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.042553 753 tablet_service.cc:1511] Processing CreateTablet for tablet e36e6f971c5e4929b42bb522e91d4eba (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.043164 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36e6f971c5e4929b42bb522e91d4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.046258 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437f46d00cb4950aa394df78f9fff19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:02.046721 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ca0c330e729d4314ae8d312b321992a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca0c330e729d4314ae8d312b321992a6 already in progress: creating tablet
I20260503 07:53:02.048681 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ca0c330e729d4314ae8d312b321992a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.055645 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb85af86bc8419885107aaccfeecbe8 (DEFAULT_TABLE table=default.Table_f58999eb7cdc4655bc0919470038f1bd [id=d085710815ae4ffb9747dfd31caf3c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.056042 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb85af86bc8419885107aaccfeecbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.059095 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 97a4afc318ac4b1e94c48b33f8f9a729 (DEFAULT_TABLE table=default.Table_6f0e040673b44e9a8cb82f7db332d604 [id=9a894d39610f4302980818fa137dc065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.059404 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a4afc318ac4b1e94c48b33f8f9a729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.064988 884 tablet_service.cc:1511] Processing CreateTablet for tablet 97a4afc318ac4b1e94c48b33f8f9a729 (DEFAULT_TABLE table=default.Table_6f0e040673b44e9a8cb82f7db332d604 [id=9a894d39610f4302980818fa137dc065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.066540 1948 raft_consensus.cc:493] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.066704 1948 raft_consensus.cc:515] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.067304 1948 leader_election.cc:290] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.069072 1948 raft_consensus.cc:493] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.069180 1948 raft_consensus.cc:515] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.069635 1948 leader_election.cc:290] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.068217 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ccdf187eb4cae9688ff4929f3e95e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.068254 879 tablet_service.cc:1511] Processing CreateTablet for tablet e3e5be5ce78c4da2a76e819a050d56f4 (DEFAULT_TABLE table=default.Table_e7b94e6fd936496f9e4747169db37800 [id=2a8a57a550134390b5616073b6804082]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:02.072577 988 leader_election.cc:343] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.072748 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e5be5ce78c4da2a76e819a050d56f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.073511 759 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee (DEFAULT_TABLE table=default.Table_45c7f14be79c49acbc82c7186b726a53 [id=09badd4799e54e8b82adf3cbff1ffc50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.074004 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c7ed4e184a0f98cf8952cb76c1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.074476 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 822c15b68f61466584eec0702196a5c5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.077677 1948 raft_consensus.cc:493] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.077805 1948 raft_consensus.cc:515] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.078397 1948 leader_election.cc:290] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:02.079574 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:02.079871 988 consensus_peers.cc:597] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:02.080161 988 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.080981 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 822c15b68f61466584eec0702196a5c5
I20260503 07:53:02.081707 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a4afc318ac4b1e94c48b33f8f9a729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.082542 594 catalog_manager.cc:6741] ReplaceTablet: tablet 822c15b68f61466584eec0702196a5c5 deleted and replaced by tablet 899976aadc9d4ae8be4dc245cfb00cac
I20260503 07:53:02.083920 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3222cedb816c47b4b48e7865fb0fa990"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.084576 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3222cedb816c47b4b48e7865fb0fa990 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.092502 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 822c15b68f61466584eec0702196a5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 899976aadc9d4ae8be4dc245cfb00cac) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.070393 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58deacb99c643d89a6641ef09b026ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.070078 1166 raft_consensus.cc:385] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.083547 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 822c15b68f61466584eec0702196a5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 899976aadc9d4ae8be4dc245cfb00cac) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:02.094012 988 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:02.094061 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 822c15b68f61466584eec0702196a5c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 822c15b68f61466584eec0702196a5c5 already in progress: creating tablet
I20260503 07:53:02.094308 1166 raft_consensus.cc:740] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.094708 1166 consensus_queue.cc:260] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.097501 879 tablet_service.cc:1511] Processing CreateTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.098279 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207707e4ce14e70a6df9578c6bd54b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.097970 1166 ts_tablet_manager.cc:1434] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.134s user 0.015s sys 0.002s
I20260503 07:53:02.100440 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e3e5be5ce78c4da2a76e819a050d56f4 (DEFAULT_TABLE table=default.Table_e7b94e6fd936496f9e4747169db37800 [id=2a8a57a550134390b5616073b6804082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.100885 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e5be5ce78c4da2a76e819a050d56f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.101263 1166 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.100502 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.103085 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207707e4ce14e70a6df9578c6bd54b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.106581 1166 tablet_bootstrap.cc:654] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.117843 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f5731f3196e2486597f0b6c4f0855c20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.118089 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d148d37a79a1439b98b2caa0f672c96f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.118209 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_32a0cef7755c4b14b4b97855b791b883"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.118517 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d148d37a79a1439b98b2caa0f672c96f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.118643 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c67ae44b27fa46c4b568beb02732c1eb" } modify_external_catalogs: true
I20260503 07:53:02.119128 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c67ae44b27fa46c4b568beb02732c1eb" } modify_external_catalogs: true
I20260503 07:53:02.119704 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d05882184ada46ecbcceeb86e6c4862b" } new_table_name: "default.Table_25a7649dbedf42b78ea9fcb629b4daf3" modify_external_catalogs: true
I20260503 07:53:02.120582 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_63d40973d4274e249dabcfbeb69433aa" } modify_external_catalogs: true
I20260503 07:53:02.120622 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_accdb92d0ffc47e38205a2ec05b71df5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.121281 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32a0cef7755c4b14b4b97855b791b883 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.121517 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_63d40973d4274e249dabcfbeb69433aa" } modify_external_catalogs: true
W20260503 07:53:02.123296 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_accdb92d0ffc47e38205a2ec05b71df5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:02.123816 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5731f3196e2486597f0b6c4f0855c20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.125190 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_71e1d22f05b440089329a58f532fa712" } new_table_name: "default.Table_549762b2162d47ac9e5f217fafbdf632" modify_external_catalogs: true
I20260503 07:53:02.126109 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d86e37b23cee4cec9605969951db1bd3" } modify_external_catalogs: true
I20260503 07:53:02.126278 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d86e37b23cee4cec9605969951db1bd3" } modify_external_catalogs: true
I20260503 07:53:02.131537 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b5f31f37e97345bb9187865e38ee1d61
I20260503 07:53:02.132153 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:02.132365 778 raft_consensus.cc:2468] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:02.133001 986 leader_election.cc:343] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 568ccdf187eb4cae9688ff4929f3e95e
I20260503 07:53:02.133173 986 leader_election.cc:304] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.133697 1948 raft_consensus.cc:2749] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.136066 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 057b62a991b74c859045a74df7dc716f from {username='slave'} at 127.0.0.1:44308
W20260503 07:53:02.136801 986 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:02.136911 1166 tablet_bootstrap.cc:492] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.136898 986 leader_election.cc:304] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.137024 1166 ts_tablet_manager.cc:1403] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.007s
I20260503 07:53:02.137079 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3efaa3d37a9d40288239aa540e6b44d6" } modify_external_catalogs: true
I20260503 07:53:02.137214 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3efaa3d37a9d40288239aa540e6b44d6" } modify_external_catalogs: true
I20260503 07:53:02.137307 1948 raft_consensus.cc:2749] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.137691 1166 raft_consensus.cc:359] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.137857 1166 raft_consensus.cc:385] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.137907 1166 raft_consensus.cc:740] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.138113 1166 consensus_queue.cc:260] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.139917 1166 ts_tablet_manager.cc:1434] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:53:02.140187 1166 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.144912 1166 tablet_bootstrap.cc:654] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.147221 754 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb85af86bc8419885107aaccfeecbe8 (DEFAULT_TABLE table=default.Table_f58999eb7cdc4655bc0919470038f1bd [id=d085710815ae4ffb9747dfd31caf3c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.150346 1166 tablet_bootstrap.cc:492] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.150485 1166 ts_tablet_manager.cc:1403] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260503 07:53:02.151171 1166 raft_consensus.cc:359] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.151345 1166 raft_consensus.cc:385] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.151403 1166 raft_consensus.cc:740] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.151602 1166 consensus_queue.cc:260] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.152218 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2f58c734c20e4da180b30b1fbc3f2031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.152702 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f58c734c20e4da180b30b1fbc3f2031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.155890 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1740bfbbb2834abbaf512d05db38aa19" } new_table_name: "default.Table_11bde1b76bf54bf19be5e9f545931bf5" modify_external_catalogs: true
I20260503 07:53:02.156035 1166 ts_tablet_manager.cc:1434] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:02.156778 1166 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.159716 1166 tablet_bootstrap.cc:654] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.148483 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 822c15b68f61466584eec0702196a5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 899976aadc9d4ae8be4dc245cfb00cac) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.150467 753 tablet_service.cc:1511] Processing CreateTablet for tablet 97a4afc318ac4b1e94c48b33f8f9a729 (DEFAULT_TABLE table=default.Table_6f0e040673b44e9a8cb82f7db332d604 [id=9a894d39610f4302980818fa137dc065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.167428 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a4afc318ac4b1e94c48b33f8f9a729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.171222 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb85af86bc8419885107aaccfeecbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.171530 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7bab3c5163f04dc3b37396189dacdc63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.171939 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9833d3b3bf174720b5da54e19ae8e015 consensus state has no leader
W20260503 07:53:02.172021 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bab3c5163f04dc3b37396189dacdc63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.172272 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_24dec90bc24e4a8a9103832658dfcfcf" } new_table_name: "default.Table_b78cbc86f75049a9bd25f88deb484788" modify_external_catalogs: true
I20260503 07:53:02.173005 889 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0f650d2efd4a5d9308952b32fa7d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.173194 1173 tablet_replica.cc:333] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.173352 1173 raft_consensus.cc:2243] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.173465 1173 raft_consensus.cc:2272] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.175882 917 raft_consensus.cc:3060] T 3be42428a60142ca99f48e592a29070f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.176535 1173 ts_tablet_manager.cc:1916] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:02.179352 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efbf07a603be411895839aece99fa78c consensus state has no leader
I20260503 07:53:02.179596 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d451c0ddf9b44a208ecac7810971318d" } new_table_name: "default.Table_83b7af1a01fb4958b0293eb03c96b091" modify_external_catalogs: true
I20260503 07:53:02.179790 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f1f86609fc7b4007ab4c730002918613
I20260503 07:53:02.180359 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 18523493ee4841cb8949826239e2e458
I20260503 07:53:02.181185 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:02.183702 1173 ts_tablet_manager.cc:1929] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.183892 1173 log.cc:1199] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/bf0f650d2efd4a5d9308952b32fa7d63
I20260503 07:53:02.184449 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.184514 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.184449 889 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f86609fc7b4007ab4c730002918613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.184846 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 057b62a991b74c859045a74df7dc716f
I20260503 07:53:02.184335 1173 ts_tablet_manager.cc:1950] T bf0f650d2efd4a5d9308952b32fa7d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.185314 601 catalog_manager.cc:6741] ReplaceTablet: tablet 057b62a991b74c859045a74df7dc716f deleted and replaced by tablet 6840aeb0532c43738cb868a0fc48f70c
I20260503 07:53:02.185573 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.185545 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f86609fc7b4007ab4c730002918613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.185847 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.185885 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet bf0f650d2efd4a5d9308952b32fa7d63 (table default.Table_a32643442a2541d585cec3f44840509c [id=7f8470e7e307465b8eb6fa6b1b5bf94f]) successfully deleted
I20260503 07:53:02.186376 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.186520 1173 tablet_replica.cc:333] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.185883 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:02.186787 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ecc39d127c71412ea867a0b3cad10452 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecc39d127c71412ea867a0b3cad10452 already in progress: creating tablet
I20260503 07:53:02.186808 1173 raft_consensus.cc:2243] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.186968 1173 raft_consensus.cc:2272] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:02.186995 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 18523493ee4841cb8949826239e2e458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18523493ee4841cb8949826239e2e458 already in progress: creating tablet
I20260503 07:53:02.187776 1173 ts_tablet_manager.cc:1916] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.189709 918 raft_consensus.cc:3060] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.193238 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_838891067c3b4d54a5e0f2f6cdd18aca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.193976 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_838891067c3b4d54a5e0f2f6cdd18aca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.194100 1173 ts_tablet_manager.cc:1929] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260503 07:53:02.194196 1173 log.cc:1199] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f1f86609fc7b4007ab4c730002918613
I20260503 07:53:02.195576 1166 tablet_bootstrap.cc:492] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.193239 594 master_service.cc:954] ReplaceTablet: received request to replace tablet e19d7eab61e24e18a1e4eb600e9d592a from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.195690 1166 ts_tablet_manager.cc:1403] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.001s
I20260503 07:53:02.196345 1166 raft_consensus.cc:359] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.196491 1166 raft_consensus.cc:385] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.196671 894 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96ba84739c45b7847f0c43ab4a08e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.200698 879 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.201745 1173 ts_tablet_manager.cc:1950] T f1f86609fc7b4007ab4c730002918613 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.202667 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]) successfully deleted
W20260503 07:53:02.203316 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 057b62a991b74c859045a74df7dc716f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 057b62a991b74c859045a74df7dc716f already in progress: creating tablet
I20260503 07:53:02.203840 1173 tablet_replica.cc:333] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.160385 747 tablet_service.cc:1511] Processing CreateTablet for tablet e3e5be5ce78c4da2a76e819a050d56f4 (DEFAULT_TABLE table=default.Table_e7b94e6fd936496f9e4747169db37800 [id=2a8a57a550134390b5616073b6804082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.165314 745 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.152233 1165 tablet_bootstrap.cc:654] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:02.208439 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet f9e78eb6d2a3489dbb15806dd93867a4 (table default.Table_af4a886426b247b7ae33063090adeea5 [id=3fb3c0ecf0204981854c6a492a3b36a3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f9e78eb6d2a3489dbb15806dd93867a4 consensus state has no leader
I20260503 07:53:02.210394 1173 raft_consensus.cc:2243] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.210834 1173 raft_consensus.cc:2272] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.199170 1166 raft_consensus.cc:740] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.212667 1166 consensus_queue.cc:260] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.215178 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
W20260503 07:53:02.216001 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57dd3c136b364aee91a733132d4caef5 has no consensus state
I20260503 07:53:02.217579 1173 ts_tablet_manager.cc:1916] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.219806 1166 ts_tablet_manager.cc:1434] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260503 07:53:02.220054 1166 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.227654 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_417eac5b97e84183ba5bd85c32593d95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.227710 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_68406bd365a8436db1ba7c29c23aa199"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.228672 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5d8b2c631087445188d01c39291fb9a3" } modify_external_catalogs: true
I20260503 07:53:02.228843 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5d8b2c631087445188d01c39291fb9a3" } modify_external_catalogs: true
W20260503 07:53:02.229081 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68406bd365a8436db1ba7c29c23aa199 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:02.229725 714 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 68629.6us
I20260503 07:53:02.230186 986 leader_election.cc:304] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.230530 1948 raft_consensus.cc:2804] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:02.230604 1948 raft_consensus.cc:493] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:02.230669 1948 raft_consensus.cc:3060] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.231185 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.232060 1173 ts_tablet_manager.cc:1929] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.232218 1173 log.cc:1199] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/bb96ba84739c45b7847f0c43ab4a08e7
I20260503 07:53:02.232550 1173 ts_tablet_manager.cc:1950] T bb96ba84739c45b7847f0c43ab4a08e7 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.233291 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet bb96ba84739c45b7847f0c43ab4a08e7 (table default.Table_cb0d3dedda9548889d35745848bf96df [id=80cec7d9da0a482e9ad9e0b2798e5c58]) successfully deleted
I20260503 07:53:02.233367 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
W20260503 07:53:02.233536 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b5f31f37e97345bb9187865e38ee1d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f31f37e97345bb9187865e38ee1d61 already in progress: creating tablet
I20260503 07:53:02.233626 1166 tablet_bootstrap.cc:654] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.233786 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.234232 744 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.234753 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.235080 1952 raft_consensus.cc:493] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.235219 1952 raft_consensus.cc:515] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.235778 1952 leader_election.cc:290] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:02.235843 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_417eac5b97e84183ba5bd85c32593d95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.236117 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f86609fc7b4007ab4c730002918613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.236544 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e5be5ce78c4da2a76e819a050d56f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:02.237260 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f77cc1370a434961ae9138cbb8c39d7b consensus state has no leader
I20260503 07:53:02.241449 1948 raft_consensus.cc:515] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.242146 1948 leader_election.cc:290] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:02.245965 1948 raft_consensus.cc:493] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.246135 1948 raft_consensus.cc:515] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.246835 1948 leader_election.cc:290] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.188088 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 618) took 1037 ms. Trace:
I20260503 07:53:02.194289 1978 raft_consensus.cc:493] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.247227 1978 raft_consensus.cc:515] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.248214 1978 leader_election.cc:290] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:02.248708 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:02.249311 716 leader_election.cc:343] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.249509 1174 rpcz_store.cc:276] 0503 07:53:01.150393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.150470 (+ 77us) service_pool.cc:224] Handling call
0503 07:53:01.503173 (+352703us) ts_tablet_manager.cc:1151] Deleting tablet 568ccdf187eb4cae9688ff4929f3e95e
0503 07:53:01.503186 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:01.625590 (+122404us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:01.669748 (+ 44158us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.188029 (+518281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":350338}
I20260503 07:53:02.249959 1174 tablet_replica.cc:333] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.249913 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.250208 1174 raft_consensus.cc:2243] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.250375 1174 raft_consensus.cc:2272] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:02.250469 715 leader_election.cc:343] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.250563 715 leader_election.cc:304] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.251641 1978 raft_consensus.cc:2749] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.257573 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaeda1a5d6d436292cd1688f8a4d467" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.258160 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:02.258606 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:02.259014 988 consensus_peers.cc:597] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:02.259141 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a09ff2aded174da2b6450cc2b7be28bc has no consensus state
W20260503 07:53:02.259421 988 leader_election.cc:343] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:02.259794 988 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:02.260102 988 leader_election.cc:343] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.260977 1175 ts_tablet_manager.cc:1929] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.261190 1175 log.cc:1199] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d79067c0c8594d50aa458d47b31d99af
I20260503 07:53:02.263720 1166 tablet_bootstrap.cc:492] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.263855 1166 ts_tablet_manager.cc:1403] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260503 07:53:02.264494 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.264662 1166 raft_consensus.cc:359] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.264843 1166 raft_consensus.cc:385] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.264917 1166 raft_consensus.cc:740] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.265204 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207707e4ce14e70a6df9578c6bd54b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.265127 1166 consensus_queue.cc:260] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.265573 1166 ts_tablet_manager.cc:1434] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:02.265838 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e19d7eab61e24e18a1e4eb600e9d592a
I20260503 07:53:02.265879 1166 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.266279 594 catalog_manager.cc:6741] ReplaceTablet: tablet e19d7eab61e24e18a1e4eb600e9d592a deleted and replaced by tablet 86d052abe9234579b450cc6e92b6ddf6
I20260503 07:53:02.267444 1166 tablet_bootstrap.cc:654] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.270809 594 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 766799446d1a480ca04246b0aec14852 (table default.Table_7eea345022f4468c978d09942e1140f2 [id=c9513d6e491a4250894ed7225db630fe]). Expected version 1 got 0
I20260503 07:53:02.274261 594 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 766799446d1a480ca04246b0aec14852 (table default.Table_7eea345022f4468c978d09942e1140f2 [id=c9513d6e491a4250894ed7225db630fe]). Expected version 1 got 0
I20260503 07:53:02.275048 879 tablet_service.cc:1558] Processing DeleteTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a with delete_type TABLET_DATA_DELETED (replaced by tablet 86d052abe9234579b450cc6e92b6ddf6) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.275080 1165 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.275215 1165 ts_tablet_manager.cc:1403] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.299s user 0.002s sys 0.002s
W20260503 07:53:02.275591 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e19d7eab61e24e18a1e4eb600e9d592a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19d7eab61e24e18a1e4eb600e9d592a already in progress: creating tablet
I20260503 07:53:02.275964 884 tablet_service.cc:1558] Processing DeleteTablet for tablet dda159becff6466abdcd84193f40a65e with delete_type TABLET_DATA_DELETED (replaced by tablet 16ea29e3b4a84735bb3723dd11449ec3) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.276103 1165 raft_consensus.cc:359] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.276254 1173 tablet_replica.cc:333] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.276298 1165 raft_consensus.cc:385] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.276346 1165 raft_consensus.cc:740] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.276458 1173 raft_consensus.cc:2243] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.276618 1173 raft_consensus.cc:2272] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.277272 1173 ts_tablet_manager.cc:1916] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.278374 1165 consensus_queue.cc:260] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.279672 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 568ccdf187eb4cae9688ff4929f3e95e (table default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]) successfully deleted
I20260503 07:53:02.282737 1166 tablet_bootstrap.cc:492] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.282883 1166 ts_tablet_manager.cc:1403] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260503 07:53:02.283452 1173 ts_tablet_manager.cc:1929] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.283528 1166 raft_consensus.cc:359] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.283715 1166 raft_consensus.cc:385] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.283815 1166 raft_consensus.cc:740] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.284024 1166 consensus_queue.cc:260] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.284509 1166 ts_tablet_manager.cc:1434] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:02.283627 1173 log.cc:1199] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/dda159becff6466abdcd84193f40a65e
I20260503 07:53:02.284866 1173 ts_tablet_manager.cc:1950] T dda159becff6466abdcd84193f40a65e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.285313 1166 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.288676 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 61316b7a521e42a59bf955179b080f40
I20260503 07:53:02.289582 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.291082 1166 tablet_bootstrap.cc:654] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.292392 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f539af5e44f048ff42619fcda1943" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:02.292574 778 raft_consensus.cc:3060] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.292711 750 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.293268 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet dda159becff6466abdcd84193f40a65e (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:53:02.293632 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a with delete_type TABLET_DATA_DELETED (replaced by tablet 86d052abe9234579b450cc6e92b6ddf6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.293645 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:02.293867 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 61316b7a521e42a59bf955179b080f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61316b7a521e42a59bf955179b080f40 already in progress: creating tablet
I20260503 07:53:02.295111 778 raft_consensus.cc:2468] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:02.295466 1175 ts_tablet_manager.cc:1950] T d79067c0c8594d50aa458d47b31d99af P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:02.295730 1174 ts_tablet_manager.cc:1916] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.297443 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d79067c0c8594d50aa458d47b31d99af (table default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]) successfully deleted
I20260503 07:53:02.297817 1175 tablet_replica.cc:333] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:02.298170 1175 raft_consensus.cc:2243] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.298364 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b79b96b9ab1542e48bd33c363698ae1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.298467 1175 raft_consensus.cc:2272] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:02.298986 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b79b96b9ab1542e48bd33c363698ae1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.299705 1175 ts_tablet_manager.cc:1916] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.300336 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e19d7eab61e24e18a1e4eb600e9d592a with delete_type TABLET_DATA_DELETED (replaced by tablet 86d052abe9234579b450cc6e92b6ddf6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.301261 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:02.301442 777 raft_consensus.cc:2468] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:02.302080 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da9549389254875b94268abc5c3bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.302627 1173 tablet_replica.cc:333] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.303018 1173 raft_consensus.cc:2243] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.303332 1173 raft_consensus.cc:2272] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:02.303889 986 leader_election.cc:343] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:02.304000 986 leader_election.cc:304] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.304473 1948 raft_consensus.cc:2749] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.304493 1173 ts_tablet_manager.cc:1916] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.304911 986 leader_election.cc:304] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.305362 1948 raft_consensus.cc:2804] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:02.305470 1948 raft_consensus.cc:697] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:02.305688 1948 consensus_queue.cc:237] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.310828 2076 log.cc:826] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Log is configured to *not* fsync() on all Append() calls
I20260503 07:53:02.311148 1165 ts_tablet_manager.cc:1434] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260503 07:53:02.311676 1171 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.311887 1171 ts_tablet_manager.cc:1403] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.351s user 0.013s sys 0.024s
I20260503 07:53:02.313181 1171 raft_consensus.cc:359] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.313453 1171 raft_consensus.cc:385] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.313570 1171 raft_consensus.cc:740] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.313927 1171 consensus_queue.cc:260] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.314910 1171 ts_tablet_manager.cc:1434] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:02.321089 1165 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.333377 1171 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.333520 1963 raft_consensus.cc:493] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.333972 1963 raft_consensus.cc:515] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.335377 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5fbac7e007964bb097d813068a2f5769" } modify_external_catalogs: true
I20260503 07:53:02.335597 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5fbac7e007964bb097d813068a2f5769" } modify_external_catalogs: true
I20260503 07:53:02.337723 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.341274 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:02.341849 988 leader_election.cc:343] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.344144 1165 tablet_bootstrap.cc:654] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.344393 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet aa9153d3245f4dcfacf26f174bced2ba
I20260503 07:53:02.345697 1173 ts_tablet_manager.cc:1929] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.346673 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet aa9153d3245f4dcfacf26f174bced2ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.334870 1171 tablet_bootstrap.cc:654] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.336501 986 leader_election.cc:304] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.357566 2113 raft_consensus.cc:2804] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:02.357731 2113 raft_consensus.cc:493] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:02.357663 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_259dfd3e0f54418c84a01d011786ebdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.346999 884 tablet_service.cc:1558] Processing DeleteTablet for tablet aa9153d3245f4dcfacf26f174bced2ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.358259 2113 raft_consensus.cc:3060] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:02.358249 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_259dfd3e0f54418c84a01d011786ebdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.358246 1173 log.cc:1199] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/3da9549389254875b94268abc5c3bb3e
I20260503 07:53:02.358613 1173 ts_tablet_manager.cc:1950] T 3da9549389254875b94268abc5c3bb3e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.360222 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 3da9549389254875b94268abc5c3bb3e (table default.Table_9a0af138fe05419dabb84e78f58b3849 [id=9fb387b27c1d4259881fc2460de7370a]) successfully deleted
I20260503 07:53:02.360641 1173 tablet_replica.cc:333] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.362782 1978 raft_consensus.cc:493] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.362978 1978 raft_consensus.cc:515] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.363687 1978 leader_election.cc:290] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:02.364595 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ea29e3b4a84735bb3723dd11449ec3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.365036 1166 tablet_bootstrap.cc:492] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.365171 1166 ts_tablet_manager.cc:1403] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.080s user 0.007s sys 0.024s
W20260503 07:53:02.365899 715 leader_election.cc:343] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.365909 1166 raft_consensus.cc:359] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.365846 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e05a268800c741258262ebbef730615c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.366060 1166 raft_consensus.cc:385] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.366133 1166 raft_consensus.cc:740] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.366387 1173 raft_consensus.cc:2243] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:02.366415 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e05a268800c741258262ebbef730615c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.366439 1166 consensus_queue.cc:260] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.366662 1173 raft_consensus.cc:2272] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.367108 1166 ts_tablet_manager.cc:1434] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.368083 1173 ts_tablet_manager.cc:1916] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.368336 2113 raft_consensus.cc:515] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.370072 2113 leader_election.cc:290] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.378247 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c07d1c22bddc4542a2548c783107cd3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.378901 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c07d1c22bddc4542a2548c783107cd3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.384675 1963 leader_election.cc:290] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.387532 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:02.387692 779 raft_consensus.cc:3060] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.390722 779 raft_consensus.cc:2468] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:02.391011 753 tablet_service.cc:1558] Processing DeleteTablet for tablet aa9153d3245f4dcfacf26f174bced2ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.391016 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89860f4b2acb4f3b845ca047709f84af" } modify_external_catalogs: true
I20260503 07:53:02.391211 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89860f4b2acb4f3b845ca047709f84af" } modify_external_catalogs: true
I20260503 07:53:02.391685 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e7b94e6fd936496f9e4747169db37800" } new_table_name: "default.Table_79153d9f56f84e01937636fc78074f46" modify_external_catalogs: true
I20260503 07:53:02.392925 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9ae6c84f1a8340a9858fbed22de8d5bf" } modify_external_catalogs: true
I20260503 07:53:02.393092 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9ae6c84f1a8340a9858fbed22de8d5bf" } modify_external_catalogs: true
I20260503 07:53:02.395139 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_db4eb84f6f264f13b5921eb799ae104b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.395635 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db4eb84f6f264f13b5921eb799ae104b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.396766 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e50e303a9124c588bb671f5ca64a04c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.397249 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e50e303a9124c588bb671f5ca64a04c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.402133 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c75f9f01238b4ea58157bb094224d6c0" } modify_external_catalogs: true
I20260503 07:53:02.402364 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c75f9f01238b4ea58157bb094224d6c0" } modify_external_catalogs: true
I20260503 07:53:02.402915 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11378258563d415586230d101efb0247" } new_table_name: "default.Table_c081581d0e69483a9c4fdc42e9abec77" modify_external_catalogs: true
W20260503 07:53:02.409622 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3e5be5ce78c4da2a76e819a050d56f4 consensus state has no leader
I20260503 07:53:02.411671 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 08d7b172bb1d4ad1ba81e08748db4ae2 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.419209 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e8f4280c32e84d2e88e8941066dae78d" } new_table_name: "default.Table_66b153f206f74219a6cd3b0b8ecfa6be" modify_external_catalogs: true
I20260503 07:53:02.423509 1963 raft_consensus.cc:493] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.423672 1963 raft_consensus.cc:515] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:02.424561 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79d43ae066e6411896c490f7c0b11180 consensus state has no leader
I20260503 07:53:02.425015 986 leader_election.cc:304] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:02.425247 2113 consensus_queue.cc:1048] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:02.425422 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:02.425597 779 raft_consensus.cc:2468] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:02.425626 2113 raft_consensus.cc:2804] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:02.425719 2113 raft_consensus.cc:697] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:02.425927 2113 consensus_queue.cc:237] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.428035 1963 leader_election.cc:290] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:02.430009 757 consensus_meta.cc:287] T 7ac9db54171c456ca30c0cc65984d36c P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.712s user 0.016s sys 0.001s
I20260503 07:53:02.430461 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_01432a8a7eac48f3b2d392e5ee734b0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.430902 1171 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.431152 1171 ts_tablet_manager.cc:1403] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.002s
W20260503 07:53:02.431398 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01432a8a7eac48f3b2d392e5ee734b0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.431843 1171 raft_consensus.cc:359] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.431996 1171 raft_consensus.cc:385] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.432068 1171 raft_consensus.cc:740] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.432307 1171 consensus_queue.cc:260] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.432773 1171 ts_tablet_manager.cc:1434] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:02.433022 1171 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.436404 2109 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:02.437529 2110 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:02.441433 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e73cb801493e4ec7a2c8914854e5d9f7" } new_table_name: "default.Table_1e5903e6c78e49cdb24528dcdd8ec0ea" modify_external_catalogs: true
W20260503 07:53:02.448100 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31864ef969e94f5e9e9a7987ed88feb6 consensus state has no leader
I20260503 07:53:02.369088 1166 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.449826 1166 tablet_bootstrap.cc:654] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.370456 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0c0f5999ee4b9cae56cbb3695de12f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:02.375324 884 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2b065666ec4f1299b47d45cd1f600b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.424640 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f99c7855a4485b3523b68b0ea24c1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:02.451025 988 leader_election.cc:343] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:02.452116 988 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.452589 986 leader_election.cc:304] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.453043 2113 raft_consensus.cc:2804] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:02.453114 2113 raft_consensus.cc:493] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:02.453186 2113 raft_consensus.cc:3060] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.455672 2113 raft_consensus.cc:515] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.456414 2113 leader_election.cc:290] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.456683 1174 ts_tablet_manager.cc:1929] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:02.456833 1174 log.cc:1199] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/7b4116cc31d640ac826520b41d7d3cf9
I20260503 07:53:02.457226 1174 ts_tablet_manager.cc:1950] T 7b4116cc31d640ac826520b41d7d3cf9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:02.459117 986 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:02.459219 986 leader_election.cc:304] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.459364 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ea29e3b4a84735bb3723dd11449ec3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:02.459379 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:02.459724 2113 raft_consensus.cc:2749] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:02.459859 716 leader_election.cc:343] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.459967 716 leader_election.cc:304] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.460319 1983 raft_consensus.cc:2749] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:02.460637 988 consensus_peers.cc:597] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:02.460799 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_00bf13f51cb2470783a5ec5fd0300ab5" } new_table_name: "default.Table_977aca95114346c5b14b665778f89be6" modify_external_catalogs: true
W20260503 07:53:02.460865 988 leader_election.cc:343] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.461452 1166 tablet_bootstrap.cc:492] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.461635 1166 ts_tablet_manager.cc:1403] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.000s
I20260503 07:53:02.463142 1166 raft_consensus.cc:359] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.463357 1166 raft_consensus.cc:385] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.463433 1166 raft_consensus.cc:740] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.463642 1166 consensus_queue.cc:260] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.464326 1166 ts_tablet_manager.cc:1434] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260503 07:53:02.464720 1166 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.469601 884 tablet_service.cc:1558] Processing DeleteTablet for tablet cda8280b97254d1aaf3803f6b5cd223c with delete_type TABLET_DATA_DELETED (replaced by tablet 961d0f8f6daa4f359c15743ee42b9a87) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.472869 2082 raft_consensus.cc:493] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.472995 2082 raft_consensus.cc:515] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.473532 2082 leader_election.cc:290] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.475957 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_41724e04367244b7b2e7d8c8d588c497"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.476590 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41724e04367244b7b2e7d8c8d588c497 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:02.479084 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0e9349f195a406083c9a7e1432f1237 consensus state has no leader
I20260503 07:53:02.481032 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:02.481961 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f45941fd2c94161b5438fe65f858b95" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:02.482167 776 raft_consensus.cc:3060] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.482966 1166 tablet_bootstrap.cc:654] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.485188 776 raft_consensus.cc:2468] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:02.485854 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:02.487408 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f6e42e25b016431f818e2d8fd9d3c5ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.487881 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6e42e25b016431f818e2d8fd9d3c5ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.489588 1165 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.490036 1165 ts_tablet_manager.cc:1403] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.169s user 0.003s sys 0.000s
I20260503 07:53:02.490832 1165 raft_consensus.cc:359] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.491106 1165 raft_consensus.cc:385] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.491204 1165 raft_consensus.cc:740] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.491508 1165 consensus_queue.cc:260] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.492419 1165 ts_tablet_manager.cc:1434] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.493002 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766799446d1a480ca04246b0aec14852" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:02.493539 851 leader_election.cc:304] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.493960 2082 raft_consensus.cc:2749] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.494665 594 master_service.cc:954] ReplaceTablet: received request to replace tablet f4fd9524157c4225885a1f1831982faa from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.494872 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 620) took 1299 ms. Trace:
I20260503 07:53:02.495004 1174 rpcz_store.cc:276] 0503 07:53:01.195208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.195263 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:02.249911 (+1054648us) ts_tablet_manager.cc:1151] Deleting tablet 7b4116cc31d640ac826520b41d7d3cf9
0503 07:53:02.249922 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.343733 (+ 93811us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.456637 (+112904us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.494854 (+ 38217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054457}
I20260503 07:53:02.495510 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 623) took 1087 ms. Trace:
I20260503 07:53:02.495633 1174 rpcz_store.cc:276] 0503 07:53:01.408309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.408370 (+ 61us) service_pool.cc:224] Handling call
0503 07:53:02.495403 (+1087033us) ts_tablet_manager.cc:1151] Deleting tablet 23a4cfddb56d47a692b9226bb5af14c1
0503 07:53:02.495413 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.495495 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1082614}
I20260503 07:53:02.496008 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 624) took 1061 ms. Trace:
I20260503 07:53:02.496134 1174 rpcz_store.cc:276] 0503 07:53:01.434559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.434605 (+ 46us) service_pool.cc:224] Handling call
0503 07:53:02.495914 (+1061309us) ts_tablet_manager.cc:1151] Deleting tablet 56f1c40961284bf0848c93ed6a09b111
0503 07:53:02.495924 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.495995 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061136}
I20260503 07:53:02.496532 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 625) took 1008 ms. Trace:
I20260503 07:53:02.496644 1174 rpcz_store.cc:276] 0503 07:53:01.487749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.487818 (+ 69us) service_pool.cc:224] Handling call
0503 07:53:02.496442 (+1008624us) ts_tablet_manager.cc:1151] Deleting tablet 56f1c40961284bf0848c93ed6a09b111
0503 07:53:02.496450 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.496517 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1008435}
I20260503 07:53:02.496933 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cdb84a65114d4a77be0516c1fbdeb6be" } modify_external_catalogs: true
I20260503 07:53:02.496978 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 626) took 1005 ms. Trace:
I20260503 07:53:02.497133 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cdb84a65114d4a77be0516c1fbdeb6be" } modify_external_catalogs: true
I20260503 07:53:02.497141 1174 rpcz_store.cc:276] 0503 07:53:01.491186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.491234 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:02.496889 (+1005655us) ts_tablet_manager.cc:1151] Deleting tablet 23a4cfddb56d47a692b9226bb5af14c1
0503 07:53:02.496897 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.496964 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1005498}
I20260503 07:53:02.502024 2082 raft_consensus.cc:493] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.502156 2082 raft_consensus.cc:515] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.502655 2082 leader_election.cc:290] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:02.502766 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 08d7b172bb1d4ad1ba81e08748db4ae2
I20260503 07:53:02.503326 599 catalog_manager.cc:6741] ReplaceTablet: tablet 08d7b172bb1d4ad1ba81e08748db4ae2 deleted and replaced by tablet baf176bdc6d54088846ee5eaf5e61447
W20260503 07:53:02.503979 854 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:53:02.504248 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet baf176bdc6d54088846ee5eaf5e61447) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:02.504578 851 leader_election.cc:343] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: fe2b065666ec4f1299b47d45cd1f600b
I20260503 07:53:02.504696 851 leader_election.cc:304] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:02.504984 2082 raft_consensus.cc:2749] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.505129 1166 tablet_bootstrap.cc:492] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.505333 1166 ts_tablet_manager.cc:1403] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.000s
I20260503 07:53:02.505298 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet baf176bdc6d54088846ee5eaf5e61447) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.506207 1166 raft_consensus.cc:359] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.506426 1166 raft_consensus.cc:385] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.506551 1166 raft_consensus.cc:740] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.506845 1166 consensus_queue.cc:260] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.507040 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 388c63dc20da408ca3e141ada0200be6 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.507472 1166 ts_tablet_manager.cc:1434] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:02.507835 1166 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.509918 1166 tablet_bootstrap.cc:654] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.510800 596 catalog_manager.cc:5671] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:02.511389 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 7b4116cc31d640ac826520b41d7d3cf9 (table default.Table_4f4045fcdcb741b6b5d95f46965d854a [id=c26dfdfa353040f69adc8d6123962647]) successfully deleted
W20260503 07:53:02.511703 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23a4cfddb56d47a692b9226bb5af14c1 already in progress: creating tablet
I20260503 07:53:02.515738 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 67387c8aba1f4d728b3691c5da720e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.516116 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4248601c3f624bd8ba822648871feb03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.516415 1171 tablet_bootstrap.cc:654] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:02.516691 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4248601c3f624bd8ba822648871feb03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.517561 986 leader_election.cc:304] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.517989 1952 raft_consensus.cc:2804] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:02.518281 1952 raft_consensus.cc:697] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:02.518576 1952 consensus_queue.cc:237] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.501734 2110 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:02.524888 988 consensus_peers.cc:597] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:02.481696 2109 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:02.526976 1165 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.528452 1174 tablet_replica.cc:333] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.528822 1174 raft_consensus.cc:2243] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.529065 1174 raft_consensus.cc:2272] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.531430 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9bf17cb5fa4646b29781ef58efff2450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.532029 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bf17cb5fa4646b29781ef58efff2450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:02.534220 588 catalog_manager.cc:5075] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): alter failed for tablet b0655ef28c1d4326b2f462ab6fd8d604 (table default.Table_f600236ddc034f64ab9796c1fc5831d6 [id=b74f4a35df2a48b0b0460cf5290b374a]),no further retry: Not found: Tablet not found: b0655ef28c1d4326b2f462ab6fd8d604
I20260503 07:53:02.535496 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:02.536037 1173 ts_tablet_manager.cc:1929] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:02.542794 1174 ts_tablet_manager.cc:1916] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.549784 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80720e11ba684edfa953a24b59778ead" } modify_external_catalogs: true
I20260503 07:53:02.550117 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80720e11ba684edfa953a24b59778ead" } modify_external_catalogs: true
I20260503 07:53:02.558449 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f1aeea6b4ead45ef82934811494cf263
I20260503 07:53:02.559553 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet f1aeea6b4ead45ef82934811494cf263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.565918 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6da5a4c519a249ca90c466eab47aa00b
I20260503 07:53:02.567090 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da5a4c519a249ca90c466eab47aa00b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.573117 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d23e2aa8107a4c61a4925d15108a821d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.573777 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 77fa106f0cc24a35bd23b457660a45dc from {username='slave'} at 127.0.0.1:44308
W20260503 07:53:02.575052 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d23e2aa8107a4c61a4925d15108a821d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.575659 1165 tablet_bootstrap.cc:654] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.579209 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_709c32e6c48c4f3cac8a32c47d3c8db9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.579703 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_709c32e6c48c4f3cac8a32c47d3c8db9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.549793 1166 tablet_bootstrap.cc:492] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.561389 884 tablet_service.cc:1558] Processing DeleteTablet for tablet f1aeea6b4ead45ef82934811494cf263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.580291 1173 log.cc:1199] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/aa9153d3245f4dcfacf26f174bced2ba
I20260503 07:53:02.566624 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da5a4c519a249ca90c466eab47aa00b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.580374 1166 ts_tablet_manager.cc:1403] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.004s
I20260503 07:53:02.580942 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 773fca453dac452abc723e49b70111b9 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:02.581125 1173 ts_tablet_manager.cc:1950] T aa9153d3245f4dcfacf26f174bced2ba P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.581240 1166 raft_consensus.cc:359] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.581419 1166 raft_consensus.cc:385] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.581492 1166 raft_consensus.cc:740] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.581707 1166 consensus_queue.cc:260] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.582218 1166 ts_tablet_manager.cc:1434] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.582187 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet aa9153d3245f4dcfacf26f174bced2ba (table default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]) successfully deleted
I20260503 07:53:02.582484 1173 tablet_replica.cc:333] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.582525 1166 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.582665 1173 raft_consensus.cc:2243] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.582815 1173 raft_consensus.cc:2272] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.584121 1171 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.584268 1171 ts_tablet_manager.cc:1403] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.151s user 0.002s sys 0.003s
I20260503 07:53:02.584906 1171 raft_consensus.cc:359] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.585065 1171 raft_consensus.cc:385] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.585114 1171 raft_consensus.cc:740] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.585276 1171 consensus_queue.cc:260] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:02.586983 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f1c40961284bf0848c93ed6a09b111 already in progress: creating tablet
I20260503 07:53:02.588801 1166 tablet_bootstrap.cc:654] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.590374 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_97c7d65a379943f69aa29ae4f54a330f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.590819 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97c7d65a379943f69aa29ae4f54a330f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.592594 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 77fa106f0cc24a35bd23b457660a45dc
I20260503 07:53:02.592593 1173 ts_tablet_manager.cc:1916] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.594187 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 77fa106f0cc24a35bd23b457660a45dc with delete_type TABLET_DATA_DELETED (replaced by tablet fe059e59c2b24ead87ef36e5b7cac5bf) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.596127 879 tablet_service.cc:1558] Processing DeleteTablet for tablet e6d4cfb8426c485eb7ff408e04f69141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.596777 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 77fa106f0cc24a35bd23b457660a45dc with delete_type TABLET_DATA_DELETED (replaced by tablet fe059e59c2b24ead87ef36e5b7cac5bf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.597011 599 catalog_manager.cc:6741] ReplaceTablet: tablet 77fa106f0cc24a35bd23b457660a45dc deleted and replaced by tablet fe059e59c2b24ead87ef36e5b7cac5bf
I20260503 07:53:02.597002 1175 ts_tablet_manager.cc:1929] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.597229 1175 log.cc:1199] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:02.597684 1175 ts_tablet_manager.cc:1950] T d58deacb99c643d89a6641ef09b026ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:02.598505 1173 ts_tablet_manager.cc:1929] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.598680 1173 log.cc:1199] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/fe2b065666ec4f1299b47d45cd1f600b
W20260503 07:53:02.598868 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 56f1c40961284bf0848c93ed6a09b111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f1c40961284bf0848c93ed6a09b111 already in progress: creating tablet
I20260503 07:53:02.598910 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d58deacb99c643d89a6641ef09b026ba (table default.Table_f331a5d6fa53414699446191d6622545 [id=f892c4c9ee21484e9a16b3e368386dc3]) successfully deleted
I20260503 07:53:02.599052 1173 ts_tablet_manager.cc:1950] T fe2b065666ec4f1299b47d45cd1f600b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.599303 1175 tablet_replica.cc:333] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:02.599377 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:02.600020 1173 tablet_replica.cc:333] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.600090 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet fe2b065666ec4f1299b47d45cd1f600b (table default.Table_f3a50cbc4bd349d4aa11b4d846565f79 [id=03b8908a6f274a229083cdcf7c5499a5]) successfully deleted
W20260503 07:53:02.601830 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 23a4cfddb56d47a692b9226bb5af14c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23a4cfddb56d47a692b9226bb5af14c1 already in progress: creating tablet
I20260503 07:53:02.606153 1173 raft_consensus.cc:2243] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.606375 1173 raft_consensus.cc:2272] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.607331 1173 ts_tablet_manager.cc:1916] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.608180 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet baf176bdc6d54088846ee5eaf5e61447) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.609604 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:02.609980 597 catalog_manager.cc:5671] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:02.610594 597 catalog_manager.cc:5671] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:02.610764 1174 ts_tablet_manager.cc:1929] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.610868 1174 log.cc:1199] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/16ea29e3b4a84735bb3723dd11449ec3
I20260503 07:53:02.599681 1175 raft_consensus.cc:2243] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.610981 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:02.611228 1175 raft_consensus.cc:2272] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.612969 1173 ts_tablet_manager.cc:1929] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.614931 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5f37055c47de4dd08186694d3c04ee17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.615444 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f37055c47de4dd08186694d3c04ee17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.611878 1175 ts_tablet_manager.cc:1916] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.616411 1173 log.cc:1199] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/cda8280b97254d1aaf3803f6b5cd223c
I20260503 07:53:02.616773 1173 ts_tablet_manager.cc:1950] T cda8280b97254d1aaf3803f6b5cd223c P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.617816 1173 tablet_replica.cc:333] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.617754 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet cda8280b97254d1aaf3803f6b5cd223c (table default.Table_ba4ac916a85e49c793f64e171c13382a [id=f77e5c2d75e54caab615fea946fb7c73]) successfully deleted
I20260503 07:53:02.618052 1173 raft_consensus.cc:2243] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:02.618135 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08d7b172bb1d4ad1ba81e08748db4ae2 already in progress: creating tablet
I20260503 07:53:02.618217 1173 raft_consensus.cc:2272] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.613816 1171 ts_tablet_manager.cc:1434] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.029s user 0.000s sys 0.001s
I20260503 07:53:02.617506 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ffded03505a4436c8598eb62fc41c377" } new_table_name: "default.Table_9781f3c5bf124f8a8c0924bda4299878" modify_external_catalogs: true
I20260503 07:53:02.622035 1173 ts_tablet_manager.cc:1916] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.623817 1171 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.628132 1173 ts_tablet_manager.cc:1929] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:53:02.639938 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 597c7c65f49a4811997d99a782e7b146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597c7c65f49a4811997d99a782e7b146 already in progress: creating tablet
I20260503 07:53:02.629293 879 tablet_service.cc:1511] Processing CreateTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b (DEFAULT_TABLE table=default.Table_3222cedb816c47b4b48e7865fb0fa990 [id=73b737a754d84ccb90f2ac07750173f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.637559 1166 tablet_bootstrap.cc:492] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.640347 1173 log.cc:1199] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/67387c8aba1f4d728b3691c5da720e4d
I20260503 07:53:02.640403 1166 ts_tablet_manager.cc:1403] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.058s user 0.022s sys 0.017s
I20260503 07:53:02.640458 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b8c1768a15487ba9140acd77c4ff7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.640803 1173 ts_tablet_manager.cc:1950] T 67387c8aba1f4d728b3691c5da720e4d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.641214 1171 tablet_bootstrap.cc:654] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.641764 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 67387c8aba1f4d728b3691c5da720e4d (table default.Table_29f9d87b702f4f08a7d36b2f3bd2028c [id=bd345ab54d2640ab81ef3154b405dcf0]) successfully deleted
I20260503 07:53:02.642084 1173 tablet_replica.cc:333] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.642279 1173 raft_consensus.cc:2243] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.642495 1173 raft_consensus.cc:2272] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.643348 1173 ts_tablet_manager.cc:1916] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.649225 1173 ts_tablet_manager.cc:1929] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:02.650085 1173 log.cc:1199] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f1aeea6b4ead45ef82934811494cf263
I20260503 07:53:02.650605 1173 ts_tablet_manager.cc:1950] T f1aeea6b4ead45ef82934811494cf263 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.650689 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_88245cee4c2545c4afc3a1859deb67db" } new_table_name: "default.Table_4137d4cf080d4f6ab4ae2d20453ccb5d" modify_external_catalogs: true
I20260503 07:53:02.651902 1166 raft_consensus.cc:359] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.652215 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:53:02.652225 1166 raft_consensus.cc:385] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.652376 1166 raft_consensus.cc:740] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.652755 1166 consensus_queue.cc:260] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.653951 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:02.653970 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b (DEFAULT_TABLE table=default.Table_3222cedb816c47b4b48e7865fb0fa990 [id=73b737a754d84ccb90f2ac07750173f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.654428 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b8c1768a15487ba9140acd77c4ff7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.656416 1166 ts_tablet_manager.cc:1434] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:53:02.658465 1174 ts_tablet_manager.cc:1950] T 16ea29e3b4a84735bb3723dd11449ec3 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:02.659837 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 629) took 1067 ms. Trace:
I20260503 07:53:02.661108 1173 tablet_replica.cc:333] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.661334 1173 raft_consensus.cc:2243] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.622318 757 tablet_service.cc:1558] Processing DeleteTablet for tablet f1aeea6b4ead45ef82934811494cf263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.623708 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da5a4c519a249ca90c466eab47aa00b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.661514 1173 raft_consensus.cc:2272] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.629556 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 77fa106f0cc24a35bd23b457660a45dc with delete_type TABLET_DATA_DELETED (replaced by tablet fe059e59c2b24ead87ef36e5b7cac5bf) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.631893 1983 raft_consensus.cc:493] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.661700 1983 raft_consensus.cc:515] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:02.661942 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6da5a4c519a249ca90c466eab47aa00b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da5a4c519a249ca90c466eab47aa00b already in progress: creating tablet
I20260503 07:53:02.662285 1983 leader_election.cc:290] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:02.662820 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:02.663225 1173 ts_tablet_manager.cc:1916] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:02.663344 716 leader_election.cc:343] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.663940 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:02.659986 1174 rpcz_store.cc:276] 0503 07:53:01.592363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.592655 (+ 292us) service_pool.cc:224] Handling call
0503 07:53:02.528390 (+935735us) ts_tablet_manager.cc:1151] Deleting tablet 16ea29e3b4a84735bb3723dd11449ec3
0503 07:53:02.528403 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.605776 (+ 77373us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.610704 (+ 4928us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.659815 (+ 49111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":935481}
W20260503 07:53:02.664374 715 leader_election.cc:343] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.664474 715 leader_election.cc:304] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:02.664515 1174 tablet_replica.cc:333] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.664696 1174 raft_consensus.cc:2243] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.664849 1174 raft_consensus.cc:2272] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.664808 1166 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.664947 1983 raft_consensus.cc:2749] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.634543 1165 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.665186 1165 ts_tablet_manager.cc:1403] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.002s
I20260503 07:53:02.665493 1174 ts_tablet_manager.cc:1916] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.665899 1165 raft_consensus.cc:359] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.666036 1165 raft_consensus.cc:385] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.666077 1165 raft_consensus.cc:740] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.666240 1165 consensus_queue.cc:260] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.666731 1165 ts_tablet_manager.cc:1434] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260503 07:53:02.666982 1165 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.669385 1165 tablet_bootstrap.cc:654] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.669456 1173 ts_tablet_manager.cc:1929] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:02.673310 1165 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.673324 1175 ts_tablet_manager.cc:1929] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.673422 1175 log.cc:1199] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/568ccdf187eb4cae9688ff4929f3e95e
I20260503 07:53:02.673514 1173 log.cc:1199] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/77fa106f0cc24a35bd23b457660a45dc
I20260503 07:53:02.673542 1165 ts_tablet_manager.cc:1403] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260503 07:53:02.673887 1173 ts_tablet_manager.cc:1950] T 77fa106f0cc24a35bd23b457660a45dc P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.674403 1171 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.674822 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 77fa106f0cc24a35bd23b457660a45dc (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
I20260503 07:53:02.672137 1166 tablet_bootstrap.cc:654] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.675093 1171 ts_tablet_manager.cc:1403] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.001s
I20260503 07:53:02.674958 1165 raft_consensus.cc:359] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.675290 1165 raft_consensus.cc:385] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.675422 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3a7b104c6633409085757a7fce0f7028"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.675880 1173 tablet_replica.cc:333] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.675884 1165 raft_consensus.cc:740] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.676067 1173 raft_consensus.cc:2243] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.676254 1173 raft_consensus.cc:2272] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.676441 1171 raft_consensus.cc:359] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.676612 1171 raft_consensus.cc:385] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.676682 1171 raft_consensus.cc:740] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.676906 1171 consensus_queue.cc:260] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.677330 1171 ts_tablet_manager.cc:1434] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:02.677585 1171 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.679103 1171 tablet_bootstrap.cc:654] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.680871 1175 ts_tablet_manager.cc:1950] T 568ccdf187eb4cae9688ff4929f3e95e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:02.681799 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 568ccdf187eb4cae9688ff4929f3e95e (table default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]) successfully deleted
W20260503 07:53:02.682078 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet dd06852d500a41c881103e1ab742029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd06852d500a41c881103e1ab742029b already in progress: creating tablet
W20260503 07:53:02.687721 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet dbd9458716524bdb8658bdef4d73bbac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd9458716524bdb8658bdef4d73bbac already in progress: creating tablet
W20260503 07:53:02.688467 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet efeecf8029c8464089a5a64e4457c9c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efeecf8029c8464089a5a64e4457c9c5 already in progress: creating tablet
W20260503 07:53:02.689085 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3e688661ecdc4ba1b8b8c0867499fe4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e688661ecdc4ba1b8b8c0867499fe4d already in progress: creating tablet
I20260503 07:53:02.689383 1175 tablet_replica.cc:333] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:02.689610 1175 raft_consensus.cc:2243] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:02.691098 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a7b104c6633409085757a7fce0f7028 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.691269 1165 consensus_queue.cc:260] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.693053 1165 ts_tablet_manager.cc:1434] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260503 07:53:02.693992 1165 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.696689 1173 ts_tablet_manager.cc:1916] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.700098 1165 tablet_bootstrap.cc:654] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.702548 879 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd3c136b364aee91a733132d4caef5 (DEFAULT_TABLE table=default.Table_11bde1b76bf54bf19be5e9f545931bf5 [id=df399b0411a64f6a86484a2a8a838c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.702929 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd3c136b364aee91a733132d4caef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.702754 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd3c136b364aee91a733132d4caef5 (DEFAULT_TABLE table=default.Table_11bde1b76bf54bf19be5e9f545931bf5 [id=df399b0411a64f6a86484a2a8a838c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.703256 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd3c136b364aee91a733132d4caef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.707963 1175 raft_consensus.cc:2272] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.709045 1174 ts_tablet_manager.cc:1929] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.709350 1174 log.cc:1199] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f5896bb71c674358957c87a347b8fb79
I20260503 07:53:02.709784 1174 ts_tablet_manager.cc:1950] T f5896bb71c674358957c87a347b8fb79 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:02.693698 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 16ea29e3b4a84735bb3723dd11449ec3 (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:53:02.712350 1952 consensus_queue.cc:1048] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:02.713565 1175 ts_tablet_manager.cc:1916] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.716282 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 630) took 1123 ms. Trace:
I20260503 07:53:02.716537 1174 rpcz_store.cc:276] 0503 07:53:01.592486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.596230 (+ 3744us) service_pool.cc:224] Handling call
0503 07:53:02.664464 (+1068234us) ts_tablet_manager.cc:1151] Deleting tablet f5896bb71c674358957c87a347b8fb79
0503 07:53:02.664475 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.687274 (+ 22799us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.708982 (+ 21708us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.716258 (+ 7276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1068088}
I20260503 07:53:02.717077 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b435d9b81275447189fba50c82258955
I20260503 07:53:02.717706 879 tablet_service.cc:1558] Processing DeleteTablet for tablet b435d9b81275447189fba50c82258955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.718590 1166 tablet_bootstrap.cc:492] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.718715 1166 ts_tablet_manager.cc:1403] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.000s
I20260503 07:53:02.718990 1174 tablet_replica.cc:333] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.719177 1174 raft_consensus.cc:2243] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.719323 1174 raft_consensus.cc:2272] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.719851 1174 ts_tablet_manager.cc:1916] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.719841 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:02.720000 1166 raft_consensus.cc:359] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.720201 1166 raft_consensus.cc:385] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.720258 1166 raft_consensus.cc:740] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.720470 1166 consensus_queue.cc:260] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.720603 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3a3671670c294045b91a9e1d2641ae68" } new_table_name: "default.Table_47281d82f2c84819a8121c1e4d4e3585" modify_external_catalogs: true
I20260503 07:53:02.720920 1166 ts_tablet_manager.cc:1434] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:02.721388 1166 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:02.721928 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_c081581d0e69483a9c4fdc42e9abec77 [id=6f2dee6dc12f4eb1a99cf69412d2d256] alter complete (version 1)
I20260503 07:53:02.722959 1166 tablet_bootstrap.cc:654] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.727358 754 tablet_service.cc:1511] Processing CreateTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b (DEFAULT_TABLE table=default.Table_3222cedb816c47b4b48e7865fb0fa990 [id=73b737a754d84ccb90f2ac07750173f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.727761 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b8c1768a15487ba9140acd77c4ff7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.718510 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b435d9b81275447189fba50c82258955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.737375 1173 ts_tablet_manager.cc:1929] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.737682 1173 log.cc:1199] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/e6d4cfb8426c485eb7ff408e04f69141
I20260503 07:53:02.738134 1173 ts_tablet_manager.cc:1950] T e6d4cfb8426c485eb7ff408e04f69141 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.739068 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet e6d4cfb8426c485eb7ff408e04f69141 (table default.Table_91536c63cda14993a1239c5b47af0f7b [id=c060913d5be94693bb63ccf44d30c300]) successfully deleted
W20260503 07:53:02.740083 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b435d9b81275447189fba50c82258955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b435d9b81275447189fba50c82258955 already in progress: creating tablet
I20260503 07:53:02.748234 1174 ts_tablet_manager.cc:1929] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.756989 1171 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.757218 1171 ts_tablet_manager.cc:1403] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.005s
I20260503 07:53:02.758002 879 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae (DEFAULT_TABLE table=default.Table_ca3bd12cae99485f821af37a50f557b0 [id=26259235228247fab7866a09d79d8bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.758072 1171 raft_consensus.cc:359] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.758234 1171 raft_consensus.cc:385] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.758288 1171 raft_consensus.cc:740] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.758399 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29807ce9b4ccabafeb059afb9bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.758518 1171 consensus_queue.cc:260] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.759006 1171 ts_tablet_manager.cc:1434] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:02.759279 1171 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.760871 1171 tablet_bootstrap.cc:654] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.768282 1174 log.cc:1199] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:53:02.768766 1174 ts_tablet_manager.cc:1950] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:02.765285 988 consensus_peers.cc:597] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1f86609fc7b4007ab4c730002918613. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:02.770680 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 631) took 1178 ms. Trace:
I20260503 07:53:02.770865 1174 rpcz_store.cc:276] 0503 07:53:01.592607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.596396 (+ 3789us) service_pool.cc:224] Handling call
0503 07:53:02.718692 (+1122296us) ts_tablet_manager.cc:1151] Deleting tablet 75419ed8fabc4c36ae2d2b128ec4f5b5
0503 07:53:02.718945 (+ 253us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.722683 (+ 3738us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.748149 (+ 25466us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.770659 (+ 22510us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122166}
I20260503 07:53:02.771319 1174 tablet_replica.cc:333] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.771546 1174 raft_consensus.cc:2243] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.771562 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f5896bb71c674358957c87a347b8fb79 (table default.Table_8e054473f51a46658409679b60b4f097 [id=4d435b963bd742c0b3d6da1c384015e6]) successfully deleted
I20260503 07:53:02.771757 1174 raft_consensus.cc:2272] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.772394 1174 ts_tablet_manager.cc:1916] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.774567 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b435d9b81275447189fba50c82258955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.775132 759 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd3c136b364aee91a733132d4caef5 (DEFAULT_TABLE table=default.Table_11bde1b76bf54bf19be5e9f545931bf5 [id=df399b0411a64f6a86484a2a8a838c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.775583 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd3c136b364aee91a733132d4caef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.777168 1171 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:02.777284 1171 ts_tablet_manager.cc:1403] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:53:02.777954 1171 raft_consensus.cc:359] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.778105 1171 raft_consensus.cc:385] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.778158 1171 raft_consensus.cc:740] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.778345 1171 consensus_queue.cc:260] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.778774 1171 ts_tablet_manager.cc:1434] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:02.779059 1171 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:02.780616 1171 tablet_bootstrap.cc:654] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.798590 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae (DEFAULT_TABLE table=default.Table_ca3bd12cae99485f821af37a50f557b0 [id=26259235228247fab7866a09d79d8bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.799022 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29807ce9b4ccabafeb059afb9bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.806772 1165 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.806777 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 (DEFAULT_TABLE table=default.Table_cb6a510fb25541a98a4439a381cde649 [id=28efd6b6f86d4548ba0e1944be337cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.807036 1165 ts_tablet_manager.cc:1403] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.003s
I20260503 07:53:02.807255 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
I20260503 07:53:02.808096 1165 raft_consensus.cc:359] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.808406 1165 raft_consensus.cc:385] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.808550 1165 raft_consensus.cc:740] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.816892 1165 consensus_queue.cc:260] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.817288 1174 ts_tablet_manager.cc:1929] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.817392 1174 log.cc:1199] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b028017b7cc74ef6a199d6b9e0ba6e14
I20260503 07:53:02.817706 1174 ts_tablet_manager.cc:1950] T b028017b7cc74ef6a199d6b9e0ba6e14 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:02.818251 1165 ts_tablet_manager.cc:1434] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260503 07:53:02.818737 1165 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.820989 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 638) took 1130 ms. Trace:
I20260503 07:53:02.823105 759 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae (DEFAULT_TABLE table=default.Table_ca3bd12cae99485f821af37a50f557b0 [id=26259235228247fab7866a09d79d8bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.823575 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29807ce9b4ccabafeb059afb9bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.821484 1174 rpcz_store.cc:276] 0503 07:53:01.690892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.690940 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:02.771268 (+1080328us) ts_tablet_manager.cc:1151] Deleting tablet b028017b7cc74ef6a199d6b9e0ba6e14
0503 07:53:02.771278 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.783035 (+ 11757us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.817228 (+ 34193us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.820950 (+ 3722us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1080120}
I20260503 07:53:02.826805 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 637) took 1136 ms. Trace:
I20260503 07:53:02.827373 1174 rpcz_store.cc:276] 0503 07:53:01.690747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.690944 (+ 197us) service_pool.cc:224] Handling call
0503 07:53:02.826211 (+1135267us) ts_tablet_manager.cc:1151] Deleting tablet 72fc61b1b49045fbb9b6b0cb94b1d661
0503 07:53:02.826221 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.826786 (+ 565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1106646}
I20260503 07:53:02.829125 1165 tablet_bootstrap.cc:654] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.835592 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b028017b7cc74ef6a199d6b9e0ba6e14 (table default.Table_569d7dd42684487a89c9749674c78b1a [id=1773e021ed7c489aa09d73e171b34837]) successfully deleted
W20260503 07:53:02.837291 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 72fc61b1b49045fbb9b6b0cb94b1d661 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72fc61b1b49045fbb9b6b0cb94b1d661 already in progress: creating tablet
W20260503 07:53:02.837792 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0422b379bbf34a8e8773541f2336f477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0422b379bbf34a8e8773541f2336f477 already in progress: creating tablet
I20260503 07:53:02.842051 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e1efb53c5e184a618316a759b8e7d38e
I20260503 07:53:02.843163 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e1efb53c5e184a618316a759b8e7d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:02.844091 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e1efb53c5e184a618316a759b8e7d38e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1efb53c5e184a618316a759b8e7d38e already in progress: creating tablet
I20260503 07:53:02.844420 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_788af50afe2f4b44a37aad1c77d49d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.845984 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:02.847272 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_accdb92d0ffc47e38205a2ec05b71df5" } new_table_name: "default.Table_b80f2de2517343d79af84f18e972c101" modify_external_catalogs: true
I20260503 07:53:02.848593 884 tablet_service.cc:1558] Processing DeleteTablet for tablet efec3cb45daf44e59132ea4d8929bd43 with delete_type TABLET_DATA_DELETED (replaced by tablet 314f539af5e44f048ff42619fcda1943) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.848834 1173 tablet_replica.cc:333] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:02.849017 1173 raft_consensus.cc:2243] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.849170 1173 raft_consensus.cc:2272] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.849583 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae4a8f39d67459dbb80c72947ae7005. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:02.849674 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_788af50afe2f4b44a37aad1c77d49d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.850787 1174 tablet_replica.cc:333] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.852057 1174 raft_consensus.cc:2243] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.852823 1173 ts_tablet_manager.cc:1916] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.853437 1174 raft_consensus.cc:2272] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:02.853816 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b90ec3eb3894c18825ebe5fb79fa5be consensus state has no leader
I20260503 07:53:02.854173 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e55353e7b6e34de4aa897a63b55dd09b" } new_table_name: "default.Table_76d0c5a78ae24f419d73eabf93174885" modify_external_catalogs: true
I20260503 07:53:02.856284 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet e1efb53c5e184a618316a759b8e7d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:02.857354 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3e688661ecdc4ba1b8b8c0867499fe4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e688661ecdc4ba1b8b8c0867499fe4d already in progress: creating tablet
I20260503 07:53:02.857416 1174 ts_tablet_manager.cc:1916] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.858708 1173 ts_tablet_manager.cc:1929] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.858868 1173 log.cc:1199] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/efec3cb45daf44e59132ea4d8929bd43
I20260503 07:53:02.859457 1173 ts_tablet_manager.cc:1950] T efec3cb45daf44e59132ea4d8929bd43 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:02.860011 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet efec3cb45daf44e59132ea4d8929bd43 (table default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]) successfully deleted
I20260503 07:53:02.863070 918 raft_consensus.cc:3060] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:02.868275 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet dd06852d500a41c881103e1ab742029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd06852d500a41c881103e1ab742029b already in progress: creating tablet
W20260503 07:53:02.868924 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet efeecf8029c8464089a5a64e4457c9c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efeecf8029c8464089a5a64e4457c9c5 already in progress: creating tablet
W20260503 07:53:02.869745 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet dbd9458716524bdb8658bdef4d73bbac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd9458716524bdb8658bdef4d73bbac already in progress: creating tablet
I20260503 07:53:02.872706 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 (DEFAULT_TABLE table=default.Table_cb6a510fb25541a98a4439a381cde649 [id=28efd6b6f86d4548ba0e1944be337cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.874439 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae4a8f39d67459dbb80c72947ae7005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.879185 884 tablet_service.cc:1511] Processing CreateTablet for tablet 918d98225bd44da9afef237fb836b6b3 (DEFAULT_TABLE table=default.Table_2c4f599d97c14121ab590982ded7da24 [id=f797d4227bd046cea168de391a9a2d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.879532 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918d98225bd44da9afef237fb836b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.880671 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 918d98225bd44da9afef237fb836b6b3 (DEFAULT_TABLE table=default.Table_2c4f599d97c14121ab590982ded7da24 [id=f797d4227bd046cea168de391a9a2d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.881079 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918d98225bd44da9afef237fb836b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:02.890463 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6eb7486acc6a49dba0295ee26ac68724 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eb7486acc6a49dba0295ee26ac68724 already in progress: creating tablet
W20260503 07:53:02.890841 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f3cfc39292764a93a7cbb7c83f11e179 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cfc39292764a93a7cbb7c83f11e179 already in progress: creating tablet
I20260503 07:53:02.895488 1983 raft_consensus.cc:493] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.895622 1983 raft_consensus.cc:515] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.896580 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c1709a2a49475daaa2372360610b1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:02.896736 1052 raft_consensus.cc:2468] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:02.897285 716 leader_election.cc:304] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:02.897535 1978 raft_consensus.cc:2804] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:02.897598 1978 raft_consensus.cc:493] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:02.897653 1978 raft_consensus.cc:3060] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.899923 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e2dcbb5010e346fca99dffdbdbb337f4
I20260503 07:53:02.900234 1983 leader_election.cc:290] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:02.900626 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c1709a2a49475daaa2372360610b1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:02.901129 715 leader_election.cc:343] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.901605 1978 raft_consensus.cc:515] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.901724 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.902160 1978 leader_election.cc:290] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:02.902303 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:02.902631 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c1709a2a49475daaa2372360610b1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:02.902782 1052 raft_consensus.cc:3060] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:02.905376 1052 raft_consensus.cc:2468] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:02.905391 1166 tablet_bootstrap.cc:492] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.905529 1166 ts_tablet_manager.cc:1403] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.184s user 0.011s sys 0.039s
I20260503 07:53:02.905730 716 leader_election.cc:304] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:02.906222 1166 raft_consensus.cc:359] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.906360 1166 raft_consensus.cc:385] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.906414 1166 raft_consensus.cc:740] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.906618 1166 consensus_queue.cc:260] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.906731 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c1709a2a49475daaa2372360610b1e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:02.907051 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e1efb53c5e184a618316a759b8e7d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.907172 1166 ts_tablet_manager.cc:1434] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.907424 1166 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:02.907622 715 leader_election.cc:343] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:02.907968 1978 raft_consensus.cc:2804] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:02.908066 1978 raft_consensus.cc:697] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:02.908278 1978 consensus_queue.cc:237] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:02.908696 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4483da8794df4f2a94b7b28908a76dc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.908892 1166 tablet_bootstrap.cc:654] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:02.909313 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4483da8794df4f2a94b7b28908a76dc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:02.909711 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e2dcbb5010e346fca99dffdbdbb337f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2dcbb5010e346fca99dffdbdbb337f4 already in progress: creating tablet
I20260503 07:53:02.914326 1175 ts_tablet_manager.cc:1929] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.917008 1165 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.917133 1165 ts_tablet_manager.cc:1403] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.002s
I20260503 07:53:02.917434 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 (DEFAULT_TABLE table=default.Table_cb6a510fb25541a98a4439a381cde649 [id=28efd6b6f86d4548ba0e1944be337cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.917817 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae4a8f39d67459dbb80c72947ae7005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.917860 1165 raft_consensus.cc:359] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.918007 1165 raft_consensus.cc:385] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.918057 1165 raft_consensus.cc:740] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.918231 1165 consensus_queue.cc:260] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.918800 1165 ts_tablet_manager.cc:1434] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.919059 1165 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.921564 1165 tablet_bootstrap.cc:654] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.925540 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:02.925423 2143 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:02.934093 757 tablet_service.cc:1511] Processing CreateTablet for tablet 918d98225bd44da9afef237fb836b6b3 (DEFAULT_TABLE table=default.Table_2c4f599d97c14121ab590982ded7da24 [id=f797d4227bd046cea168de391a9a2d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.934486 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918d98225bd44da9afef237fb836b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.941756 1165 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.941941 1165 ts_tablet_manager.cc:1403] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260503 07:53:02.942814 1165 raft_consensus.cc:359] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.943022 1165 raft_consensus.cc:385] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.943094 1165 raft_consensus.cc:740] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.943331 1165 consensus_queue.cc:260] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.943892 1165 ts_tablet_manager.cc:1434] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:02.944160 1165 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.945698 1165 tablet_bootstrap.cc:654] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.946599 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f4fd9524157c4225885a1f1831982faa
I20260503 07:53:02.947072 594 catalog_manager.cc:6741] ReplaceTablet: tablet f4fd9524157c4225885a1f1831982faa deleted and replaced by tablet 07f79085c25d43e58f221af146d252cf
I20260503 07:53:02.951372 879 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:02.952209 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f4fd9524157c4225885a1f1831982faa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4fd9524157c4225885a1f1831982faa already in progress: creating tablet
I20260503 07:53:02.952580 1174 ts_tablet_manager.cc:1929] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:02.953732 879 tablet_service.cc:1511] Processing CreateTablet for tablet 314618c911b148d48e4651a100d66fae (DEFAULT_TABLE table=default.Table_cd3761aae67d400e9781b631dc57766b [id=49067875cc9c4900bba9e2b64616e536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.953593 1174 log.cc:1199] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:02.954288 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314618c911b148d48e4651a100d66fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.955470 1174 ts_tablet_manager.cc:1950] T 3650ec1de28c4f1bafd979257dd2b778 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:02.961880 594 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 766799446d1a480ca04246b0aec14852 (table default.Table_7eea345022f4468c978d09942e1140f2 [id=c9513d6e491a4250894ed7225db630fe]). Expected version 1 got 0
W20260503 07:53:02.967123 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46dd100e06ff41be960b265b52d1c607 consensus state has no leader
I20260503 07:53:02.968974 1165 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:02.969146 1165 ts_tablet_manager.cc:1403] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260503 07:53:02.969972 1165 raft_consensus.cc:359] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.970192 1165 raft_consensus.cc:385] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:02.970263 1165 raft_consensus.cc:740] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:02.970475 1165 consensus_queue.cc:260] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.970570 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:02.971117 1165 ts_tablet_manager.cc:1434] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260503 07:53:02.971115 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.971280 884 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e (DEFAULT_TABLE table=default.Table_a2f4f64a80a0412fbaecc20893120f76 [id=dae8ece76f3f4254af8d052addd8b761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.971398 1165 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:02.971647 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6d0c557fe34e588e5baddc3a30774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.972967 1165 tablet_bootstrap.cc:654] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:02.975636 2082 raft_consensus.cc:493] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:02.975749 2082 raft_consensus.cc:515] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:02.976537 2082 leader_election.cc:290] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:02.979157 854 leader_election.cc:343] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: e63048335fe349ebb6001b37e63a389e
I20260503 07:53:02.979241 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1e8e9400225d4c089fb68ec17dedd6a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.979449 851 leader_election.cc:343] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e63048335fe349ebb6001b37e63a389e
I20260503 07:53:02.979547 851 leader_election.cc:304] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:02.979730 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e8e9400225d4c089fb68ec17dedd6a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.980108 2082 raft_consensus.cc:2749] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:02.980137 1174 tablet_replica.cc:333] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:02.981160 1174 raft_consensus.cc:2243] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:02.982074 1174 raft_consensus.cc:2272] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:02.984092 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3650ec1de28c4f1bafd979257dd2b778 (table default.Table_50b3d54db78b4a0fa4c0735349d51cad [id=d778245ff437405896430039f772e652]) successfully deleted
W20260503 07:53:02.984552 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d93d5f6df3349588b9f1d5e0e24a1db consensus state has no leader
I20260503 07:53:02.948531 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:02.985878 1174 ts_tablet_manager.cc:1916] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:02.987109 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:02.987347 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ca0c330e729d4314ae8d312b321992a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca0c330e729d4314ae8d312b321992a6 already in progress: creating tablet
W20260503 07:53:02.987635 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 822c15b68f61466584eec0702196a5c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 822c15b68f61466584eec0702196a5c5 already in progress: creating tablet
W20260503 07:53:02.987915 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b5f31f37e97345bb9187865e38ee1d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f31f37e97345bb9187865e38ee1d61 already in progress: creating tablet
W20260503 07:53:02.988197 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 18523493ee4841cb8949826239e2e458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18523493ee4841cb8949826239e2e458 already in progress: creating tablet
I20260503 07:53:02.988328 884 tablet_service.cc:1511] Processing CreateTablet for tablet e51911038c2d44f9a5c5aebdbcb5946e (DEFAULT_TABLE table=default.Table_2f9dd118b5dc4939baed5ff4f8b624e5 [id=71d63e61e2fa4966b5d55b50cb3b7546]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:02.988574 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ecc39d127c71412ea867a0b3cad10452 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecc39d127c71412ea867a0b3cad10452 already in progress: creating tablet
I20260503 07:53:02.988773 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51911038c2d44f9a5c5aebdbcb5946e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:02.988852 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 057b62a991b74c859045a74df7dc716f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 057b62a991b74c859045a74df7dc716f already in progress: creating tablet
I20260503 07:53:02.989601 1166 tablet_bootstrap.cc:492] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:02.990167 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_177808a7b6234be8a8f79c240c720c85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:02.990628 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_177808a7b6234be8a8f79c240c720c85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:02.993220 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 314618c911b148d48e4651a100d66fae (DEFAULT_TABLE table=default.Table_cd3761aae67d400e9781b631dc57766b [id=49067875cc9c4900bba9e2b64616e536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.993489 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e (DEFAULT_TABLE table=default.Table_a2f4f64a80a0412fbaecc20893120f76 [id=dae8ece76f3f4254af8d052addd8b761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.993685 1175 log.cc:1199] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:02.994086 1175 ts_tablet_manager.cc:1950] T aaaeda1a5d6d436292cd1688f8a4d467 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:02.994150 757 tablet_service.cc:1511] Processing CreateTablet for tablet 314618c911b148d48e4651a100d66fae (DEFAULT_TABLE table=default.Table_cd3761aae67d400e9781b631dc57766b [id=49067875cc9c4900bba9e2b64616e536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.994481 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314618c911b148d48e4651a100d66fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:02.995379 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e51911038c2d44f9a5c5aebdbcb5946e (DEFAULT_TABLE table=default.Table_2f9dd118b5dc4939baed5ff4f8b624e5 [id=71d63e61e2fa4966b5d55b50cb3b7546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.999831 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc (DEFAULT_TABLE table=default.Table_fadf876a1e6c4d0b98eec1b009f15056 [id=6b447ce3da1b4956a20a9efdf42f4c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:02.999948 1165 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.000077 1165 ts_tablet_manager.cc:1403] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.003s
I20260503 07:53:03.000221 1166 ts_tablet_manager.cc:1403] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.013s
I20260503 07:53:03.000396 1171 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.000535 1171 ts_tablet_manager.cc:1403] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.222s user 0.017s sys 0.023s
I20260503 07:53:03.001276 1165 raft_consensus.cc:359] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.001441 1165 raft_consensus.cc:385] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.001493 1165 raft_consensus.cc:740] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.001680 1165 consensus_queue.cc:260] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.001770 1171 raft_consensus.cc:359] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.001966 1171 raft_consensus.cc:385] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.002059 1171 raft_consensus.cc:740] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.002228 1165 ts_tablet_manager.cc:1434] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:03.002511 1165 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.002480 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e (DEFAULT_TABLE table=default.Table_a2f4f64a80a0412fbaecc20893120f76 [id=dae8ece76f3f4254af8d052addd8b761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.002874 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6d0c557fe34e588e5baddc3a30774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.004079 1165 tablet_bootstrap.cc:654] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.004318 1171 consensus_queue.cc:260] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.004484 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_7eea345022f4468c978d09942e1140f2 [id=c9513d6e491a4250894ed7225db630fe] alter complete (version 1)
I20260503 07:53:03.004555 1978 raft_consensus.cc:493] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.004665 1978 raft_consensus.cc:515] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.005223 1978 leader_election.cc:290] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.006570 754 tablet_service.cc:1511] Processing CreateTablet for tablet e51911038c2d44f9a5c5aebdbcb5946e (DEFAULT_TABLE table=default.Table_2f9dd118b5dc4939baed5ff4f8b624e5 [id=71d63e61e2fa4966b5d55b50cb3b7546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.006928 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51911038c2d44f9a5c5aebdbcb5946e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.008080 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.008468 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb88812c6b0459d86bd441926f57ecf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.008936 715 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.009411 1171 ts_tablet_manager.cc:1434] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260503 07:53:03.010375 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81" } modify_external_catalogs: true
I20260503 07:53:03.010545 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81" } modify_external_catalogs: true
I20260503 07:53:03.011719 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_977aca95114346c5b14b665778f89be6" } modify_external_catalogs: true
I20260503 07:53:03.011870 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_977aca95114346c5b14b665778f89be6" } modify_external_catalogs: true
I20260503 07:53:03.013074 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1c68da010fec44829aa7de3ba818cc1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.013574 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c68da010fec44829aa7de3ba818cc1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.015870 894 tablet_service.cc:1511] Processing CreateTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a (DEFAULT_TABLE table=default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2 [id=b10b679b3648407097f09deb5940524f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.016837 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d0e93ae66c46749c4f7e9e495ae60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.017894 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb88812c6b0459d86bd441926f57ecf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.018548 716 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.018643 716 leader_election.cc:304] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.022193 1978 raft_consensus.cc:2749] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.022360 1978 raft_consensus.cc:493] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.022460 1978 raft_consensus.cc:515] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.023005 1978 leader_election.cc:290] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.023603 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.024086 716 leader_election.cc:343] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.024206 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.024449 1166 raft_consensus.cc:359] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:03.024696 715 leader_election.cc:343] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.024791 715 leader_election.cc:304] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.025111 1983 raft_consensus.cc:2749] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.026753 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
W20260503 07:53:03.027767 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f142af0cf6a40e29f8b6faa6a400395 has no consensus state
I20260503 07:53:03.028430 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6d0c557fe34e588e5baddc3a30774e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.033541 1174 ts_tablet_manager.cc:1929] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260503 07:53:03.033718 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:03.034221 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:03.034488 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:03.034766 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]). Expected version 1 got 0
I20260503 07:53:03.037992 1174 log.cc:1199] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f1f86609fc7b4007ab4c730002918613
I20260503 07:53:03.038239 754 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.038702 1174 ts_tablet_manager.cc:1950] T f1f86609fc7b4007ab4c730002918613 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.039374 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.040387 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.041046 1174 tablet_replica.cc:333] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.041678 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]) successfully deleted
I20260503 07:53:03.042347 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314618c911b148d48e4651a100d66fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.042232 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.043602 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:03.042337 1174 raft_consensus.cc:2243] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.044809 1166 raft_consensus.cc:385] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.040575 894 tablet_service.cc:1558] Processing DeleteTablet for tablet e63048335fe349ebb6001b37e63a389e with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3210d1ecd42198e080b02a8b594a5) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.045123 1173 tablet_replica.cc:333] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:03.045290 1173 raft_consensus.cc:2243] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.045426 1173 raft_consensus.cc:2272] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.046034 1173 ts_tablet_manager.cc:1916] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.048290 1174 raft_consensus.cc:2272] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.048983 1174 ts_tablet_manager.cc:1916] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.052673 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 677) took 1143 ms. Trace:
I20260503 07:53:03.052774 1175 rpcz_store.cc:276] 0503 07:53:01.909613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.936037 (+ 26424us) service_pool.cc:224] Handling call
0503 07:53:02.689341 (+753304us) ts_tablet_manager.cc:1151] Deleting tablet aaaeda1a5d6d436292cd1688f8a4d467
0503 07:53:02.689350 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:02.755834 (+ 66484us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:02.914273 (+158439us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:03.052634 (+138361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":753086}
I20260503 07:53:03.053220 1175 tablet_replica.cc:333] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:03.053414 1175 raft_consensus.cc:2243] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.053614 1173 ts_tablet_manager.cc:1929] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.053639 1983 raft_consensus.cc:493] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.053809 1173 log.cc:1199] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/e63048335fe349ebb6001b37e63a389e
I20260503 07:53:03.053751 1983 raft_consensus.cc:515] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.054185 1173 ts_tablet_manager.cc:1950] T e63048335fe349ebb6001b37e63a389e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:03.054431 1983 leader_election.cc:290] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.054543 1983 raft_consensus.cc:493] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.054628 1983 raft_consensus.cc:515] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.054764 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.055094 1983 leader_election.cc:290] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.055729 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb4d150eadb479d9978f2450637bd3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:03.056062 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.056493 716 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:03.056672 716 leader_election.cc:343] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.056820 1175 raft_consensus.cc:2272] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:03.057353 715 leader_election.cc:343] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.057482 1175 ts_tablet_manager.cc:1916] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.057440 715 leader_election.cc:304] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.057978 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb4d150eadb479d9978f2450637bd3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.058475 715 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.058565 715 leader_election.cc:304] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.058935 1983 raft_consensus.cc:2749] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.059069 1983 raft_consensus.cc:2749] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.060256 1166 raft_consensus.cc:740] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.060595 1166 consensus_queue.cc:260] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.062830 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51911038c2d44f9a5c5aebdbcb5946e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.067965 1166 ts_tablet_manager.cc:1434] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260503 07:53:03.068427 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.069918 1174 ts_tablet_manager.cc:1929] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.070012 1174 log.cc:1199] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/feb88812c6b0459d86bd441926f57ecf
I20260503 07:53:03.070323 1174 ts_tablet_manager.cc:1950] T feb88812c6b0459d86bd441926f57ecf P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.077405 1171 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.078965 1171 tablet_bootstrap.cc:654] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.079137 1174 tablet_replica.cc:333] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.079520 1174 raft_consensus.cc:2243] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.079888 1174 raft_consensus.cc:2272] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.080577 1174 ts_tablet_manager.cc:1916] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.087394 1166 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:03.053169 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet aaaeda1a5d6d436292cd1688f8a4d467 (table default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]) successfully deleted
I20260503 07:53:03.060070 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet e63048335fe349ebb6001b37e63a389e (table default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]) successfully deleted
I20260503 07:53:03.075137 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet feb88812c6b0459d86bd441926f57ecf (table default.Table_f758e269b4d74a1a93e7c2e458442f35 [id=07bab04461974a1088917f8c34d18388]) successfully deleted
W20260503 07:53:03.088431 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e19d7eab61e24e18a1e4eb600e9d592a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19d7eab61e24e18a1e4eb600e9d592a already in progress: creating tablet
W20260503 07:53:03.088666 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 61316b7a521e42a59bf955179b080f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61316b7a521e42a59bf955179b080f40 already in progress: creating tablet
I20260503 07:53:03.089344 757 tablet_service.cc:1511] Processing CreateTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a (DEFAULT_TABLE table=default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2 [id=b10b679b3648407097f09deb5940524f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.089504 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 949c2dc3bcb144578739aec2ea066fdf (DEFAULT_TABLE table=default.Table_3d454384a9da4ca3ae6089eac78d92a7 [id=f82999c799e0455e906f5707faa83388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.089670 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d0e93ae66c46749c4f7e9e495ae60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.089875 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949c2dc3bcb144578739aec2ea066fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.090255 1024 tablet_service.cc:1511] Processing CreateTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a (DEFAULT_TABLE table=default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2 [id=b10b679b3648407097f09deb5940524f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.090600 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d0e93ae66c46749c4f7e9e495ae60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.077270 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b7b9520e93814067a84ea66f201d3534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.092834 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7b9520e93814067a84ea66f201d3534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:03.094161 988 consensus_peers.cc:597] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.094676 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:02.997308 879 tablet_service.cc:1511] Processing CreateTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc (DEFAULT_TABLE table=default.Table_fadf876a1e6c4d0b98eec1b009f15056 [id=6b447ce3da1b4956a20a9efdf42f4c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.089848 894 tablet_service.cc:1511] Processing CreateTablet for tablet 949c2dc3bcb144578739aec2ea066fdf (DEFAULT_TABLE table=default.Table_3d454384a9da4ca3ae6089eac78d92a7 [id=f82999c799e0455e906f5707faa83388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.095618 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949c2dc3bcb144578739aec2ea066fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.095963 1174 ts_tablet_manager.cc:1929] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:03.095988 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.096244 1173 tablet_replica.cc:333] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:03.096462 1173 raft_consensus.cc:2243] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.096637 1173 raft_consensus.cc:2272] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.097311 1173 ts_tablet_manager.cc:1916] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.100383 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.101670 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:03.102785 1173 ts_tablet_manager.cc:1929] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.102885 1173 log.cc:1199] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/388c63dc20da408ca3e141ada0200be6
I20260503 07:53:03.103178 1173 ts_tablet_manager.cc:1950] T 388c63dc20da408ca3e141ada0200be6 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:03.103994 757 tablet_service.cc:1511] Processing CreateTablet for tablet 949c2dc3bcb144578739aec2ea066fdf (DEFAULT_TABLE table=default.Table_3d454384a9da4ca3ae6089eac78d92a7 [id=f82999c799e0455e906f5707faa83388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.105747 754 tablet_service.cc:1511] Processing CreateTablet for tablet 84d1372ba462479db6cf9e865c104df4 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.105803 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 84d1372ba462479db6cf9e865c104df4 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.106002 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949c2dc3bcb144578739aec2ea066fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.106164 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d1372ba462479db6cf9e865c104df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.106163 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 901759f5fd1b4ab9af876c76a14023ad (DEFAULT_TABLE table=default.Table_bf3c0bef71dd4cbb95e968ab52972f4a [id=6388a225137a49d9a5cb8b04cb505c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.106395 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d1372ba462479db6cf9e865c104df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.106637 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901759f5fd1b4ab9af876c76a14023ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:03.109395 988 consensus_peers.cc:597] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77fa106f0cc24a35bd23b457660a45dc. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.111387 1174 log.cc:1199] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/aa9153d3245f4dcfacf26f174bced2ba
I20260503 07:53:03.111738 1174 ts_tablet_manager.cc:1950] T aa9153d3245f4dcfacf26f174bced2ba P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.116245 1174 tablet_replica.cc:333] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.116433 1174 raft_consensus.cc:2243] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:03.116712 1174 raft_consensus.cc:2272] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.118119 1174 ts_tablet_manager.cc:1916] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.120046 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f8e7f2b756584f329c965e01a3205283 (DEFAULT_TABLE table=default.Table_e306b43052074e12b84b9ee8974a1001 [id=2756f98f68404a7ab0eaf02af4f1aa58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.120756 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e7f2b756584f329c965e01a3205283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.121639 1166 tablet_bootstrap.cc:654] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.104422 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 388c63dc20da408ca3e141ada0200be6 (table default.Table_2366a5c6383a445a94641d3de6d15462 [id=2f964145fadb4be9b5284c2a5bedb60b]) successfully deleted
I20260503 07:53:03.112645 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet aa9153d3245f4dcfacf26f174bced2ba (table default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]) successfully deleted
W20260503 07:53:03.122853 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08d7b172bb1d4ad1ba81e08748db4ae2 already in progress: creating tablet
W20260503 07:53:03.116816 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ae4a39d4e3a42db816e592123a6a2e7 consensus state has no leader
I20260503 07:53:03.123471 889 tablet_service.cc:1511] Processing CreateTablet for tablet 901759f5fd1b4ab9af876c76a14023ad (DEFAULT_TABLE table=default.Table_bf3c0bef71dd4cbb95e968ab52972f4a [id=6388a225137a49d9a5cb8b04cb505c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.123831 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901759f5fd1b4ab9af876c76a14023ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.124346 757 tablet_service.cc:1511] Processing CreateTablet for tablet 901759f5fd1b4ab9af876c76a14023ad (DEFAULT_TABLE table=default.Table_bf3c0bef71dd4cbb95e968ab52972f4a [id=6388a225137a49d9a5cb8b04cb505c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.124653 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901759f5fd1b4ab9af876c76a14023ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.124938 1165 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.125061 1165 ts_tablet_manager.cc:1403] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.123s user 0.015s sys 0.007s
I20260503 07:53:03.125665 1165 raft_consensus.cc:359] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.125814 1165 raft_consensus.cc:385] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.125864 1165 raft_consensus.cc:740] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.126029 1165 consensus_queue.cc:260] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.126528 1952 raft_consensus.cc:493] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.126672 1952 raft_consensus.cc:515] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.127400 1952 leader_election.cc:290] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.127895 896 tablet_service.cc:1511] Processing CreateTablet for tablet f8e7f2b756584f329c965e01a3205283 (DEFAULT_TABLE table=default.Table_e306b43052074e12b84b9ee8974a1001 [id=2756f98f68404a7ab0eaf02af4f1aa58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.127938 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028017b7cc74ef6a199d6b9e0ba6e14" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.128155 986 leader_election.cc:343] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b028017b7cc74ef6a199d6b9e0ba6e14
I20260503 07:53:03.128255 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e7f2b756584f329c965e01a3205283. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:03.128458 988 leader_election.cc:343] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.128574 988 leader_election.cc:304] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.128911 1952 raft_consensus.cc:2749] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.129220 1165 ts_tablet_manager.cc:1434] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:53:03.131073 1165 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.131529 1174 ts_tablet_manager.cc:1929] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:03.131626 1174 log.cc:1199] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f1aeea6b4ead45ef82934811494cf263
I20260503 07:53:03.131541 892 tablet_service.cc:1511] Processing CreateTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 (DEFAULT_TABLE table=default.Table_50de55ae9d5940d08b84f37e93bb41fc [id=9980e596a591423ea9dae769194c26c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.131882 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8e3c37b65a4f3b8fb3d6357af50325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.131976 1174 ts_tablet_manager.cc:1950] T f1aeea6b4ead45ef82934811494cf263 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.132871 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:53:03.134003 1165 tablet_bootstrap.cc:654] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.136348 1171 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.136593 1171 ts_tablet_manager.cc:1403] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.001s
I20260503 07:53:03.137820 1171 raft_consensus.cc:359] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.138072 1171 raft_consensus.cc:385] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.138129 1175 ts_tablet_manager.cc:1929] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.138192 1171 raft_consensus.cc:740] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.138252 1175 log.cc:1199] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:03.138602 1175 ts_tablet_manager.cc:1950] T 0e5f99c7855a4485b3523b68b0ea24c1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:03.138523 1171 consensus_queue.cc:260] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.139395 1171 ts_tablet_manager.cc:1434] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:03.139520 759 tablet_service.cc:1511] Processing CreateTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc (DEFAULT_TABLE table=default.Table_fadf876a1e6c4d0b98eec1b009f15056 [id=6b447ce3da1b4956a20a9efdf42f4c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.142978 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.144052 1952 raft_consensus.cc:493] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.144207 1952 raft_consensus.cc:515] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.144702 1952 leader_election.cc:290] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.145244 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.145726 988 leader_election.cc:343] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.146253 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.146353 754 tablet_service.cc:1511] Processing CreateTablet for tablet f8e7f2b756584f329c965e01a3205283 (DEFAULT_TABLE table=default.Table_e306b43052074e12b84b9ee8974a1001 [id=2756f98f68404a7ab0eaf02af4f1aa58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.146442 777 raft_consensus.cc:2468] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:03.146768 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e7f2b756584f329c965e01a3205283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.146904 986 leader_election.cc:304] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.147282 1952 raft_consensus.cc:2804] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.147363 1952 raft_consensus.cc:493] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.147435 1952 raft_consensus.cc:3060] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:03.147557 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6da5a4c519a249ca90c466eab47aa00b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da5a4c519a249ca90c466eab47aa00b already in progress: creating tablet
I20260503 07:53:03.147962 1174 tablet_replica.cc:333] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.148161 1174 raft_consensus.cc:2243] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.148655 1174 raft_consensus.cc:2272] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.149207 1174 ts_tablet_manager.cc:1916] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.151594 757 tablet_service.cc:1511] Processing CreateTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 (DEFAULT_TABLE table=default.Table_50de55ae9d5940d08b84f37e93bb41fc [id=9980e596a591423ea9dae769194c26c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.152012 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8e3c37b65a4f3b8fb3d6357af50325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.152191 1030 tablet_service.cc:1511] Processing CreateTablet for tablet aa0eb374ab074335807e883f1df3f998 (DEFAULT_TABLE table=default.Table_d7ed646c9f5d4a579cc52a8c314ed388 [id=b4b5323807b64df9b334d63f878f88ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.151904 1952 raft_consensus.cc:515] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.152881 892 tablet_service.cc:1511] Processing CreateTablet for tablet aa0eb374ab074335807e883f1df3f998 (DEFAULT_TABLE table=default.Table_d7ed646c9f5d4a579cc52a8c314ed388 [id=b4b5323807b64df9b334d63f878f88ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.153200 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0eb374ab074335807e883f1df3f998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.152803 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 (DEFAULT_TABLE table=default.Table_50de55ae9d5940d08b84f37e93bb41fc [id=9980e596a591423ea9dae769194c26c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.153985 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:03.154484 988 leader_election.cc:343] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.155102 1952 leader_election.cc:290] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.155272 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce181da64bad49389a64df1ade0e90ef" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:03.155470 777 raft_consensus.cc:3060] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.157804 777 raft_consensus.cc:2468] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:03.158273 986 leader_election.cc:304] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.160549 884 tablet_service.cc:1511] Processing CreateTablet for tablet 84d1372ba462479db6cf9e865c104df4 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.160955 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d1372ba462479db6cf9e865c104df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.161895 753 tablet_service.cc:1511] Processing CreateTablet for tablet aa0eb374ab074335807e883f1df3f998 (DEFAULT_TABLE table=default.Table_d7ed646c9f5d4a579cc52a8c314ed388 [id=b4b5323807b64df9b334d63f878f88ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.162238 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0eb374ab074335807e883f1df3f998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.163357 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:03.161139 1952 raft_consensus.cc:2804] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:03.165146 1952 raft_consensus.cc:697] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:03.165560 1952 consensus_queue.cc:237] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.167514 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.167682 1174 ts_tablet_manager.cc:1929] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:03.167776 1174 log.cc:1199] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/77fa106f0cc24a35bd23b457660a45dc
I20260503 07:53:03.168128 1174 ts_tablet_manager.cc:1950] T 77fa106f0cc24a35bd23b457660a45dc P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.168196 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.168605 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.171938 889 tablet_service.cc:1511] Processing CreateTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 (DEFAULT_TABLE table=default.Table_5963a9665ae24475a6510b9aa2541706 [id=fa2ee9dfae294d2383a2b9a6a64e7578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.172427 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648cf6a6c774c05a427a5c1344bfb77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.172420 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 (DEFAULT_TABLE table=default.Table_5963a9665ae24475a6510b9aa2541706 [id=fa2ee9dfae294d2383a2b9a6a64e7578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.174378 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 77fa106f0cc24a35bd23b457660a45dc (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
I20260503 07:53:03.174902 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 (DEFAULT_TABLE table=default.Table_5963a9665ae24475a6510b9aa2541706 [id=fa2ee9dfae294d2383a2b9a6a64e7578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.175391 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648cf6a6c774c05a427a5c1344bfb77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.175740 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6720679e01e44baaa1501c8dbadba08a (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.176309 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720679e01e44baaa1501c8dbadba08a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:03.182627 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b435d9b81275447189fba50c82258955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b435d9b81275447189fba50c82258955 already in progress: creating tablet
I20260503 07:53:03.182950 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 6720679e01e44baaa1501c8dbadba08a (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:03.183275 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e1efb53c5e184a618316a759b8e7d38e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1efb53c5e184a618316a759b8e7d38e already in progress: creating tablet
W20260503 07:53:03.183854 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e2dcbb5010e346fca99dffdbdbb337f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2dcbb5010e346fca99dffdbdbb337f4 already in progress: creating tablet
W20260503 07:53:03.184661 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f4fd9524157c4225885a1f1831982faa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4fd9524157c4225885a1f1831982faa already in progress: creating tablet
I20260503 07:53:03.184656 753 tablet_service.cc:1511] Processing CreateTablet for tablet 6720679e01e44baaa1501c8dbadba08a (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.184962 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720679e01e44baaa1501c8dbadba08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.184963 1174 tablet_replica.cc:333] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.187706 1174 raft_consensus.cc:2243] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.187896 1174 raft_consensus.cc:2272] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.188476 1174 ts_tablet_manager.cc:1916] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.191239 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6a83a0efd1fd4fe8b079754da0fa9972 (DEFAULT_TABLE table=default.Table_afc1e4ba984b4535aacfca7a13f3a0f9 [id=a12a1f9cea1d4d709c8ca4d7ba6cc3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.191565 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a83a0efd1fd4fe8b079754da0fa9972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.196785 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6a83a0efd1fd4fe8b079754da0fa9972 (DEFAULT_TABLE table=default.Table_afc1e4ba984b4535aacfca7a13f3a0f9 [id=a12a1f9cea1d4d709c8ca4d7ba6cc3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.197799 753 tablet_service.cc:1511] Processing CreateTablet for tablet 6a83a0efd1fd4fe8b079754da0fa9972 (DEFAULT_TABLE table=default.Table_afc1e4ba984b4535aacfca7a13f3a0f9 [id=a12a1f9cea1d4d709c8ca4d7ba6cc3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.198119 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a83a0efd1fd4fe8b079754da0fa9972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.200464 1174 ts_tablet_manager.cc:1929] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.200644 1174 log.cc:1199] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/fb821b329d284643a889b07f9a4f287e
I20260503 07:53:03.200989 1174 ts_tablet_manager.cc:1950] T fb821b329d284643a889b07f9a4f287e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.201922 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet fb821b329d284643a889b07f9a4f287e (table default.Table_f3f0440daf4a4fe89f92e6c20afef7e5 [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:53:03.202261 1174 tablet_replica.cc:333] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.202468 1174 raft_consensus.cc:2243] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.210305 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_641a845999b54069807be5903205cfcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.210857 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_641a845999b54069807be5903205cfcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.212101 1174 raft_consensus.cc:2272] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.212502 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 388c63dc20da408ca3e141ada0200be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.212970 1174 ts_tablet_manager.cc:1916] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:03.213251 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 388c63dc20da408ca3e141ada0200be6 because the tablet was not found. No further retry: Not found: Tablet not found: 388c63dc20da408ca3e141ada0200be6
I20260503 07:53:03.214036 601 master_service.cc:954] ReplaceTablet: received request to replace tablet ab33d15e70ec4856a15ed7c6175cd334 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.214557 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 6fb49d5b35994fe9b383b72f77eaebb6 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.218389 1174 ts_tablet_manager.cc:1929] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.218783 1174 log.cc:1199] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:03.220177 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5731f3196e2486597f0b6c4f0855c20" } modify_external_catalogs: true
I20260503 07:53:03.220364 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f5731f3196e2486597f0b6c4f0855c20" } modify_external_catalogs: true
I20260503 07:53:03.222939 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 01319ce0cb1c4be7b53b952d50fd1cc1 (DEFAULT_TABLE table=default.Table_123af1899c15436d972ab19727e939b4 [id=7cb2040787df449a9e0fc9e996c50279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.223479 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 9207707e4ce14e70a6df9578c6bd54b6 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.223977 894 tablet_service.cc:1511] Processing CreateTablet for tablet ee30917dbe6740148461fca8ceab4510 (DEFAULT_TABLE table=default.Table_beba5c7824814c2c9032f691c03cfe49 [id=a402ee9fdd554733ad7ef59cfc14ae44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.224406 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee30917dbe6740148461fca8ceab4510. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:03.225603 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 2938683f48cc45fca87f01e4aec9e6b9 (table default.Table_30fb89cc2aa04ab2bff3ca1557627122 [id=ba66a930a3104ecc802bd8265365009a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2938683f48cc45fca87f01e4aec9e6b9 consensus state has no leader
I20260503 07:53:03.221925 1165 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.227453 1165 ts_tablet_manager.cc:1403] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.002s
I20260503 07:53:03.228422 1165 raft_consensus.cc:359] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.228650 1165 raft_consensus.cc:385] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:53:03.229732 988 consensus_peers.cc:597] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.230098 1165 raft_consensus.cc:740] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.230422 1165 consensus_queue.cc:260] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.230944 1165 ts_tablet_manager.cc:1434] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:03.233774 1165 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.235675 754 tablet_service.cc:1511] Processing CreateTablet for tablet 01319ce0cb1c4be7b53b952d50fd1cc1 (DEFAULT_TABLE table=default.Table_123af1899c15436d972ab19727e939b4 [id=7cb2040787df449a9e0fc9e996c50279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.236016 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01319ce0cb1c4be7b53b952d50fd1cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.238759 1165 tablet_bootstrap.cc:654] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.240574 1166 tablet_bootstrap.cc:492] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:03.240924 1166 ts_tablet_manager.cc:1403] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.154s user 0.003s sys 0.001s
I20260503 07:53:03.239094 1174 ts_tablet_manager.cc:1950] T 8fb4d150eadb479d9978f2450637bd3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.241653 1166 raft_consensus.cc:359] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.241818 1166 raft_consensus.cc:385] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.241884 1166 raft_consensus.cc:740] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.242101 1166 consensus_queue.cc:260] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.242475 1029 tablet_service.cc:1511] Processing CreateTablet for tablet ee30917dbe6740148461fca8ceab4510 (DEFAULT_TABLE table=default.Table_beba5c7824814c2c9032f691c03cfe49 [id=a402ee9fdd554733ad7ef59cfc14ae44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.242731 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8fb4d150eadb479d9978f2450637bd3e (table default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]) successfully deleted
I20260503 07:53:03.243009 757 tablet_service.cc:1511] Processing CreateTablet for tablet ee30917dbe6740148461fca8ceab4510 (DEFAULT_TABLE table=default.Table_beba5c7824814c2c9032f691c03cfe49 [id=a402ee9fdd554733ad7ef59cfc14ae44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.243332 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee30917dbe6740148461fca8ceab4510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.243726 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2938683f48cc45fca87f01e4aec9e6b9 (DEFAULT_TABLE table=default.Table_30fb89cc2aa04ab2bff3ca1557627122 [id=ba66a930a3104ecc802bd8265365009a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.244030 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2938683f48cc45fca87f01e4aec9e6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.246696 1166 ts_tablet_manager.cc:1434] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:53:03.246955 1166 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:03.248373 1952 raft_consensus.cc:493] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.248525 1952 raft_consensus.cc:515] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.249168 1952 leader_election.cc:290] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:03.249866 986 leader_election.cc:343] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:53:03.250207 1174 tablet_replica.cc:333] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.250242 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75419ed8fabc4c36ae2d2b128ec4f5b5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.250452 1174 raft_consensus.cc:2243] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.250626 1174 raft_consensus.cc:2272] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:03.250909 988 leader_election.cc:343] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.251044 988 leader_election.cc:304] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.251439 1174 ts_tablet_manager.cc:1916] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.251449 1952 raft_consensus.cc:2749] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.254472 889 tablet_service.cc:1511] Processing CreateTablet for tablet 01319ce0cb1c4be7b53b952d50fd1cc1 (DEFAULT_TABLE table=default.Table_123af1899c15436d972ab19727e939b4 [id=7cb2040787df449a9e0fc9e996c50279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.254853 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01319ce0cb1c4be7b53b952d50fd1cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.256399 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2938683f48cc45fca87f01e4aec9e6b9 (DEFAULT_TABLE table=default.Table_30fb89cc2aa04ab2bff3ca1557627122 [id=ba66a930a3104ecc802bd8265365009a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.258697 757 tablet_service.cc:1511] Processing CreateTablet for tablet 37cc1d6810594735bf78bd2de7e09755 (DEFAULT_TABLE table=default.Table_94433405f3d44e7f871bbc04f66d0033 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.258977 753 tablet_service.cc:1511] Processing CreateTablet for tablet 2938683f48cc45fca87f01e4aec9e6b9 (DEFAULT_TABLE table=default.Table_30fb89cc2aa04ab2bff3ca1557627122 [id=ba66a930a3104ecc802bd8265365009a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.259368 892 tablet_service.cc:1511] Processing CreateTablet for tablet 37cc1d6810594735bf78bd2de7e09755 (DEFAULT_TABLE table=default.Table_94433405f3d44e7f871bbc04f66d0033 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.259054 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cc1d6810594735bf78bd2de7e09755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.259745 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2938683f48cc45fca87f01e4aec9e6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.261265 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cc1d6810594735bf78bd2de7e09755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.264715 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 37cc1d6810594735bf78bd2de7e09755 (DEFAULT_TABLE table=default.Table_94433405f3d44e7f871bbc04f66d0033 [id=fb981378f93e4607a396da55a13aa560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.265797 894 tablet_service.cc:1511] Processing CreateTablet for tablet 52f0f9d823134a7e87f3f4b6af7211a3 (DEFAULT_TABLE table=default.Table_f4fac070ce05432a81a7eb6efaee5edc [id=b863e6aa3b114796a5dbfa4a4fff9e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.266151 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f0f9d823134a7e87f3f4b6af7211a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.267490 1165 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.267656 1165 ts_tablet_manager.cc:1403] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.004s
I20260503 07:53:03.268605 1165 raft_consensus.cc:359] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.268802 1165 raft_consensus.cc:385] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.268898 1165 raft_consensus.cc:740] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.269258 1165 consensus_queue.cc:260] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.269732 1165 ts_tablet_manager.cc:1434] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:03.270780 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8e3c37b65a4f3b8fb3d6357af50325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.276470 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 52f0f9d823134a7e87f3f4b6af7211a3 (DEFAULT_TABLE table=default.Table_f4fac070ce05432a81a7eb6efaee5edc [id=b863e6aa3b114796a5dbfa4a4fff9e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.277671 1171 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.279120 1165 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.279762 1171 tablet_bootstrap.cc:654] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.280473 1165 tablet_bootstrap.cc:654] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.280721 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 682) took 1328 ms. Trace:
I20260503 07:53:03.280829 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee30917dbe6740148461fca8ceab4510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.280897 1175 rpcz_store.cc:276] 0503 07:53:01.952459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.960136 (+ 7677us) service_pool.cc:224] Handling call
0503 07:53:03.053158 (+1093022us) ts_tablet_manager.cc:1151] Deleting tablet 0e5f99c7855a4485b3523b68b0ea24c1
0503 07:53:03.053167 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.060470 (+ 7303us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:03.138051 (+ 77581us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:03.280673 (+142622us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092808}
I20260503 07:53:03.281360 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 688) took 1315 ms. Trace:
I20260503 07:53:03.281420 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 0e5f99c7855a4485b3523b68b0ea24c1 (table default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]) successfully deleted
I20260503 07:53:03.281455 1175 rpcz_store.cc:276] 0503 07:53:01.965964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.973736 (+ 7772us) service_pool.cc:224] Handling call
0503 07:53:03.281184 (+1307448us) ts_tablet_manager.cc:1151] Deleting tablet 6eb7486acc6a49dba0295ee26ac68724
0503 07:53:03.281192 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.281324 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1307202}
I20260503 07:53:03.281005 1174 ts_tablet_manager.cc:1929] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.281613 1174 log.cc:1199] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ab33d15e70ec4856a15ed7c6175cd334
I20260503 07:53:03.281772 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 692) took 1271 ms. Trace:
I20260503 07:53:03.281867 1174 ts_tablet_manager.cc:1950] T ab33d15e70ec4856a15ed7c6175cd334 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:03.281898 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6eb7486acc6a49dba0295ee26ac68724 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eb7486acc6a49dba0295ee26ac68724 already in progress: creating tablet
I20260503 07:53:03.281875 1175 rpcz_store.cc:276] 0503 07:53:02.010018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.010290 (+ 272us) service_pool.cc:224] Handling call
0503 07:53:03.281648 (+1271358us) ts_tablet_manager.cc:1151] Deleting tablet f3cfc39292764a93a7cbb7c83f11e179
0503 07:53:03.281658 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.281732 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271186}
W20260503 07:53:03.282234 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f3cfc39292764a93a7cbb7c83f11e179 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cfc39292764a93a7cbb7c83f11e179 already in progress: creating tablet
I20260503 07:53:03.282541 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 694) took 1255 ms. Trace:
I20260503 07:53:03.282660 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ab33d15e70ec4856a15ed7c6175cd334 (table default.Table_dad6c6e91b084308a94abf81b5c120a3 [id=cb3204cb6061405bb6a2cdff89916775]) successfully deleted
I20260503 07:53:03.282627 1175 rpcz_store.cc:276] 0503 07:53:02.026937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.026991 (+ 54us) service_pool.cc:224] Handling call
0503 07:53:03.282423 (+1255432us) ts_tablet_manager.cc:1151] Deleting tablet ca0c330e729d4314ae8d312b321992a6
0503 07:53:03.282431 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.282501 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255231}
I20260503 07:53:03.282912 1174 tablet_replica.cc:333] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:03.282995 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ca0c330e729d4314ae8d312b321992a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca0c330e729d4314ae8d312b321992a6 already in progress: creating tablet
I20260503 07:53:03.283061 1174 raft_consensus.cc:2243] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:03.283243 1174 pending_rounds.cc:70] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:03.283277 1174 pending_rounds.cc:77] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847430794309632 op_type: NO_OP noop_request { }
I20260503 07:53:03.283335 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 697) took 1200 ms. Trace:
I20260503 07:53:03.283365 1174 raft_consensus.cc:2889] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:03.283427 1174 raft_consensus.cc:2272] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.283433 1175 rpcz_store.cc:276] 0503 07:53:02.082728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.092438 (+ 9710us) service_pool.cc:224] Handling call
0503 07:53:03.283198 (+1190760us) ts_tablet_manager.cc:1151] Deleting tablet 822c15b68f61466584eec0702196a5c5
0503 07:53:03.283205 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.283276 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190514}
W20260503 07:53:03.283862 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 822c15b68f61466584eec0702196a5c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 822c15b68f61466584eec0702196a5c5 already in progress: creating tablet
I20260503 07:53:03.284438 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cc1d6810594735bf78bd2de7e09755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.284673 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 702) took 1099 ms. Trace:
I20260503 07:53:03.284767 1175 rpcz_store.cc:276] 0503 07:53:02.185490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.185538 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:03.284064 (+1098526us) ts_tablet_manager.cc:1151] Deleting tablet 18523493ee4841cb8949826239e2e458
0503 07:53:03.284072 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.284637 (+ 565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1098369}
W20260503 07:53:03.285166 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 18523493ee4841cb8949826239e2e458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18523493ee4841cb8949826239e2e458 already in progress: creating tablet
I20260503 07:53:03.288858 1952 consensus_queue.cc:1048] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:03.291920 757 tablet_service.cc:1511] Processing CreateTablet for tablet 52f0f9d823134a7e87f3f4b6af7211a3 (DEFAULT_TABLE table=default.Table_f4fac070ce05432a81a7eb6efaee5edc [id=b863e6aa3b114796a5dbfa4a4fff9e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.292526 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f0f9d823134a7e87f3f4b6af7211a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.293664 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 07228cdc4a2b4ab7879abadbc5875e23 (DEFAULT_TABLE table=default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49 [id=0c4d848dca8748098bf95a46cc7cc082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.296398 1018 tablet_service.cc:1511] Processing CreateTablet for tablet e3375914e0d14e709d3e81787bb7f0bc (DEFAULT_TABLE table=default.Table_89fd388c703543638201c6d69055cb8b [id=1676e47abbd64d20b445ee055e8e274a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.297511 600 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 6840aeb0532c43738cb868a0fc48f70c
I20260503 07:53:03.298450 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a0e9349f195a406083c9a7e1432f1237
I20260503 07:53:03.300750 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:03.301484 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 (DEFAULT_TABLE table=default.Table_bec8690e29ea4e8382846d3c96263603 [id=62bb06e087db4a5483632d19786f3e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.301899 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebe35052c634a8baa45fe333d46baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.301909 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e9349f195a406083c9a7e1432f1237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.302316 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 (DEFAULT_TABLE table=default.Table_bec8690e29ea4e8382846d3c96263603 [id=62bb06e087db4a5483632d19786f3e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.302687 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebe35052c634a8baa45fe333d46baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.300094 758 tablet_service.cc:1511] Processing CreateTablet for tablet e3375914e0d14e709d3e81787bb7f0bc (DEFAULT_TABLE table=default.Table_89fd388c703543638201c6d69055cb8b [id=1676e47abbd64d20b445ee055e8e274a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.306931 1171 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.307019 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3375914e0d14e709d3e81787bb7f0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.307076 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e9349f195a406083c9a7e1432f1237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.307226 1171 ts_tablet_manager.cc:1403] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.003s
I20260503 07:53:03.307447 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 (DEFAULT_TABLE table=default.Table_bec8690e29ea4e8382846d3c96263603 [id=62bb06e087db4a5483632d19786f3e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.309033 1171 raft_consensus.cc:359] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.309403 1171 raft_consensus.cc:385] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.309581 1171 raft_consensus.cc:740] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.309691 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e9349f195a406083c9a7e1432f1237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:03.310411 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a0e9349f195a406083c9a7e1432f1237 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e9349f195a406083c9a7e1432f1237 already in progress: creating tablet
I20260503 07:53:03.310799 1171 consensus_queue.cc:260] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.311662 750 tablet_service.cc:1511] Processing CreateTablet for tablet 899976aadc9d4ae8be4dc245cfb00cac (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.311975 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899976aadc9d4ae8be4dc245cfb00cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.311977 2113 raft_consensus.cc:493] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.312450 2113 raft_consensus.cc:515] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.312507 1171 ts_tablet_manager.cc:1434] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:53:03.312502 879 tablet_service.cc:1511] Processing CreateTablet for tablet e3375914e0d14e709d3e81787bb7f0bc (DEFAULT_TABLE table=default.Table_89fd388c703543638201c6d69055cb8b [id=1676e47abbd64d20b445ee055e8e274a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.312836 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3375914e0d14e709d3e81787bb7f0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.313087 2113 leader_election.cc:290] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:03.313549 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ea29e3b4a84735bb3723dd11449ec3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.313724 986 leader_election.cc:343] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 16ea29e3b4a84735bb3723dd11449ec3
W20260503 07:53:03.313956 988 leader_election.cc:343] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.314057 988 leader_election.cc:304] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.314517 2113 raft_consensus.cc:2749] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.314862 896 tablet_service.cc:1511] Processing CreateTablet for tablet 899976aadc9d4ae8be4dc245cfb00cac (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.315167 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899976aadc9d4ae8be4dc245cfb00cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.315642 884 tablet_service.cc:1511] Processing CreateTablet for tablet 07228cdc4a2b4ab7879abadbc5875e23 (DEFAULT_TABLE table=default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49 [id=0c4d848dca8748098bf95a46cc7cc082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.315960 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07228cdc4a2b4ab7879abadbc5875e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.325937 1166 tablet_bootstrap.cc:654] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.328737 1175 tablet_replica.cc:333] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:53:03.328838 986 consensus_peers.cc:597] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa9153d3245f4dcfacf26f174bced2ba. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.329218 1174 ts_tablet_manager.cc:1916] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.331208 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648cf6a6c774c05a427a5c1344bfb77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.335961 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 899976aadc9d4ae8be4dc245cfb00cac (DEFAULT_TABLE table=default.Table_16adf807c53c4ed09bdfadfd1d27511e [id=2121e3dad6c843678264c482b42b1047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.336345 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899976aadc9d4ae8be4dc245cfb00cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.336530 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01319ce0cb1c4be7b53b952d50fd1cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.337760 1165 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.338034 1165 ts_tablet_manager.cc:1403] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.000s
I20260503 07:53:03.338725 1165 raft_consensus.cc:359] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.338866 1165 raft_consensus.cc:385] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.338914 1165 raft_consensus.cc:740] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.339092 1165 consensus_queue.cc:260] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.339622 1165 ts_tablet_manager.cc:1434] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:03.339947 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2938683f48cc45fca87f01e4aec9e6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.340787 1174 ts_tablet_manager.cc:1929] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:03.340865 1174 log.cc:1199] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/92c1709a2a49475daaa2372360610b1e
I20260503 07:53:03.341172 1174 ts_tablet_manager.cc:1950] T 92c1709a2a49475daaa2372360610b1e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.344277 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9965fee9d08749b6b39c82e99fdcfbef (DEFAULT_TABLE table=default.Table_ad22db3dd7be4ad6857b954e72ad22f0 [id=ba33f748d1214201887ddc60fa72ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.344517 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9965fee9d08749b6b39c82e99fdcfbef (DEFAULT_TABLE table=default.Table_ad22db3dd7be4ad6857b954e72ad22f0 [id=ba33f748d1214201887ddc60fa72ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.345311 1952 consensus_queue.cc:1048] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:53:03.345317 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9965fee9d08749b6b39c82e99fdcfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.348304 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720679e01e44baaa1501c8dbadba08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.351521 1952 consensus_queue.cc:1048] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:03.352312 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a83a0efd1fd4fe8b079754da0fa9972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.353263 896 tablet_service.cc:1511] Processing CreateTablet for tablet 703363a7e1544cf694ab05dab855d1d4 (DEFAULT_TABLE table=default.Table_8feb829fa26149529dfedfed7c5679ae [id=2dfe869c76f44a9492d3fe627cf4540d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.353987 1165 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.354523 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 92c1709a2a49475daaa2372360610b1e (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
W20260503 07:53:03.354974 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet a0e9349f195a406083c9a7e1432f1237 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e9349f195a406083c9a7e1432f1237 already in progress: creating tablet
I20260503 07:53:03.356289 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f0f9d823134a7e87f3f4b6af7211a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.356407 1165 tablet_bootstrap.cc:654] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:03.358600 988 consensus_peers.cc:597] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.362728 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9965fee9d08749b6b39c82e99fdcfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.363937 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0eb374ab074335807e883f1df3f998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.365739 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703363a7e1544cf694ab05dab855d1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.368395 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07228cdc4a2b4ab7879abadbc5875e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.369544 750 tablet_service.cc:1511] Processing CreateTablet for tablet 703363a7e1544cf694ab05dab855d1d4 (DEFAULT_TABLE table=default.Table_8feb829fa26149529dfedfed7c5679ae [id=2dfe869c76f44a9492d3fe627cf4540d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.369877 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703363a7e1544cf694ab05dab855d1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.370826 1165 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.370820 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1db37f124b3547bd918f509ef0e780b9 (DEFAULT_TABLE table=default.Table_cf0fc71afa81460c80b460e39722d398 [id=4fd4ac6125854081bc9fdee16f6fce90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.371016 1165 ts_tablet_manager.cc:1403] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260503 07:53:03.371168 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db37f124b3547bd918f509ef0e780b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.372452 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3375914e0d14e709d3e81787bb7f0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.372740 1171 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.372838 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebe35052c634a8baa45fe333d46baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.372109 1165 raft_consensus.cc:359] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.374567 1171 tablet_bootstrap.cc:654] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.376873 2082 raft_consensus.cc:493] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.376991 2082 raft_consensus.cc:515] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.377579 2082 leader_election.cc:290] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.372917 1165 raft_consensus.cc:385] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.377748 1165 raft_consensus.cc:740] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:53:03.379081 854 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:03.378682 1165 consensus_queue.cc:260] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:03.379436 851 leader_election.cc:343] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:03.379519 851 leader_election.cc:304] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.380013 2082 raft_consensus.cc:2749] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.381224 1165 ts_tablet_manager.cc:1434] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260503 07:53:03.382875 1165 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.384611 1171 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.384825 1171 ts_tablet_manager.cc:1403] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260503 07:53:03.386711 1171 raft_consensus.cc:359] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.387009 1171 raft_consensus.cc:385] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.387131 1171 raft_consensus.cc:740] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.387640 1171 consensus_queue.cc:260] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.388494 1171 ts_tablet_manager.cc:1434] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260503 07:53:03.389072 1171 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.392786 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 703363a7e1544cf694ab05dab855d1d4 (DEFAULT_TABLE table=default.Table_8feb829fa26149529dfedfed7c5679ae [id=2dfe869c76f44a9492d3fe627cf4540d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.393251 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9965fee9d08749b6b39c82e99fdcfbef (DEFAULT_TABLE table=default.Table_ad22db3dd7be4ad6857b954e72ad22f0 [id=ba33f748d1214201887ddc60fa72ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.393429 1171 tablet_bootstrap.cc:654] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.393707 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9965fee9d08749b6b39c82e99fdcfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.394948 1165 tablet_bootstrap.cc:654] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.398654 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703363a7e1544cf694ab05dab855d1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.407043 1171 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.406991 1165 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.407375 1165 ts_tablet_manager.cc:1403] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.002s
I20260503 07:53:03.407428 1171 ts_tablet_manager.cc:1403] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20260503 07:53:03.408267 1978 raft_consensus.cc:493] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.408396 1978 raft_consensus.cc:515] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.408987 1978 leader_election.cc:290] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.409297 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.409559 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.409816 715 leader_election.cc:343] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:03.410116 716 leader_election.cc:343] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.410211 716 leader_election.cc:304] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.410565 1978 raft_consensus.cc:2749] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.411275 2113 raft_consensus.cc:493] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.411383 2113 raft_consensus.cc:515] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.412209 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.411722 1165 raft_consensus.cc:359] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.411780 1171 raft_consensus.cc:359] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:03.412679 988 leader_election.cc:343] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.412608 1165 raft_consensus.cc:385] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.412751 1171 raft_consensus.cc:385] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.413466 2113 leader_election.cc:290] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.413537 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.413698 777 raft_consensus.cc:2468] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:03.413352 1165 raft_consensus.cc:740] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.413501 1171 raft_consensus.cc:740] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.414108 986 leader_election.cc:304] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.414503 2113 raft_consensus.cc:2804] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.414590 2113 raft_consensus.cc:493] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.414669 2113 raft_consensus.cc:3060] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.414894 1165 consensus_queue.cc:260] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.415059 1171 consensus_queue.cc:260] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.417351 1165 ts_tablet_manager.cc:1434] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:53:03.417410 1171 ts_tablet_manager.cc:1434] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260503 07:53:03.418677 2113 raft_consensus.cc:515] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.419394 1165 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.419458 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:03.419620 1171 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:03.419844 988 leader_election.cc:343] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.420414 2113 leader_election.cc:290] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.420560 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0487d02934453fbb25104f3b8fe732" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:03.420718 777 raft_consensus.cc:3060] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.423413 777 raft_consensus.cc:2468] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:03.425859 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 596130e78eb1444a96480fc1075478cd from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.426317 986 leader_election.cc:304] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.430711 597 catalog_manager.cc:5671] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:03.431156 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:03.431365 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:03.432798 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1db37f124b3547bd918f509ef0e780b9 (DEFAULT_TABLE table=default.Table_cf0fc71afa81460c80b460e39722d398 [id=4fd4ac6125854081bc9fdee16f6fce90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.433180 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db37f124b3547bd918f509ef0e780b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.433380 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11bde1b76bf54bf19be5e9f545931bf5" } modify_external_catalogs: true
I20260503 07:53:03.433559 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11bde1b76bf54bf19be5e9f545931bf5" } modify_external_catalogs: true
I20260503 07:53:03.434768 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_698bd4594c51474d957b3e47aaa43b4f" } modify_external_catalogs: true
I20260503 07:53:03.434911 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_698bd4594c51474d957b3e47aaa43b4f" } modify_external_catalogs: true
I20260503 07:53:03.436030 757 tablet_service.cc:1511] Processing CreateTablet for tablet e66033d0ee71439cba1545815aa5213f (DEFAULT_TABLE table=default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4 [id=8b5de14ec21041d397925c12452b2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.436412 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66033d0ee71439cba1545815aa5213f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.436614 885 tablet_service.cc:1511] Processing CreateTablet for tablet e66033d0ee71439cba1545815aa5213f (DEFAULT_TABLE table=default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4 [id=8b5de14ec21041d397925c12452b2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.436937 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 1db37f124b3547bd918f509ef0e780b9 (DEFAULT_TABLE table=default.Table_cf0fc71afa81460c80b460e39722d398 [id=4fd4ac6125854081bc9fdee16f6fce90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.437103 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66033d0ee71439cba1545815aa5213f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.437269 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db37f124b3547bd918f509ef0e780b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.440354 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1a7c4a465cba4f08bf124f943b9de29d" } new_table_name: "default.Table_bf1f9987b1fd4d8faa7ba3073334730d" modify_external_catalogs: true
I20260503 07:53:03.440371 759 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa92517beb4622bdfa3fd824e78648 (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.440675 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa92517beb4622bdfa3fd824e78648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.440888 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.441118 1173 tablet_replica.cc:333] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:03.441279 1173 raft_consensus.cc:2243] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.441406 1173 raft_consensus.cc:2272] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.441779 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d4f4e33c65524d7c8a4647b7e648f9f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.442303 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4f4e33c65524d7c8a4647b7e648f9f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.442855 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:03.443071 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:03.444443 1173 ts_tablet_manager.cc:1916] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.444531 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.445211 1174 tablet_replica.cc:333] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.445369 1174 raft_consensus.cc:2243] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.445492 1174 raft_consensus.cc:2272] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.445847 894 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa92517beb4622bdfa3fd824e78648 (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.446166 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa92517beb4622bdfa3fd824e78648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.446606 1174 ts_tablet_manager.cc:1916] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.451835 1174 ts_tablet_manager.cc:1929] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.451913 1174 log.cc:1199] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ebec2b05025444ccaf0bf0bb4ab62dae
I20260503 07:53:03.454270 1173 ts_tablet_manager.cc:1929] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.454366 1173 log.cc:1199] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:03.454320 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ff1d642f7a1246b0854a16320e21497c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.454890 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff1d642f7a1246b0854a16320e21497c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.455000 1173 ts_tablet_manager.cc:1950] T 4674c22562f744f5bce13d97ad8a52b2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:03.455538 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 4674c22562f744f5bce13d97ad8a52b2 (table default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]) successfully deleted
I20260503 07:53:03.456501 892 tablet_service.cc:1511] Processing CreateTablet for tablet 8160807f463042e7bd65ba846a726922 (DEFAULT_TABLE table=default.Table_ad3393d69e914af6bc8c5f82b09418ab [id=79afac52da874d45a98b98558541bdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.452162 1174 ts_tablet_manager.cc:1950] T ebec2b05025444ccaf0bf0bb4ab62dae P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.456847 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8160807f463042e7bd65ba846a726922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.455592 750 tablet_service.cc:1511] Processing CreateTablet for tablet 8160807f463042e7bd65ba846a726922 (DEFAULT_TABLE table=default.Table_ad3393d69e914af6bc8c5f82b09418ab [id=79afac52da874d45a98b98558541bdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.457525 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ebec2b05025444ccaf0bf0bb4ab62dae (table default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]) successfully deleted
I20260503 07:53:03.457914 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8160807f463042e7bd65ba846a726922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.461102 880 tablet_service.cc:1511] Processing CreateTablet for tablet 52b467f800704c88bd176c3a0c0c8b51 (DEFAULT_TABLE table=default.Table_397f26889e7d46759abaaeb160796c0a [id=f782ae772802488ebdd54e805314589c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.461439 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b467f800704c88bd176c3a0c0c8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.441004 1171 tablet_bootstrap.cc:654] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.464377 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e66033d0ee71439cba1545815aa5213f (DEFAULT_TABLE table=default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4 [id=8b5de14ec21041d397925c12452b2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.465917 1165 tablet_bootstrap.cc:654] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.472530 1978 raft_consensus.cc:493] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.472643 1978 raft_consensus.cc:515] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.472838 1171 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.472944 1171 ts_tablet_manager.cc:1403] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.003s
I20260503 07:53:03.473271 1978 leader_election.cc:290] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.474186 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.474561 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.475131 716 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:03.475512 715 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.475600 715 leader_election.cc:304] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.475975 1978 raft_consensus.cc:2749] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.445537 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:03.479652 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66033d0ee71439cba1545815aa5213f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.445601 2113 raft_consensus.cc:2804] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:53:03.462623 986 consensus_peers.cc:597] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77fa106f0cc24a35bd23b457660a45dc. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:03.484086 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:03.460453 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8160807f463042e7bd65ba846a726922 (DEFAULT_TABLE table=default.Table_ad3393d69e914af6bc8c5f82b09418ab [id=79afac52da874d45a98b98558541bdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.488306 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8160807f463042e7bd65ba846a726922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.490607 601 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet dfd331f7e6fd4719b9ee6b396446152a
I20260503 07:53:03.490746 1171 raft_consensus.cc:359] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.490917 1171 raft_consensus.cc:385] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.490968 1171 raft_consensus.cc:740] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.488512 2113 raft_consensus.cc:697] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:03.491325 2113 consensus_queue.cc:237] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.491583 1171 consensus_queue.cc:260] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.497524 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:03.497954 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:03.500313 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.500566 1174 tablet_replica.cc:333] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.500766 1174 raft_consensus.cc:2243] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.500763 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.500937 1174 raft_consensus.cc:2272] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.501618 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c8fc879134dd44bcbe3691c18e4f71ec" } new_table_name: "default.Table_096b6f6990bb4089a2fb69c42199ecad" modify_external_catalogs: true
I20260503 07:53:03.501734 1174 ts_tablet_manager.cc:1916] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.502781 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 4674c22562f744f5bce13d97ad8a52b2 with delete_type TABLET_DATA_DELETED (replaced by tablet f4fd9524157c4225885a1f1831982faa) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:03.503427 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 4674c22562f744f5bce13d97ad8a52b2 because the tablet was not found. No further retry: Not found: Tablet not found: 4674c22562f744f5bce13d97ad8a52b2
I20260503 07:53:03.503998 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a5cc2b29a6234b95bb78235232b7ee7c" } new_table_name: "default.Table_6cb608facc89412eafb322ecd2f41590" modify_external_catalogs: true
I20260503 07:53:03.508687 1171 ts_tablet_manager.cc:1434] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260503 07:53:03.509076 1171 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.510502 1171 tablet_bootstrap.cc:654] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.513518 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6fb49d5b35994fe9b383b72f77eaebb6
I20260503 07:53:03.514420 592 catalog_manager.cc:6741] ReplaceTablet: tablet 6fb49d5b35994fe9b383b72f77eaebb6 deleted and replaced by tablet 4db7807a41124ed192096d89fd740ddf
I20260503 07:53:03.515257 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9207707e4ce14e70a6df9578c6bd54b6
I20260503 07:53:03.515646 595 catalog_manager.cc:6741] ReplaceTablet: tablet 9207707e4ce14e70a6df9578c6bd54b6 deleted and replaced by tablet edfe937339914b29afbceb9cd3cd7c1c
I20260503 07:53:03.520015 1174 ts_tablet_manager.cc:1929] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.520205 1174 log.cc:1199] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:03.520637 1174 ts_tablet_manager.cc:1950] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.523963 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9a23702aa5493ea8712f904af96755 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.524017 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4db7807a41124ed192096d89fd740ddf) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.524322 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9a23702aa5493ea8712f904af96755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.524583 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 with delete_type TABLET_DATA_DELETED (replaced by tablet edfe937339914b29afbceb9cd3cd7c1c) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.524580 753 tablet_service.cc:1511] Processing CreateTablet for tablet 52b467f800704c88bd176c3a0c0c8b51 (DEFAULT_TABLE table=default.Table_397f26889e7d46759abaaeb160796c0a [id=f782ae772802488ebdd54e805314589c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.524909 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b467f800704c88bd176c3a0c0c8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.528278 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 with delete_type TABLET_DATA_DELETED (replaced by tablet edfe937339914b29afbceb9cd3cd7c1c) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.528684 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 52b467f800704c88bd176c3a0c0c8b51 (DEFAULT_TABLE table=default.Table_397f26889e7d46759abaaeb160796c0a [id=f782ae772802488ebdd54e805314589c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.529181 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b467f800704c88bd176c3a0c0c8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.531405 1171 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.531535 1171 ts_tablet_manager.cc:1403] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260503 07:53:03.532341 1171 raft_consensus.cc:359] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.532495 1171 raft_consensus.cc:385] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.532542 1171 raft_consensus.cc:740] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.532778 1171 consensus_queue.cc:260] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.533267 1171 ts_tablet_manager.cc:1434] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:03.533540 1171 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.534773 1171 tablet_bootstrap.cc:654] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.532835 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9a23702aa5493ea8712f904af96755 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.535383 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9a23702aa5493ea8712f904af96755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.537272 750 tablet_service.cc:1511] Processing CreateTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 (DEFAULT_TABLE table=default.Table_80eafe625685447b916b4021b04e45a3 [id=77a589d094cc4d4aa0aca7c7f7d820b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.535579 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4db7807a41124ed192096d89fd740ddf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.535713 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 (DEFAULT_TABLE table=default.Table_80eafe625685447b916b4021b04e45a3 [id=77a589d094cc4d4aa0aca7c7f7d820b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.537606 897 tablet_service.cc:1511] Processing CreateTablet for tablet a09ff2aded174da2b6450cc2b7be28bc (DEFAULT_TABLE table=default.Table_83b7af1a01fb4958b0293eb03c96b091 [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.537669 759 tablet_service.cc:1511] Processing CreateTablet for tablet a09ff2aded174da2b6450cc2b7be28bc (DEFAULT_TABLE table=default.Table_83b7af1a01fb4958b0293eb03c96b091 [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.537987 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ff2aded174da2b6450cc2b7be28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.538026 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ff2aded174da2b6450cc2b7be28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.538358 885 tablet_service.cc:1511] Processing CreateTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 (DEFAULT_TABLE table=default.Table_80eafe625685447b916b4021b04e45a3 [id=77a589d094cc4d4aa0aca7c7f7d820b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.538017 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f5e16014a34ab9a125d62c72cf2c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.539604 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f5e16014a34ab9a125d62c72cf2c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.543766 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f5e16014a34ab9a125d62c72cf2c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.549953 1978 raft_consensus.cc:493] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.550087 1978 raft_consensus.cc:515] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.550671 1978 leader_election.cc:290] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.551326 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.551781 716 leader_election.cc:343] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.539951 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 9207707e4ce14e70a6df9578c6bd54b6 with delete_type TABLET_DATA_DELETED (replaced by tablet edfe937339914b29afbceb9cd3cd7c1c) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:03.553191 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9207707e4ce14e70a6df9578c6bd54b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9207707e4ce14e70a6df9578c6bd54b6 already in progress: creating tablet
I20260503 07:53:03.553850 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.554981 715 leader_election.cc:343] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.555084 715 leader_election.cc:304] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.555491 1978 raft_consensus.cc:2749] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.556939 1171 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.557080 1171 ts_tablet_manager.cc:1403] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260503 07:53:03.544920 1166 tablet_bootstrap.cc:492] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:03.557833 1166 ts_tablet_manager.cc:1403] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.311s user 0.002s sys 0.002s
I20260503 07:53:03.557852 1171 raft_consensus.cc:359] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.558020 1171 raft_consensus.cc:385] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.558085 1171 raft_consensus.cc:740] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.558271 1171 consensus_queue.cc:260] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.558745 1171 ts_tablet_manager.cc:1434] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:03.558878 1166 raft_consensus.cc:359] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.559144 1166 raft_consensus.cc:385] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.559229 1166 raft_consensus.cc:740] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.559459 1166 consensus_queue.cc:260] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.560190 1166 ts_tablet_manager.cc:1434] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:03.560528 1166 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:03.562220 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:03.563838 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a09ff2aded174da2b6450cc2b7be28bc (DEFAULT_TABLE table=default.Table_83b7af1a01fb4958b0293eb03c96b091 [id=8b5aaaf3a2d54577a492c96d8f4e2dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.564505 754 tablet_service.cc:1511] Processing CreateTablet for tablet 07228cdc4a2b4ab7879abadbc5875e23 (DEFAULT_TABLE table=default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49 [id=0c4d848dca8748098bf95a46cc7cc082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.565445 1174 tablet_replica.cc:333] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:03.565621 1174 raft_consensus.cc:2243] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.565768 1174 raft_consensus.cc:2272] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.566915 1174 ts_tablet_manager.cc:1916] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.570214 2113 raft_consensus.cc:493] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.570394 2113 raft_consensus.cc:515] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.570871 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (table default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]) successfully deleted
I20260503 07:53:03.571323 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.571503 2113 leader_election.cc:290] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.571583 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.571759 778 raft_consensus.cc:2468] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:03.571760 988 leader_election.cc:343] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.572117 986 leader_election.cc:304] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.572572 2174 raft_consensus.cc:2804] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.572705 2174 raft_consensus.cc:493] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.572829 2174 raft_consensus.cc:3060] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.576601 1171 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.578651 1171 tablet_bootstrap.cc:654] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.580426 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ff2aded174da2b6450cc2b7be28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.584668 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9a23702aa5493ea8712f904af96755 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.584949 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4db7807a41124ed192096d89fd740ddf) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.585322 1175 raft_consensus.cc:2243] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:53:03.585614 1175 raft_consensus.cc:2272] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.586179 1175 ts_tablet_manager.cc:1916] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.593112 1166 tablet_bootstrap.cc:654] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.594630 1165 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.594910 1165 ts_tablet_manager.cc:1403] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.176s user 0.016s sys 0.026s
I20260503 07:53:03.595290 1952 raft_consensus.cc:493] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.595417 1952 raft_consensus.cc:515] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:03.596298 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6fb49d5b35994fe9b383b72f77eaebb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fb49d5b35994fe9b383b72f77eaebb6 already in progress: creating tablet
I20260503 07:53:03.596724 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9a23702aa5493ea8712f904af96755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.596976 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2546e95e0f40ad99f1ba6bc512debe" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.597414 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2546e95e0f40ad99f1ba6bc512debe" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:03.597465 988 leader_election.cc:343] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.597524 1952 leader_election.cc:290] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.597563 778 raft_consensus.cc:2468] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:03.598686 986 leader_election.cc:304] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.598637 1165 raft_consensus.cc:359] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.598910 1165 raft_consensus.cc:385] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.599010 1165 raft_consensus.cc:740] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.599260 2113 raft_consensus.cc:2804] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.599373 2113 raft_consensus.cc:493] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.599478 2113 raft_consensus.cc:3060] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.599409 1165 consensus_queue.cc:260] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.600355 918 raft_consensus.cc:3060] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.602747 1171 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.602855 1171 ts_tablet_manager.cc:1403] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.007s
I20260503 07:53:03.603590 1171 raft_consensus.cc:359] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.603745 1171 raft_consensus.cc:385] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.603802 1171 raft_consensus.cc:740] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.603984 1171 consensus_queue.cc:260] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.605080 1171 ts_tablet_manager.cc:1434] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:03.606223 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_24a0406bc2814a528e089ec908f4e841" } new_table_name: "default.Table_aa999d66f9e14901b5b5fe467b2d501f" modify_external_catalogs: true
I20260503 07:53:03.610344 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:03.611394 592 master_service.cc:954] ReplaceTablet: received request to replace tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.618551 1174 ts_tablet_manager.cc:1929] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.618672 1174 log.cc:1199] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/596130e78eb1444a96480fc1075478cd
I20260503 07:53:03.618935 1174 ts_tablet_manager.cc:1950] T 596130e78eb1444a96480fc1075478cd P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:03.619462 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07228cdc4a2b4ab7879abadbc5875e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.619717 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 656dfeb5247e4cdfaacd29690353da83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.620057 1173 tablet_replica.cc:333] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:03.620247 1173 raft_consensus.cc:2243] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:03.620381 1173 raft_consensus.cc:2272] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:03.621220 1173 ts_tablet_manager.cc:1916] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:03.620941 2174 raft_consensus.cc:515] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.625123 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:03.625320 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399acb90cf124fcf8a75bf936e3e426f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:03.625484 778 raft_consensus.cc:3060] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:03.625629 988 leader_election.cc:343] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.628115 2174 leader_election.cc:290] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.631335 2176 raft_consensus.cc:493] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.631516 2176 raft_consensus.cc:515] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.632360 2176 leader_election.cc:290] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.632426 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb821b329d284643a889b07f9a4f287e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.633033 988 leader_election.cc:343] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:03.634032 986 leader_election.cc:343] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: fb821b329d284643a889b07f9a4f287e
I20260503 07:53:03.634150 986 leader_election.cc:304] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.634380 2176 raft_consensus.cc:2749] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.635466 1165 ts_tablet_manager.cc:1434] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260503 07:53:03.640089 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.642053 1165 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.655771 1165 tablet_bootstrap.cc:654] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.659950 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa92517beb4622bdfa3fd824e78648 (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:03.662992 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 596130e78eb1444a96480fc1075478cd (table default.Table_7f279670887e4606ab0d08db41d9affe [id=04182b9dfa4f41738dedf12d85d54147]) successfully deleted
W20260503 07:53:03.663357 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6fb49d5b35994fe9b383b72f77eaebb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fb49d5b35994fe9b383b72f77eaebb6 already in progress: creating tablet
W20260503 07:53:03.663623 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9207707e4ce14e70a6df9578c6bd54b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9207707e4ce14e70a6df9578c6bd54b6 already in progress: creating tablet
I20260503 07:53:03.664031 2176 raft_consensus.cc:493] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.664211 2176 raft_consensus.cc:515] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.665375 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5896bb71c674358957c87a347b8fb79" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.666710 988 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.666952 2176 leader_election.cc:290] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:03.667268 986 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f5896bb71c674358957c87a347b8fb79
I20260503 07:53:03.667371 986 leader_election.cc:304] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.667568 1952 raft_consensus.cc:2749] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.672646 1165 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.672708 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:03.673913 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e6b7a14031ca41a7ace939e8001d3ba1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:03.674067 2082 raft_consensus.cc:493] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:03.674207 2082 raft_consensus.cc:515] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:03.674669 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6b7a14031ca41a7ace939e8001d3ba1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.674955 2082 leader_election.cc:290] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.680287 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 57dd3c136b364aee91a733132d4caef5
I20260503 07:53:03.681625 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:03.682135 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b6147bab7a44b19b4a22addf68961f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.683702 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dd3c136b364aee91a733132d4caef5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.683911 854 leader_election.cc:304] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.684298 2082 raft_consensus.cc:2749] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:03.684456 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dd3c136b364aee91a733132d4caef5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:03.685243 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 57dd3c136b364aee91a733132d4caef5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57dd3c136b364aee91a733132d4caef5 already in progress: creating tablet
I20260503 07:53:03.689311 1165 ts_tablet_manager.cc:1403] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.007s
I20260503 07:53:03.690408 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dd3c136b364aee91a733132d4caef5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.691798 1165 raft_consensus.cc:359] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.692139 1165 raft_consensus.cc:385] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.692276 1165 raft_consensus.cc:740] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.692648 1171 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.692902 1165 consensus_queue.cc:260] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.694216 1165 ts_tablet_manager.cc:1434] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:53:03.694645 1171 tablet_bootstrap.cc:654] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.694646 1165 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.697559 1165 tablet_bootstrap.cc:654] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.711993 1171 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.712283 1171 ts_tablet_manager.cc:1403] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.005s
I20260503 07:53:03.713091 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:03.714282 1165 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.714558 1165 ts_tablet_manager.cc:1403] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.010s
I20260503 07:53:03.715934 1171 raft_consensus.cc:359] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.716210 1171 raft_consensus.cc:385] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.716312 1171 raft_consensus.cc:740] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.716560 1171 consensus_queue.cc:260] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.717044 1171 ts_tablet_manager.cc:1434] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:53:03.717342 1171 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.722506 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 24e6193c682b44c5aec60cb6e64a7fac
I20260503 07:53:03.725240 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.725924 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.727140 1171 tablet_bootstrap.cc:654] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:03.727139 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 24e6193c682b44c5aec60cb6e64a7fac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24e6193c682b44c5aec60cb6e64a7fac already in progress: creating tablet
I20260503 07:53:03.728577 2178 raft_consensus.cc:493] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.728782 2178 raft_consensus.cc:515] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.730355 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:03.730994 716 leader_election.cc:343] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.731555 2178 leader_election.cc:290] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.731832 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 24e6193c682b44c5aec60cb6e64a7fac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.732580 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.733081 715 leader_election.cc:343] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.733186 715 leader_election.cc:304] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.738179 594 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]). Expected version 1 got 0
I20260503 07:53:03.739153 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_41724e04367244b7b2e7d8c8d588c497" } new_table_name: "default.Table_9646530ccdda41a5a44559346f8868a0" modify_external_catalogs: true
I20260503 07:53:03.744357 1171 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.744576 1171 ts_tablet_manager.cc:1403] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.003s
I20260503 07:53:03.745430 1171 raft_consensus.cc:359] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.745656 1171 raft_consensus.cc:385] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.745769 1171 raft_consensus.cc:740] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.746027 1171 consensus_queue.cc:260] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.746881 1171 ts_tablet_manager.cc:1434] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260503 07:53:03.747017 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd492fb40d4944e0bb1e1e7019570778 consensus state has no leader
I20260503 07:53:03.747282 1171 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.716341 1165 raft_consensus.cc:359] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.747895 1165 raft_consensus.cc:385] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.748631 1171 tablet_bootstrap.cc:654] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.748507 1165 raft_consensus.cc:740] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.749802 1165 consensus_queue.cc:260] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.751106 1978 raft_consensus.cc:2749] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.755674 1165 ts_tablet_manager.cc:1434] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260503 07:53:03.759301 1165 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.760110 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e453763b83b34fc5a5c811138db3a7d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.760864 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e453763b83b34fc5a5c811138db3a7d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.764531 1171 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.764724 1171 ts_tablet_manager.cc:1403] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:53:03.765515 1171 raft_consensus.cc:359] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.765744 1171 raft_consensus.cc:385] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.765851 1171 raft_consensus.cc:740] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.766160 1171 consensus_queue.cc:260] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.766783 1171 ts_tablet_manager.cc:1434] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:03.767268 1171 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.768783 1171 tablet_bootstrap.cc:654] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.770596 2178 raft_consensus.cc:493] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.770731 2178 raft_consensus.cc:515] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.771703 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c25addae8c94554a83344f07a11362f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.771802 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c25addae8c94554a83344f07a11362f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:03.771968 1052 raft_consensus.cc:2468] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:03.772212 715 leader_election.cc:343] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.772594 716 leader_election.cc:304] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.771175 1165 tablet_bootstrap.cc:654] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.772863 1978 raft_consensus.cc:2804] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.772934 1978 raft_consensus.cc:493] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.772992 1978 raft_consensus.cc:3060] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.773449 2178 leader_election.cc:290] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.774235 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa92517beb4622bdfa3fd824e78648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:03.774768 778 raft_consensus.cc:2468] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:03.774755 2113 raft_consensus.cc:515] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.775305 2113 leader_election.cc:290] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.775642 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2546e95e0f40ad99f1ba6bc512debe" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:03.776078 988 leader_election.cc:343] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.778342 986 leader_election.cc:304] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.780432 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2546e95e0f40ad99f1ba6bc512debe" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:03.780635 778 raft_consensus.cc:3060] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.781342 1978 raft_consensus.cc:515] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.782335 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c25addae8c94554a83344f07a11362f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:03.782784 715 leader_election.cc:343] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.782982 2113 raft_consensus.cc:2804] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:03.783109 2113 raft_consensus.cc:697] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:03.783355 2113 consensus_queue.cc:237] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.783934 778 raft_consensus.cc:2468] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:03.784476 986 leader_election.cc:304] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.784796 2176 raft_consensus.cc:2804] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:03.784890 2176 raft_consensus.cc:697] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:03.785064 2176 consensus_queue.cc:237] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.786193 1978 leader_election.cc:290] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:03.786662 1171 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.786763 1171 ts_tablet_manager.cc:1403] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260503 07:53:03.786734 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c25addae8c94554a83344f07a11362f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:03.786914 1052 raft_consensus.cc:3060] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.787490 1171 raft_consensus.cc:359] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.787618 1171 raft_consensus.cc:385] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.787658 1171 raft_consensus.cc:740] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.787855 1171 consensus_queue.cc:260] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.788443 1171 ts_tablet_manager.cc:1434] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:03.788697 1171 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.790347 1171 tablet_bootstrap.cc:654] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.797763 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_50b786a031ce462fae095812adaa3bd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.798593 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50b786a031ce462fae095812adaa3bd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.809037 1166 tablet_bootstrap.cc:492] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:03.809213 1166 ts_tablet_manager.cc:1403] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.249s user 0.015s sys 0.049s
I20260503 07:53:03.809886 1166 raft_consensus.cc:359] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.810083 1166 raft_consensus.cc:385] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.810155 1166 raft_consensus.cc:740] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.810389 1166 consensus_queue.cc:260] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.810818 1166 ts_tablet_manager.cc:1434] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:03.812554 1166 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:03.818231 1052 raft_consensus.cc:2468] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:03.818910 716 leader_election.cc:304] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.819669 1173 ts_tablet_manager.cc:1929] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:03.819811 1173 log.cc:1199] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/656dfeb5247e4cdfaacd29690353da83
I20260503 07:53:03.820210 1173 ts_tablet_manager.cc:1950] T 656dfeb5247e4cdfaacd29690353da83 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:03.820734 1978 raft_consensus.cc:2804] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:03.820861 1978 raft_consensus.cc:697] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:03.821643 1978 consensus_queue.cc:237] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.830586 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b688bb298df944f798eb63e70f407f61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.831266 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b688bb298df944f798eb63e70f407f61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:03.837124 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ab0752eb4fa49a48cf521f9a072689a consensus state has no leader
I20260503 07:53:03.842366 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
W20260503 07:53:03.858246 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73d5d6444bbf415ca5feb27ca96ebcd5 consensus state has no leader
I20260503 07:53:03.859642 1165 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.859944 1165 ts_tablet_manager.cc:1403] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.001s
I20260503 07:53:03.861325 1165 raft_consensus.cc:359] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.861644 1165 raft_consensus.cc:385] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.861788 1165 raft_consensus.cc:740] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.862419 1165 consensus_queue.cc:260] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.862874 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
I20260503 07:53:03.864602 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_785d45f016d940afba4884beadbe2146"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.865293 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_785d45f016d940afba4884beadbe2146 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.867202 1165 ts_tablet_manager.cc:1434] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260503 07:53:03.869155 1165 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:03.869741 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6050ebde3e741a1b551eecf1f704689 consensus state has no leader
I20260503 07:53:03.870697 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 656dfeb5247e4cdfaacd29690353da83 (table default.Table_a33e9be9e212414fa02ff5ca89a05939 [id=699007599c6d43ceb8d5de26859e6910]) successfully deleted
W20260503 07:53:03.871054 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 57dd3c136b364aee91a733132d4caef5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57dd3c136b364aee91a733132d4caef5 already in progress: creating tablet
W20260503 07:53:03.871297 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 24e6193c682b44c5aec60cb6e64a7fac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24e6193c682b44c5aec60cb6e64a7fac already in progress: creating tablet
I20260503 07:53:03.881040 1175 ts_tablet_manager.cc:1929] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260503 07:53:03.881198 1175 log.cc:1199] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f1f86609fc7b4007ab4c730002918613
I20260503 07:53:03.881541 1175 ts_tablet_manager.cc:1950] T f1f86609fc7b4007ab4c730002918613 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:03.882247 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5f7e8f63b8a74a30b6305c5db547c630" } modify_external_catalogs: true
I20260503 07:53:03.882409 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5f7e8f63b8a74a30b6305c5db547c630" } modify_external_catalogs: true
I20260503 07:53:03.885572 1166 tablet_bootstrap.cc:654] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.890158 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7f4f7c8dcb2640af8d4426cc69f8ba37
I20260503 07:53:03.890724 592 catalog_manager.cc:6741] ReplaceTablet: tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 deleted and replaced by tablet 3e24841bbd374cdbb8ca4ea671f712bf
I20260503 07:53:03.895117 1171 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.895246 1171 ts_tablet_manager.cc:1403] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.107s user 0.022s sys 0.051s
I20260503 07:53:03.895671 1165 tablet_bootstrap.cc:654] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.895891 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e24841bbd374cdbb8ca4ea671f712bf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.896143 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e24841bbd374cdbb8ca4ea671f712bf) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.896149 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e917af377654c46b51e3fea73b0f06b" } modify_external_catalogs: true
I20260503 07:53:03.896343 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e917af377654c46b51e3fea73b0f06b" } modify_external_catalogs: true
I20260503 07:53:03.896309 1171 raft_consensus.cc:359] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.897158 1171 raft_consensus.cc:385] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.897310 1171 raft_consensus.cc:740] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:03.897364 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 already in progress: creating tablet
I20260503 07:53:03.897715 1171 consensus_queue.cc:260] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.898788 1171 ts_tablet_manager.cc:1434] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:03.895481 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e24841bbd374cdbb8ca4ea671f712bf) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:03.899513 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 already in progress: creating tablet
I20260503 07:53:03.900810 2176 raft_consensus.cc:493] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.900928 2176 raft_consensus.cc:515] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.901911 2176 leader_election.cc:290] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.902206 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3650ec1de28c4f1bafd979257dd2b778" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:03.902704 988 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:03.902865 986 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:03.902959 986 leader_election.cc:304] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:03.903282 2174 raft_consensus.cc:493] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.903391 2174 raft_consensus.cc:515] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.903864 2174 leader_election.cc:290] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.903991 2174 raft_consensus.cc:2749] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:03.904448 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.904528 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.904697 778 raft_consensus.cc:2468] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:03.904924 988 leader_election.cc:343] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.905351 986 leader_election.cc:304] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.905738 2176 raft_consensus.cc:2804] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.905805 2176 raft_consensus.cc:493] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.905864 2176 raft_consensus.cc:3060] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.909804 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5d7d792752374a91978feb4f24d63027"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.910369 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d7d792752374a91978feb4f24d63027 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.927333 1171 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:03.928495 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f158ee50be904cee95383a3808f148f2 has no consensus state
I20260503 07:53:03.928807 1171 tablet_bootstrap.cc:654] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.928856 594 master_service.cc:954] ReplaceTablet: received request to replace tablet f9e78eb6d2a3489dbb15806dd93867a4 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:03.929809 1165 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.930061 1165 ts_tablet_manager.cc:1403] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.001s
I20260503 07:53:03.931342 1165 raft_consensus.cc:359] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.931643 1165 raft_consensus.cc:385] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.931739 1165 raft_consensus.cc:740] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.932224 1165 consensus_queue.cc:260] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.935253 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ea935fa9bd9e4e02b107e95e4d05032e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.935734 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea935fa9bd9e4e02b107e95e4d05032e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.938593 1165 ts_tablet_manager.cc:1434] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260503 07:53:03.939577 1165 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.944918 1165 tablet_bootstrap.cc:654] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.947710 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_aae3fb5443b64b1da5ca0c0d69dc2b7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:03.948288 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aae3fb5443b64b1da5ca0c0d69dc2b7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:03.956981 1171 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:03.957187 1171 ts_tablet_manager.cc:1403] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.006s
I20260503 07:53:03.957968 1171 raft_consensus.cc:359] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.958205 1171 raft_consensus.cc:385] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.958308 1171 raft_consensus.cc:740] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.958598 1171 consensus_queue.cc:260] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.959173 1171 ts_tablet_manager.cc:1434] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:03.963392 2176 raft_consensus.cc:515] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.964054 2176 leader_election.cc:290] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.964586 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:03.964751 777 raft_consensus.cc:3060] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.964761 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468a420c2a87466398cad5dfd959b3be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:03.965569 988 leader_election.cc:343] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.967803 777 raft_consensus.cc:2468] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:03.968364 986 leader_election.cc:304] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.968827 2176 raft_consensus.cc:2804] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:03.968937 2176 raft_consensus.cc:697] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:03.969157 2176 consensus_queue.cc:237] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.970175 2174 raft_consensus.cc:493] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:03.970278 2174 raft_consensus.cc:515] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.970753 2174 leader_election.cc:290] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:03.970999 1165 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:03.971225 1165 ts_tablet_manager.cc:1403] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.000s
I20260503 07:53:03.972288 1165 raft_consensus.cc:359] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.972733 1165 raft_consensus.cc:385] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.972846 1165 raft_consensus.cc:740] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:03.973155 1165 consensus_queue.cc:260] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:03.973706 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:03.974321 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8feb829fa26149529dfedfed7c5679ae" } modify_external_catalogs: true
I20260503 07:53:03.974515 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8feb829fa26149529dfedfed7c5679ae" } modify_external_catalogs: true
I20260503 07:53:03.975701 1165 ts_tablet_manager.cc:1434] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
W20260503 07:53:03.975736 988 leader_election.cc:343] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:03.976329 1165 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:03.976140 1171 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:03.976604 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:03.976773 777 raft_consensus.cc:2468] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:03.977144 986 leader_election.cc:304] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:03.977537 2176 raft_consensus.cc:2804] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:03.977622 2176 raft_consensus.cc:493] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:03.977694 2176 raft_consensus.cc:3060] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:03.977756 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08777a140b3c45e688c9b5113806f83d" } modify_external_catalogs: true
I20260503 07:53:03.977936 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08777a140b3c45e688c9b5113806f83d" } modify_external_catalogs: true
I20260503 07:53:03.984108 1171 tablet_bootstrap.cc:654] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.984508 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 701) took 1799 ms. Trace:
I20260503 07:53:03.986553 1175 rpcz_store.cc:276] 0503 07:53:02.185316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.185456 (+ 140us) service_pool.cc:224] Handling call
0503 07:53:03.286063 (+1100607us) ts_tablet_manager.cc:1151] Deleting tablet f1f86609fc7b4007ab4c730002918613
0503 07:53:03.286072 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.773864 (+487792us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:03.880965 (+107101us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:03.984489 (+103524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31,"tablet-delete.queue_time_us":1100360}
I20260503 07:53:03.987187 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f1f86609fc7b4007ab4c730002918613 (table default.Table_3efaa3d37a9d40288239aa540e6b44d6 [id=c59922f427b140b09953451892a84c06]) successfully deleted
I20260503 07:53:03.987668 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 704) took 1801 ms. Trace:
I20260503 07:53:03.987743 1166 tablet_bootstrap.cc:492] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:03.987809 1175 rpcz_store.cc:276] 0503 07:53:02.185754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.185794 (+ 40us) service_pool.cc:224] Handling call
0503 07:53:03.987546 (+1801752us) ts_tablet_manager.cc:1151] Deleting tablet 057b62a991b74c859045a74df7dc716f
0503 07:53:03.987555 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.987650 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1801501}
I20260503 07:53:03.987954 1166 ts_tablet_manager.cc:1403] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.175s user 0.002s sys 0.001s
I20260503 07:53:03.988024 1165 tablet_bootstrap.cc:654] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:03.988508 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 703) took 1802 ms. Trace:
I20260503 07:53:03.988629 1175 rpcz_store.cc:276] 0503 07:53:02.185628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.185806 (+ 178us) service_pool.cc:224] Handling call
0503 07:53:03.988392 (+1802586us) ts_tablet_manager.cc:1151] Deleting tablet ecc39d127c71412ea867a0b3cad10452
0503 07:53:03.988402 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.988493 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1801665}
I20260503 07:53:03.988762 1166 raft_consensus.cc:359] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.989017 1166 raft_consensus.cc:385] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:03.989137 1166 raft_consensus.cc:740] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:03.989259 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ecc39d127c71412ea867a0b3cad10452 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecc39d127c71412ea867a0b3cad10452 already in progress: creating tablet
I20260503 07:53:03.989506 1166 consensus_queue.cc:260] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:03.989701 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 700) took 1853 ms. Trace:
I20260503 07:53:03.989775 1175 rpcz_store.cc:276] 0503 07:53:02.136464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.231108 (+ 94644us) service_pool.cc:224] Handling call
0503 07:53:03.989591 (+1758483us) ts_tablet_manager.cc:1151] Deleting tablet b5f31f37e97345bb9187865e38ee1d61
0503 07:53:03.989600 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.989686 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1758289}
W20260503 07:53:03.990206 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b5f31f37e97345bb9187865e38ee1d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f31f37e97345bb9187865e38ee1d61 already in progress: creating tablet
I20260503 07:53:03.990953 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 706) took 1699 ms. Trace:
I20260503 07:53:03.991024 1175 rpcz_store.cc:276] 0503 07:53:02.291285 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.293583 (+ 2298us) service_pool.cc:224] Handling call
0503 07:53:03.990846 (+1697263us) ts_tablet_manager.cc:1151] Deleting tablet 61316b7a521e42a59bf955179b080f40
0503 07:53:03.990856 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.990937 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1697070}
W20260503 07:53:03.991384 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 61316b7a521e42a59bf955179b080f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61316b7a521e42a59bf955179b080f40 already in progress: creating tablet
I20260503 07:53:03.991521 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f7fed679a54441b591801542b9e8dc22
I20260503 07:53:03.992307 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 705) took 1725 ms. Trace:
I20260503 07:53:03.992372 1175 rpcz_store.cc:276] 0503 07:53:02.267116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.300228 (+ 33112us) service_pool.cc:224] Handling call
0503 07:53:03.992206 (+1691978us) ts_tablet_manager.cc:1151] Deleting tablet e19d7eab61e24e18a1e4eb600e9d592a
0503 07:53:03.992216 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:03.992292 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1691674}
W20260503 07:53:03.993444 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e19d7eab61e24e18a1e4eb600e9d592a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19d7eab61e24e18a1e4eb600e9d592a already in progress: creating tablet
I20260503 07:53:03.993561 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f7fed679a54441b591801542b9e8dc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:03.993731 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f7fed679a54441b591801542b9e8dc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:03.993818 1175 tablet_replica.cc:333] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:03.993819 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f7fed679a54441b591801542b9e8dc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:03.993989 1175 raft_consensus.cc:2243] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:03.994338 1175 raft_consensus.cc:2272] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:03.994372 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f7fed679a54441b591801542b9e8dc22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7fed679a54441b591801542b9e8dc22 already in progress: creating tablet
W20260503 07:53:03.994437 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f7fed679a54441b591801542b9e8dc22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7fed679a54441b591801542b9e8dc22 already in progress: creating tablet
I20260503 07:53:03.996801 1166 ts_tablet_manager.cc:1434] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260503 07:53:03.997006 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b3764476999d489dab360b8b4bd40abe" } modify_external_catalogs: true
I20260503 07:53:03.997176 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b3764476999d489dab360b8b4bd40abe" } modify_external_catalogs: true
I20260503 07:53:03.997905 1175 ts_tablet_manager.cc:1916] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.001467 1166 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.002985 1166 tablet_bootstrap.cc:654] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.006126 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c1eba299413e4b178556b5158d1b473c" } new_table_name: "default.Table_d6066f083a03438ab6d742e6aac144d0" modify_external_catalogs: true
I20260503 07:53:04.008687 896 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fcade062b24ee280d4943d3254df03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.009042 1173 tablet_replica.cc:333] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:04.009215 1173 raft_consensus.cc:2243] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.009346 1173 raft_consensus.cc:2272] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.010802 1171 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.010942 1171 ts_tablet_manager.cc:1403] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260503 07:53:04.011440 1173 ts_tablet_manager.cc:1916] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.011786 1171 raft_consensus.cc:359] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.011946 1171 raft_consensus.cc:385] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.012005 1171 raft_consensus.cc:740] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.012687 1165 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.013422 1165 ts_tablet_manager.cc:1403] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.000s
I20260503 07:53:04.014822 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f9e78eb6d2a3489dbb15806dd93867a4
I20260503 07:53:04.014612 1165 raft_consensus.cc:359] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.015324 594 catalog_manager.cc:6741] ReplaceTablet: tablet f9e78eb6d2a3489dbb15806dd93867a4 deleted and replaced by tablet 0a4d8b20f6d9467ba283f80f77e113a1
I20260503 07:53:04.015316 1165 raft_consensus.cc:385] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.015439 1165 raft_consensus.cc:740] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.015761 1165 consensus_queue.cc:260] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.018378 1165 ts_tablet_manager.cc:1434] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:04.019464 1165 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.023517 1165 tablet_bootstrap.cc:654] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.023699 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a4d8b20f6d9467ba283f80f77e113a1) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.024014 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a4d8b20f6d9467ba283f80f77e113a1) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.024209 1166 tablet_bootstrap.cc:492] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.024466 1166 ts_tablet_manager.cc:1403] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20260503 07:53:04.025419 1166 raft_consensus.cc:359] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.025653 1166 raft_consensus.cc:385] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.025755 1166 raft_consensus.cc:740] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.026008 1166 consensus_queue.cc:260] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.026782 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e78eb6d2a3489dbb15806dd93867a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a4d8b20f6d9467ba283f80f77e113a1) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.027220 2113 raft_consensus.cc:493] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.027325 2113 raft_consensus.cc:515] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.027885 2113 leader_election.cc:290] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.028754 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f9e78eb6d2a3489dbb15806dd93867a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9e78eb6d2a3489dbb15806dd93867a4 already in progress: creating tablet
I20260503 07:53:04.029759 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d15e70ec4856a15ed7c6175cd334" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.030398 988 leader_election.cc:343] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.034075 986 leader_election.cc:343] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ab33d15e70ec4856a15ed7c6175cd334
I20260503 07:53:04.034185 986 leader_election.cc:304] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.034370 2113 raft_consensus.cc:2749] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.035143 1166 ts_tablet_manager.cc:1434] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260503 07:53:04.036420 2204 tablet.cc:1724] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.037391 2203 tablet.cc:1724] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.041425 1166 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.042126 1171 consensus_queue.cc:260] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.042446 594 master_service.cc:954] ReplaceTablet: received request to replace tablet e36e6f971c5e4929b42bb522e91d4eba from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.044346 1171 ts_tablet_manager.cc:1434] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.033s user 0.002s sys 0.001s
I20260503 07:53:04.044664 1171 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.046677 1166 tablet_bootstrap.cc:654] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.051852 1171 tablet_bootstrap.cc:654] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.061127 1166 tablet_bootstrap.cc:492] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.061269 1166 ts_tablet_manager.cc:1403] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260503 07:53:04.062040 1166 raft_consensus.cc:359] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.062209 1166 raft_consensus.cc:385] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.062258 1166 raft_consensus.cc:740] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.062461 1166 consensus_queue.cc:260] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.062920 1166 ts_tablet_manager.cc:1434] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:04.063220 1166 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.063362 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e25c6ff05c264ce4905a0e07af688764"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.063865 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e25c6ff05c264ce4905a0e07af688764 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.064581 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e1c047f13d94420949c1288b12725a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.065090 2176 raft_consensus.cc:515] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.065703 2176 leader_election.cc:290] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.067538 1166 tablet_bootstrap.cc:654] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.072800 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.073029 778 raft_consensus.cc:3060] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.077239 1166 tablet_bootstrap.cc:492] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.077363 1166 ts_tablet_manager.cc:1403] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260503 07:53:04.078037 1166 raft_consensus.cc:359] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.078207 1166 raft_consensus.cc:385] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.078258 1166 raft_consensus.cc:740] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.078433 1166 consensus_queue.cc:260] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.080096 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.080926 1171 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.081053 1171 ts_tablet_manager.cc:1403] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.002s
I20260503 07:53:04.081728 1171 raft_consensus.cc:359] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.081883 1171 raft_consensus.cc:385] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.081934 1166 ts_tablet_manager.cc:1434] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:53:04.081934 1171 raft_consensus.cc:740] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.082198 1166 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.082114 1171 consensus_queue.cc:260] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.082571 1171 ts_tablet_manager.cc:1434] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:04.082877 1171 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.082950 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:04.083488 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
W20260503 07:53:04.083973 988 leader_election.cc:343] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.086477 1171 tablet_bootstrap.cc:654] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.086767 2082 raft_consensus.cc:493] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.086894 2082 raft_consensus.cc:515] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.087430 2082 leader_election.cc:290] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.088083 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.088289 1165 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.088315 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d50a71c1a4bf799de34af1064597d" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.088683 1165 ts_tablet_manager.cc:1403] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.022s
I20260503 07:53:04.089314 854 leader_election.cc:304] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:04.089504 988 consensus_peers.cc:597] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:04.090123 1165 raft_consensus.cc:359] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.090351 1165 raft_consensus.cc:385] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.090456 1165 raft_consensus.cc:740] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.090597 2082 raft_consensus.cc:2749] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.090977 1165 consensus_queue.cc:260] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.093566 1165 ts_tablet_manager.cc:1434] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:53:04.094133 1165 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.095167 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6b0bee23865249f0bc429e16e7d35228"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.095685 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b0bee23865249f0bc429e16e7d35228 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.096774 896 tablet_service.cc:1558] Processing DeleteTablet for tablet ac8d392c3bb94f03819fae08fc009fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.098881 1165 tablet_bootstrap.cc:654] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.087428 1166 tablet_bootstrap.cc:654] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.111855 1171 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.112002 1171 ts_tablet_manager.cc:1403] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.003s
I20260503 07:53:04.112108 1165 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.112332 1165 ts_tablet_manager.cc:1403] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260503 07:53:04.112830 1171 raft_consensus.cc:359] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.112996 1171 raft_consensus.cc:385] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.113049 1171 raft_consensus.cc:740] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.113220 1171 consensus_queue.cc:260] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.113561 1165 raft_consensus.cc:359] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:04.113799 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a7af140ce144bc8b2e147dad98ac201 consensus state has no leader
I20260503 07:53:04.113817 1165 raft_consensus.cc:385] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.113896 1165 raft_consensus.cc:740] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.114187 1165 consensus_queue.cc:260] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.115011 1165 ts_tablet_manager.cc:1434] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:04.115584 597 master_service.cc:954] ReplaceTablet: received request to replace tablet b5f31f37e97345bb9187865e38ee1d61 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.117250 896 tablet_service.cc:1558] Processing DeleteTablet for tablet c224dc90387c4848a5dd802d0674265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.118530 1165 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.118696 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_64c5d856a21646c3a6f8ab060173488d" } new_table_name: "default.Table_c73353e0401c48e98892a62a22b8496f" modify_external_catalogs: true
I20260503 07:53:04.120195 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_123af1899c15436d972ab19727e939b4" } new_table_name: "default.Table_f70c5a8152ee4df4b89f58135994214e" modify_external_catalogs: true
I20260503 07:53:04.121234 1165 tablet_bootstrap.cc:654] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.122861 1171 ts_tablet_manager.cc:1434] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260503 07:53:04.123123 1171 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.127514 1171 tablet_bootstrap.cc:654] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.134966 1165 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.135301 1165 ts_tablet_manager.cc:1403] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.006s
I20260503 07:53:04.137166 1165 raft_consensus.cc:359] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.137564 1165 raft_consensus.cc:385] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.137692 1165 raft_consensus.cc:740] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.138159 1165 consensus_queue.cc:260] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.139052 1165 ts_tablet_manager.cc:1434] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260503 07:53:04.144891 1175 ts_tablet_manager.cc:1929] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:04.145009 1175 log.cc:1199] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/aa9153d3245f4dcfacf26f174bced2ba
I20260503 07:53:04.145341 1175 ts_tablet_manager.cc:1950] T aa9153d3245f4dcfacf26f174bced2ba P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.146334 1173 ts_tablet_manager.cc:1929] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.146431 1173 log.cc:1199] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/e6fcade062b24ee280d4943d3254df03
I20260503 07:53:04.146668 1173 ts_tablet_manager.cc:1950] T e6fcade062b24ee280d4943d3254df03 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:04.148344 778 raft_consensus.cc:2468] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.148764 986 leader_election.cc:304] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.149134 2174 raft_consensus.cc:2804] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.149231 2174 raft_consensus.cc:697] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.149425 2174 consensus_queue.cc:237] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.156764 1173 tablet_replica.cc:333] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:04.156983 1173 raft_consensus.cc:2243] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.157133 1173 raft_consensus.cc:2272] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.157775 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet e6fcade062b24ee280d4943d3254df03 (table default.Table_9a5f3d5305ab4390b83d2c3a51947d3a [id=05e0da9b54444389b8d875266770ccfe]) successfully deleted
W20260503 07:53:04.158103 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f9e78eb6d2a3489dbb15806dd93867a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9e78eb6d2a3489dbb15806dd93867a4 already in progress: creating tablet
I20260503 07:53:04.158834 1173 ts_tablet_manager.cc:1916] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.158890 1165 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.160436 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bcf8381e20f14ebcb7a812874b44213c" } new_table_name: "default.Table_281dfb85ec6847eabbcb68be237d659c" modify_external_catalogs: true
I20260503 07:53:04.160494 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 707) took 1814 ms. Trace:
I20260503 07:53:04.170562 2082 raft_consensus.cc:493] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.170739 2082 raft_consensus.cc:515] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.171475 2082 leader_election.cc:290] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.171835 1165 tablet_bootstrap.cc:654] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:04.172600 851 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: c224dc90387c4848a5dd802d0674265d
W20260503 07:53:04.172904 854 leader_election.cc:343] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: c224dc90387c4848a5dd802d0674265d
I20260503 07:53:04.172991 854 leader_election.cc:304] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.173377 2113 raft_consensus.cc:493] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.173499 2113 raft_consensus.cc:515] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.174062 2113 leader_election.cc:290] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.174160 2113 raft_consensus.cc:493] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.174235 2113 raft_consensus.cc:515] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.174718 2113 leader_election.cc:290] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.174790 1166 tablet_bootstrap.cc:492] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.174877 2180 raft_consensus.cc:2749] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.174933 1166 ts_tablet_manager.cc:1403] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.000s
I20260503 07:53:04.175679 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb4d150eadb479d9978f2450637bd3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.176250 988 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.176509 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.176678 778 raft_consensus.cc:2468] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:04.176789 986 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:04.176903 986 leader_election.cc:304] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.177449 986 leader_election.cc:304] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.177742 2176 raft_consensus.cc:2749] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.177806 2113 raft_consensus.cc:2804] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.177898 2113 raft_consensus.cc:493] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.177986 2113 raft_consensus.cc:3060] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.178735 1166 raft_consensus.cc:359] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.180260 1166 raft_consensus.cc:385] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.180467 1166 raft_consensus.cc:740] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.180789 2113 raft_consensus.cc:515] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.165256 1175 rpcz_store.cc:276] 0503 07:53:02.346013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.346619 (+ 606us) service_pool.cc:224] Handling call
0503 07:53:03.993762 (+1647143us) ts_tablet_manager.cc:1151] Deleting tablet aa9153d3245f4dcfacf26f174bced2ba
0503 07:53:03.993770 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.068322 (+ 74552us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.144833 (+ 76511us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.160478 (+ 15645us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646908}
I20260503 07:53:04.181735 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 709) took 1677 ms. Trace:
I20260503 07:53:04.181793 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet aa9153d3245f4dcfacf26f174bced2ba (table default.Table_5fbac7e007964bb097d813068a2f5769 [id=33684b8018e34236b6f01a436e969859]) successfully deleted
I20260503 07:53:04.181833 1175 rpcz_store.cc:276] 0503 07:53:02.504095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.504202 (+ 107us) service_pool.cc:224] Handling call
0503 07:53:04.181627 (+1677425us) ts_tablet_manager.cc:1151] Deleting tablet 08d7b172bb1d4ad1ba81e08748db4ae2
0503 07:53:04.181636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.181719 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677259}
I20260503 07:53:04.182145 1175 tablet_replica.cc:333] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.182336 1175 raft_consensus.cc:2243] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.182556 1175 raft_consensus.cc:2272] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:04.183048 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet baf176bdc6d54088846ee5eaf5e61447 has no consensus state
I20260503 07:53:04.183133 1175 ts_tablet_manager.cc:1916] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.183467 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4f750fe160ac401c8bbbc91eaa8cf739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.183992 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f750fe160ac401c8bbbc91eaa8cf739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.184733 2113 leader_election.cc:290] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.183050 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 08d7b172bb1d4ad1ba81e08748db4ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08d7b172bb1d4ad1ba81e08748db4ae2 already in progress: creating tablet
I20260503 07:53:04.184783 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.184967 778 raft_consensus.cc:3060] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:04.185215 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01319ce0cb1c4be7b53b952d50fd1cc1 consensus state has no leader
I20260503 07:53:04.185904 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9d74a4981bb94d9cb60de5bd4b7e9d49" } new_table_name: "default.Table_726967ae7403409199e7ecd36834feae" modify_external_catalogs: true
I20260503 07:53:04.187748 778 raft_consensus.cc:2468] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.182009 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.184144 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.188196 986 leader_election.cc:304] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.188452 2113 raft_consensus.cc:2804] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.188570 2113 raft_consensus.cc:697] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
W20260503 07:53:04.188737 988 leader_election.cc:343] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.188808 2113 consensus_queue.cc:237] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:04.189162 988 leader_election.cc:343] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.189488 1166 consensus_queue.cc:260] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.189996 1166 ts_tablet_manager.cc:1434] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260503 07:53:04.193310 1175 ts_tablet_manager.cc:1929] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:04.200434 1175 log.cc:1199] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f1aeea6b4ead45ef82934811494cf263
I20260503 07:53:04.201133 1175 ts_tablet_manager.cc:1950] T f1aeea6b4ead45ef82934811494cf263 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:04.201550 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 618b858f6e424845b5a6b0010cb2b602 consensus state has no leader
I20260503 07:53:04.202431 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 711) took 1643 ms. Trace:
I20260503 07:53:04.202529 1175 rpcz_store.cc:276] 0503 07:53:02.559453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.559506 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:04.182064 (+1622558us) ts_tablet_manager.cc:1151] Deleting tablet f1aeea6b4ead45ef82934811494cf263
0503 07:53:04.182092 (+ 28us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.186810 (+ 4718us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.193243 (+ 6433us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.202396 (+ 9153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1622382}
I20260503 07:53:04.202978 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f1aeea6b4ead45ef82934811494cf263 (table default.Table_80720e11ba684edfa953a24b59778ead [id=4d16fccdaa164fe0838289626805673e]) successfully deleted
I20260503 07:53:04.203253 598 master_service.cc:954] ReplaceTablet: received request to replace tablet ab44832fbf224a069d958cf745d914f8 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.203455 2174 consensus_queue.cc:1048] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:04.205365 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 712) took 1638 ms. Trace:
I20260503 07:53:04.205458 1175 rpcz_store.cc:276] 0503 07:53:02.567002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.567050 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:04.205227 (+1638177us) ts_tablet_manager.cc:1151] Deleting tablet 6da5a4c519a249ca90c466eab47aa00b
0503 07:53:04.205238 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.205328 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638020}
W20260503 07:53:04.205859 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6da5a4c519a249ca90c466eab47aa00b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da5a4c519a249ca90c466eab47aa00b already in progress: creating tablet
W20260503 07:53:04.206023 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07228cdc4a2b4ab7879abadbc5875e23 consensus state has no leader
I20260503 07:53:04.206617 1175 tablet_replica.cc:333] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.206548 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_37f986768ac642648f888ffbcb2cd7bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.206795 1175 raft_consensus.cc:2243] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
W20260503 07:53:04.207032 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37f986768ac642648f888ffbcb2cd7bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.209123 1978 raft_consensus.cc:493] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.209280 1978 raft_consensus.cc:515] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.209724 1175 raft_consensus.cc:2272] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.209883 1978 leader_election.cc:290] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.205225 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f291c68785bb4b6fb522386089fb2af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:51 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.210304 1175 ts_tablet_manager.cc:1916] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.210326 1166 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.210604 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd6a702c59445882a81ca2e3a0f3f6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.211086 716 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.211791 1166 tablet_bootstrap.cc:654] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.208784 1173 ts_tablet_manager.cc:1929] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.212435 1173 log.cc:1199] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/4e1c047f13d94420949c1288b12725a5
I20260503 07:53:04.212715 1173 ts_tablet_manager.cc:1950] T 4e1c047f13d94420949c1288b12725a5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:04.213570 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 4e1c047f13d94420949c1288b12725a5 (table default.Table_305020fe316f4e3b97eb80ada2fdef86 [id=950265919f564f5b81ee0ed33247ad17]) successfully deleted
I20260503 07:53:04.218864 1175 ts_tablet_manager.cc:1929] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:04.220321 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd6a702c59445882a81ca2e3a0f3f6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.220994 715 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.221170 715 leader_election.cc:304] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.222621 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8f078ddc9bae42d9ad01f2a2db9aa8c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.223168 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f078ddc9bae42d9ad01f2a2db9aa8c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.224746 1978 raft_consensus.cc:2749] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.224803 1175 log.cc:1199] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/77fa106f0cc24a35bd23b457660a45dc
I20260503 07:53:04.225183 1175 ts_tablet_manager.cc:1950] T 77fa106f0cc24a35bd23b457660a45dc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.225500 1173 tablet_replica.cc:333] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:04.225710 1173 raft_consensus.cc:2243] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.225955 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 713) took 1629 ms. Trace:
I20260503 07:53:04.226060 1175 rpcz_store.cc:276] 0503 07:53:02.596690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.596737 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:04.206556 (+1609819us) ts_tablet_manager.cc:1151] Deleting tablet 77fa106f0cc24a35bd23b457660a45dc
0503 07:53:04.206566 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.213194 (+ 6628us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.218786 (+ 5592us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.225918 (+ 7132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1609654}
I20260503 07:53:04.226449 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 77fa106f0cc24a35bd23b457660a45dc (table default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]) successfully deleted
I20260503 07:53:04.227226 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 716) took 1508 ms. Trace:
I20260503 07:53:04.228323 1173 raft_consensus.cc:2272] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.229247 1175 rpcz_store.cc:276] 0503 07:53:02.718383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.718449 (+ 66us) service_pool.cc:224] Handling call
0503 07:53:04.226669 (+1508220us) ts_tablet_manager.cc:1151] Deleting tablet b435d9b81275447189fba50c82258955
0503 07:53:04.226677 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.227194 (+ 517us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1491002}
W20260503 07:53:04.229401 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet baf176bdc6d54088846ee5eaf5e61447 (table default.Table_c73353e0401c48e98892a62a22b8496f [id=e71ef6c2ea5144c4953402becac9a79d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet baf176bdc6d54088846ee5eaf5e61447 has no consensus state
W20260503 07:53:04.229679 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b435d9b81275447189fba50c82258955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b435d9b81275447189fba50c82258955 already in progress: creating tablet
I20260503 07:53:04.230073 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 718) took 1386 ms. Trace:
I20260503 07:53:04.230188 1175 rpcz_store.cc:276] 0503 07:53:02.843774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.856222 (+ 12448us) service_pool.cc:224] Handling call
0503 07:53:04.229941 (+1373719us) ts_tablet_manager.cc:1151] Deleting tablet e1efb53c5e184a618316a759b8e7d38e
0503 07:53:04.229950 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.230027 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373461}
I20260503 07:53:04.230511 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 721) took 1328 ms. Trace:
W20260503 07:53:04.230626 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e1efb53c5e184a618316a759b8e7d38e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1efb53c5e184a618316a759b8e7d38e already in progress: creating tablet
I20260503 07:53:04.230602 1175 rpcz_store.cc:276] 0503 07:53:02.901617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.901675 (+ 58us) service_pool.cc:224] Handling call
0503 07:53:04.230396 (+1328721us) ts_tablet_manager.cc:1151] Deleting tablet e2dcbb5010e346fca99dffdbdbb337f4
0503 07:53:04.230405 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.230476 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1328561}
I20260503 07:53:04.230640 1173 ts_tablet_manager.cc:1916] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:04.230998 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e2dcbb5010e346fca99dffdbdbb337f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2dcbb5010e346fca99dffdbdbb337f4 already in progress: creating tablet
I20260503 07:53:04.231324 2113 raft_consensus.cc:493] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.231459 2113 raft_consensus.cc:515] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.232053 2113 leader_election.cc:290] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.233227 986 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: feb88812c6b0459d86bd441926f57ecf
I20260503 07:53:04.233834 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5611ce645f574985a095ac13de58a29c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.234289 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5611ce645f574985a095ac13de58a29c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.240106 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_62c4fd77baad46ce84f266f86f23481a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.240422 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb88812c6b0459d86bd441926f57ecf" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.240939 988 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.241065 988 leader_election.cc:304] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:04.241185 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62c4fd77baad46ce84f266f86f23481a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.241487 2113 raft_consensus.cc:2749] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.245491 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 722) took 1297 ms. Trace:
I20260503 07:53:04.245638 1175 rpcz_store.cc:276] 0503 07:53:02.948405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:02.948470 (+ 65us) service_pool.cc:224] Handling call
0503 07:53:04.245340 (+1296870us) ts_tablet_manager.cc:1151] Deleting tablet f4fd9524157c4225885a1f1831982faa
0503 07:53:04.245354 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.245448 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259437}
W20260503 07:53:04.246160 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f4fd9524157c4225885a1f1831982faa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4fd9524157c4225885a1f1831982faa already in progress: creating tablet
I20260503 07:53:04.246518 1175 tablet_replica.cc:333] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.248284 1175 raft_consensus.cc:2243] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.248509 1175 raft_consensus.cc:2272] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.249085 1175 ts_tablet_manager.cc:1916] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.250209 1171 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.250357 1171 ts_tablet_manager.cc:1403] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.127s user 0.003s sys 0.014s
I20260503 07:53:04.252869 1171 raft_consensus.cc:359] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.252764 1173 ts_tablet_manager.cc:1929] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.253060 1171 raft_consensus.cc:385] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.253141 1171 raft_consensus.cc:740] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.253278 1173 log.cc:1199] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ac8d392c3bb94f03819fae08fc009fbc
I20260503 07:53:04.254513 2113 raft_consensus.cc:493] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.254647 2113 raft_consensus.cc:515] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.255056 1173 ts_tablet_manager.cc:1950] T ac8d392c3bb94f03819fae08fc009fbc P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:04.255309 2113 leader_election.cc:290] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.256626 2113 raft_consensus.cc:493] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.256526 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16d225dde3247d1b61a03cf14b21d63" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.256667 986 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:04.256790 2113 raft_consensus.cc:515] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:04.257239 988 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.257357 2113 leader_election.cc:290] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.257727 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ac8d392c3bb94f03819fae08fc009fbc (table default.Table_f325744f54204131b4a076e2a2712261 [id=a95805f323654a5a9355c882cda4d708]) successfully deleted
I20260503 07:53:04.257364 988 leader_election.cc:304] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.258332 1171 consensus_queue.cc:260] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.258493 1173 tablet_replica.cc:333] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:04.259949 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:04.260434 2174 raft_consensus.cc:2749] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.262019 1171 ts_tablet_manager.cc:1434] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260503 07:53:04.262554 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebec2b05025444ccaf0bf0bb4ab62dae" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.263083 986 leader_election.cc:343] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ebec2b05025444ccaf0bf0bb4ab62dae
W20260503 07:53:04.263415 988 leader_election.cc:343] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.263535 988 leader_election.cc:304] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.264199 2176 raft_consensus.cc:2749] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.270532 1978 raft_consensus.cc:493] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.270666 1978 raft_consensus.cc:515] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.271240 1978 leader_election.cc:290] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.271791 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.272333 716 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.272928 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.273397 715 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.273495 715 leader_election.cc:304] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.273864 1978 raft_consensus.cc:2749] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.276561 1175 ts_tablet_manager.cc:1929] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.276731 1175 log.cc:1199] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/92c1709a2a49475daaa2372360610b1e
I20260503 07:53:04.277169 1175 ts_tablet_manager.cc:1950] T 92c1709a2a49475daaa2372360610b1e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.277495 1171 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.283983 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 727) took 1270 ms. Trace:
I20260503 07:53:04.284210 1175 rpcz_store.cc:276] 0503 07:53:03.007556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.008012 (+ 456us) service_pool.cc:224] Handling call
0503 07:53:04.246450 (+1238438us) ts_tablet_manager.cc:1151] Deleting tablet 92c1709a2a49475daaa2372360610b1e
0503 07:53:04.246459 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.265309 (+ 18850us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.276491 (+ 11182us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.277965 (+ 1474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":1238213}
I20260503 07:53:04.285002 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 92c1709a2a49475daaa2372360610b1e (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
I20260503 07:53:04.285132 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_fd434aa643a94db8b792d842cddbede3 [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 1 got 0
I20260503 07:53:04.285534 1175 tablet_replica.cc:333] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.289045 1175 raft_consensus.cc:2243] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.289436 1175 raft_consensus.cc:2272] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.291065 601 catalog_manager.cc:5671] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:04.291517 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:04.291886 601 catalog_manager.cc:5671] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.292392 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]). Expected version 1 got 0
I20260503 07:53:04.292153 1175 ts_tablet_manager.cc:1916] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.292778 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:04.293040 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:04.293552 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:04.291399 1171 tablet_bootstrap.cc:654] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.298949 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_94e59438b1a64a3892bd09823f11f804" } modify_external_catalogs: true
I20260503 07:53:04.299134 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_94e59438b1a64a3892bd09823f11f804" } modify_external_catalogs: true
I20260503 07:53:04.301142 1165 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.301400 1165 ts_tablet_manager.cc:1403] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.143s user 0.015s sys 0.028s
I20260503 07:53:04.302928 1165 raft_consensus.cc:359] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.303223 1165 raft_consensus.cc:385] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.303344 1165 raft_consensus.cc:740] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.304936 896 tablet_service.cc:1511] Processing CreateTablet for tablet ca703988c5a04a298b21a48b62bb6779 (DEFAULT_TABLE table=default.Table_641a845999b54069807be5903205cfcd [id=f8c0bcef1fa644f9835082a2e4ab03c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.305183 754 tablet_service.cc:1511] Processing CreateTablet for tablet ca703988c5a04a298b21a48b62bb6779 (DEFAULT_TABLE table=default.Table_641a845999b54069807be5903205cfcd [id=f8c0bcef1fa644f9835082a2e4ab03c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.305323 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca703988c5a04a298b21a48b62bb6779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.305541 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca703988c5a04a298b21a48b62bb6779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.310559 1175 ts_tablet_manager.cc:1929] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.311725 1175 log.cc:1199] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/16ea29e3b4a84735bb3723dd11449ec3
I20260503 07:53:04.312481 1175 ts_tablet_manager.cc:1950] T 16ea29e3b4a84735bb3723dd11449ec3 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.312932 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 736) took 1145 ms. Trace:
I20260503 07:53:04.313256 1173 raft_consensus.cc:2243] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.313403 1175 rpcz_store.cc:276] 0503 07:53:03.167362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.167429 (+ 67us) service_pool.cc:224] Handling call
0503 07:53:04.285377 (+1117948us) ts_tablet_manager.cc:1151] Deleting tablet 16ea29e3b4a84735bb3723dd11449ec3
0503 07:53:04.285386 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.295684 (+ 10298us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.310513 (+ 14829us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.312915 (+ 2402us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117698}
I20260503 07:53:04.313601 1173 raft_consensus.cc:2272] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.303699 1165 consensus_queue.cc:260] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.314513 1173 ts_tablet_manager.cc:1916] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.317720 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 16ea29e3b4a84735bb3723dd11449ec3 (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:53:04.317641 1165 ts_tablet_manager.cc:1434] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260503 07:53:04.318122 1175 tablet_replica.cc:333] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.318511 1175 raft_consensus.cc:2243] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.318828 2203 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:04.318898 1175 raft_consensus.cc:2272] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.319485 2204 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:04.319540 1175 ts_tablet_manager.cc:1916] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.322939 1173 ts_tablet_manager.cc:1929] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.323030 1173 log.cc:1199] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c224dc90387c4848a5dd802d0674265d
I20260503 07:53:04.323290 1173 ts_tablet_manager.cc:1950] T c224dc90387c4848a5dd802d0674265d P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:04.323822 1165 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.326874 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ca703988c5a04a298b21a48b62bb6779 (DEFAULT_TABLE table=default.Table_641a845999b54069807be5903205cfcd [id=f8c0bcef1fa644f9835082a2e4ab03c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.327339 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca703988c5a04a298b21a48b62bb6779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.330938 1165 tablet_bootstrap.cc:654] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.342377 896 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6a722c52d4dab8696a20057c15a6a (DEFAULT_TABLE table=default.Table_b7b9520e93814067a84ea66f201d3534 [id=824be5fd44714b7bb344e70b1e5f2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.342733 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6a722c52d4dab8696a20057c15a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.344013 1173 tablet_replica.cc:333] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:04.344218 1173 raft_consensus.cc:2243] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.344221 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c224dc90387c4848a5dd802d0674265d (table default.Table_12c9b352df284d9d9fc74382fdae7380 [id=f740b5eadbc64236a98d7369ae5e7ab8]) successfully deleted
I20260503 07:53:04.344393 1173 raft_consensus.cc:2272] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.346324 1173 ts_tablet_manager.cc:1916] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.351821 1175 ts_tablet_manager.cc:1929] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.352208 754 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6a722c52d4dab8696a20057c15a6a (DEFAULT_TABLE table=default.Table_b7b9520e93814067a84ea66f201d3534 [id=824be5fd44714b7bb344e70b1e5f2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.352715 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6a722c52d4dab8696a20057c15a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.352769 1978 raft_consensus.cc:493] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.352871 1978 raft_consensus.cc:515] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.353377 1978 leader_election.cc:290] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.354394 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b62a991b74c859045a74df7dc716f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.354913 715 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.353840 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b62a991b74c859045a74df7dc716f" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.358093 716 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.358184 716 leader_election.cc:304] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.358573 1978 raft_consensus.cc:2749] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.358844 2176 raft_consensus.cc:493] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.358999 2176 raft_consensus.cc:515] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.359905 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0f87f5ea057349b7a940bfe36a55183d
I20260503 07:53:04.360345 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.360710 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e7ee98eb4e1c43d6b75dffac36f9c655"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.360920 988 leader_election.cc:343] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.361299 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7ee98eb4e1c43d6b75dffac36f9c655 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.363027 2176 leader_election.cc:290] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.363204 1175 log.cc:1199] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f5896bb71c674358957c87a347b8fb79
I20260503 07:53:04.363538 1175 ts_tablet_manager.cc:1950] T f5896bb71c674358957c87a347b8fb79 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.364817 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 738) took 1197 ms. Trace:
I20260503 07:53:04.364910 1175 rpcz_store.cc:276] 0503 07:53:03.167566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.168132 (+ 566us) service_pool.cc:224] Handling call
0503 07:53:04.318074 (+1149942us) ts_tablet_manager.cc:1151] Deleting tablet f5896bb71c674358957c87a347b8fb79
0503 07:53:04.318085 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.330241 (+ 12156us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.351771 (+ 21530us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.364797 (+ 13026us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149753}
I20260503 07:53:04.365255 1175 tablet_replica.cc:333] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.365407 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f87f5ea057349b7a940bfe36a55183d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.365435 1175 raft_consensus.cc:2243] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.365559 1175 raft_consensus.cc:2272] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.366063 1175 ts_tablet_manager.cc:1916] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.366189 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f5896bb71c674358957c87a347b8fb79 (table default.Table_8e054473f51a46658409679b60b4f097 [id=4d435b963bd742c0b3d6da1c384015e6]) successfully deleted
I20260503 07:53:04.364914 1171 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.366582 1171 ts_tablet_manager.cc:1403] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.104s user 0.006s sys 0.003s
W20260503 07:53:04.366681 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0f87f5ea057349b7a940bfe36a55183d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f87f5ea057349b7a940bfe36a55183d already in progress: creating tablet
I20260503 07:53:04.367296 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 6de27712304a49a9aaaeaff474e61f08 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.367295 1171 raft_consensus.cc:359] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.367444 1171 raft_consensus.cc:385] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.367497 1171 raft_consensus.cc:740] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.369052 1171 consensus_queue.cc:260] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.369463 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f87f5ea057349b7a940bfe36a55183d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.369728 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f87f5ea057349b7a940bfe36a55183d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.369987 1171 ts_tablet_manager.cc:1434] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:04.370247 1171 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.371994 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6a722c52d4dab8696a20057c15a6a (DEFAULT_TABLE table=default.Table_b7b9520e93814067a84ea66f201d3534 [id=824be5fd44714b7bb344e70b1e5f2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.372411 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6a722c52d4dab8696a20057c15a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.372339 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.372534 778 raft_consensus.cc:2468] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:04.372887 986 leader_election.cc:304] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.373248 1952 raft_consensus.cc:2804] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.373310 1952 raft_consensus.cc:493] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.373363 1952 raft_consensus.cc:3060] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.374186 1171 tablet_bootstrap.cc:654] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.375631 1952 raft_consensus.cc:515] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.378185 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:04.378732 988 leader_election.cc:343] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.378705 1165 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.379362 1952 leader_election.cc:290] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.379377 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.379518 777 raft_consensus.cc:3060] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.382907 777 raft_consensus.cc:2468] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.383383 986 leader_election.cc:304] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.383946 1952 raft_consensus.cc:2804] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.384261 1952 raft_consensus.cc:697] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.384565 1952 consensus_queue.cc:237] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.387336 1166 tablet_bootstrap.cc:492] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.387506 1166 ts_tablet_manager.cc:1403] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.177s user 0.004s sys 0.000s
I20260503 07:53:04.387773 1165 ts_tablet_manager.cc:1403] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.006s
I20260503 07:53:04.388478 1166 raft_consensus.cc:359] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.388748 1166 raft_consensus.cc:385] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.388844 1166 raft_consensus.cc:740] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.389216 1173 ts_tablet_manager.cc:1929] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.392259 1173 log.cc:1199] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f291c68785bb4b6fb522386089fb2af3
I20260503 07:53:04.390165 896 tablet_service.cc:1511] Processing CreateTablet for tablet ba590d8c7d204e4bbf47ccb67798c49b (DEFAULT_TABLE table=default.Table_1e8e9400225d4c089fb68ec17dedd6a5 [id=0eae3d12a1c54310947d2fddd26cb4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.394416 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 40f24fb277ff43f68dcb0d2ac5faa704
I20260503 07:53:04.394675 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba590d8c7d204e4bbf47ccb67798c49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.395534 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.398729 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:04.399446 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 40f24fb277ff43f68dcb0d2ac5faa704 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f24fb277ff43f68dcb0d2ac5faa704 already in progress: creating tablet
I20260503 07:53:04.389130 1166 consensus_queue.cc:260] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.400292 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d83ff5edb21b430faaf244a27b9283eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.400542 1166 ts_tablet_manager.cc:1434] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20260503 07:53:04.400856 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d83ff5edb21b430faaf244a27b9283eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.400915 1173 ts_tablet_manager.cc:1950] T f291c68785bb4b6fb522386089fb2af3 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:04.401368 1166 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:04.402915 1166 tablet_bootstrap.cc:654] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.403695 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 40f24fb277ff43f68dcb0d2ac5faa704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.404685 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f291c68785bb4b6fb522386089fb2af3 (table default.Table_aedf5ef6a71e40c194d650861851082d [id=f43658cc10984a539500925428f2a94e]) successfully deleted
W20260503 07:53:04.405089 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0f87f5ea057349b7a940bfe36a55183d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f87f5ea057349b7a940bfe36a55183d already in progress: creating tablet
W20260503 07:53:04.405306 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 40f24fb277ff43f68dcb0d2ac5faa704 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f24fb277ff43f68dcb0d2ac5faa704 already in progress: creating tablet
I20260503 07:53:04.406219 754 tablet_service.cc:1511] Processing CreateTablet for tablet ba590d8c7d204e4bbf47ccb67798c49b (DEFAULT_TABLE table=default.Table_1e8e9400225d4c089fb68ec17dedd6a5 [id=0eae3d12a1c54310947d2fddd26cb4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.406627 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba590d8c7d204e4bbf47ccb67798c49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.410591 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ba590d8c7d204e4bbf47ccb67798c49b (DEFAULT_TABLE table=default.Table_1e8e9400225d4c089fb68ec17dedd6a5 [id=0eae3d12a1c54310947d2fddd26cb4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.410377 1165 raft_consensus.cc:359] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.411826 1165 raft_consensus.cc:385] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.412563 1165 raft_consensus.cc:740] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.414225 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 703363a7e1544cf694ab05dab855d1d4
I20260503 07:53:04.415545 1165 consensus_queue.cc:260] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.417375 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 703363a7e1544cf694ab05dab855d1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:04.418541 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 703363a7e1544cf694ab05dab855d1d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703363a7e1544cf694ab05dab855d1d4 already in progress: creating tablet
I20260503 07:53:04.421521 2204 tablet.cc:1724] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.424482 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 703363a7e1544cf694ab05dab855d1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.424491 2234 tablet.cc:1724] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:04.425918 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 703363a7e1544cf694ab05dab855d1d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703363a7e1544cf694ab05dab855d1d4 already in progress: creating tablet
I20260503 07:53:04.430337 1978 raft_consensus.cc:493] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.418357 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 703363a7e1544cf694ab05dab855d1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.419610 1171 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.420770 2203 tablet.cc:1724] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.430459 1978 raft_consensus.cc:515] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.430554 1171 ts_tablet_manager.cc:1403] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.017s
I20260503 07:53:04.430986 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba590d8c7d204e4bbf47ccb67798c49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.431046 1978 leader_election.cc:290] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.431219 1171 raft_consensus.cc:359] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.431373 1171 raft_consensus.cc:385] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.431425 1171 raft_consensus.cc:740] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.431595 1171 consensus_queue.cc:260] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.431981 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac435b09639484ca1ae82f3d4990d48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.432055 1171 ts_tablet_manager.cc:1434] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260503 07:53:04.432312 1171 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:04.432900 716 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.432979 753 tablet_service.cc:1511] Processing CreateTablet for tablet 81403b8a897b4e58a0f301d36d76dc8a (DEFAULT_TABLE table=default.Table_177808a7b6234be8a8f79c240c720c85 [id=23f5bfbb014d4b039b322577efa3b0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.433328 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81403b8a897b4e58a0f301d36d76dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.433533 1171 tablet_bootstrap.cc:654] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.433526 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac435b09639484ca1ae82f3d4990d48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.434036 715 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.434131 715 leader_election.cc:304] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.434471 1978 raft_consensus.cc:2749] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.434895 896 tablet_service.cc:1511] Processing CreateTablet for tablet 81403b8a897b4e58a0f301d36d76dc8a (DEFAULT_TABLE table=default.Table_177808a7b6234be8a8f79c240c720c85 [id=23f5bfbb014d4b039b322577efa3b0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.434973 1165 ts_tablet_manager.cc:1434] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.046s user 0.003s sys 0.000s
I20260503 07:53:04.435249 1165 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.436983 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81403b8a897b4e58a0f301d36d76dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.442513 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 81403b8a897b4e58a0f301d36d76dc8a (DEFAULT_TABLE table=default.Table_177808a7b6234be8a8f79c240c720c85 [id=23f5bfbb014d4b039b322577efa3b0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.451249 597 catalog_manager.cc:5671] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:04.451799 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:04.452932 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81403b8a897b4e58a0f301d36d76dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.457793 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.457859 1165 tablet_bootstrap.cc:654] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.457978 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f86609fc7b4007ab4c730002918613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.459263 1952 consensus_queue.cc:1048] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:04.460208 1171 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.460251 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.460402 1171 ts_tablet_manager.cc:1403] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20260503 07:53:04.460429 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet aa9153d3245f4dcfacf26f174bced2ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.460546 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.464434 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a0728a1f5a0249b89b542847e73c0396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.465246 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0728a1f5a0249b89b542847e73c0396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.465432 1165 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.465586 1165 ts_tablet_manager.cc:1403] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.001s
I20260503 07:53:04.465313 1171 raft_consensus.cc:359] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.466002 1171 raft_consensus.cc:385] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.466408 1171 raft_consensus.cc:740] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.467090 1171 consensus_queue.cc:260] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.468374 1171 ts_tablet_manager.cc:1434] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260503 07:53:04.468509 2174 raft_consensus.cc:493] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.468626 2174 raft_consensus.cc:515] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.468835 1171 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.469164 2174 leader_election.cc:290] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.471483 1171 tablet_bootstrap.cc:654] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.471999 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.472199 777 raft_consensus.cc:2468] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:04.472440 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.472878 986 leader_election.cc:304] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.473129 2176 raft_consensus.cc:2804] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.473186 2176 raft_consensus.cc:493] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.473234 2176 raft_consensus.cc:3060] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.475543 2176 raft_consensus.cc:515] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.476037 2176 leader_election.cc:290] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.476547 988 leader_election.cc:343] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.476986 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.477025 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a65f69a6c145438e8c721fe2096080" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.477173 777 raft_consensus.cc:3060] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:04.477456 988 leader_election.cc:343] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.490335 780 raft_consensus.cc:1275] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:53:04.490823 2176 consensus_queue.cc:1048] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260503 07:53:04.491510 988 consensus_peers.cc:597] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:04.491981 777 raft_consensus.cc:2468] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.493389 986 leader_election.cc:304] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.493422 1165 raft_consensus.cc:359] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.493587 1165 raft_consensus.cc:385] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.493643 1165 raft_consensus.cc:740] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.493824 1165 consensus_queue.cc:260] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.494055 2176 raft_consensus.cc:2804] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.494163 2176 raft_consensus.cc:697] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.494445 1165 ts_tablet_manager.cc:1434] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260503 07:53:04.494376 2176 consensus_queue.cc:237] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.494684 1165 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.495332 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3c54e1e24a1f48788280713893df5928 (DEFAULT_TABLE table=default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c [id=422342826f00463ebaabd7ba272e309c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.495817 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c54e1e24a1f48788280713893df5928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.496544 1165 tablet_bootstrap.cc:654] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.507066 2203 tablet.cc:1724] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.507517 1978 raft_consensus.cc:493] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.507838 1978 raft_consensus.cc:515] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.508553 1978 leader_election.cc:290] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.509196 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc39d127c71412ea867a0b3cad10452" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.510056 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc39d127c71412ea867a0b3cad10452" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.510257 1052 raft_consensus.cc:2468] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:04.510736 716 leader_election.cc:304] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.510882 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74af21d58e4fe7aaad590adff10c4e (DEFAULT_TABLE table=default.Table_4483da8794df4f2a94b7b28908a76dc2 [id=6b6d727108754e3088b7ebfa5ca01eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.511310 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74af21d58e4fe7aaad590adff10c4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.511287 715 leader_election.cc:343] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.511669 1978 raft_consensus.cc:2804] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.511745 1978 raft_consensus.cc:493] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.511811 1978 raft_consensus.cc:3060] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.514655 1978 raft_consensus.cc:515] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.516418 753 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74af21d58e4fe7aaad590adff10c4e (DEFAULT_TABLE table=default.Table_4483da8794df4f2a94b7b28908a76dc2 [id=6b6d727108754e3088b7ebfa5ca01eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.516487 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc39d127c71412ea867a0b3cad10452" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.516855 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74af21d58e4fe7aaad590adff10c4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.516959 715 leader_election.cc:343] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.517701 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc39d127c71412ea867a0b3cad10452" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:04.517867 1052 raft_consensus.cc:3060] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.522163 1978 leader_election.cc:290] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.523205 1052 raft_consensus.cc:2468] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:04.523648 716 leader_election.cc:304] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.426668 1175 ts_tablet_manager.cc:1929] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.524425 1175 log.cc:1199] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b028017b7cc74ef6a199d6b9e0ba6e14
I20260503 07:53:04.524660 1978 raft_consensus.cc:2804] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.524921 1175 ts_tablet_manager.cc:1950] T b028017b7cc74ef6a199d6b9e0ba6e14 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.525060 2204 tablet.cc:1724] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:04.525296 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 737) took 1357 ms. Trace:
I20260503 07:53:04.525360 1175 rpcz_store.cc:276] 0503 07:53:03.167473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.168551 (+ 1078us) service_pool.cc:224] Handling call
0503 07:53:04.365212 (+1196661us) ts_tablet_manager.cc:1151] Deleting tablet b028017b7cc74ef6a199d6b9e0ba6e14
0503 07:53:04.365224 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.405846 (+ 40622us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.426598 (+ 20752us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.525272 (+ 98674us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196505}
I20260503 07:53:04.525731 1978 raft_consensus.cc:697] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:04.526049 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 749) took 1219 ms. Trace:
I20260503 07:53:04.526065 1978 consensus_queue.cc:237] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.526171 1175 rpcz_store.cc:276] 0503 07:53:03.306791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.306990 (+ 199us) service_pool.cc:224] Handling call
0503 07:53:04.525952 (+1218962us) ts_tablet_manager.cc:1151] Deleting tablet a0e9349f195a406083c9a7e1432f1237
0503 07:53:04.525960 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.526037 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218756}
I20260503 07:53:04.526619 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 762) took 1009 ms. Trace:
I20260503 07:53:04.526727 1175 rpcz_store.cc:276] 0503 07:53:03.517022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.524459 (+ 7437us) service_pool.cc:224] Handling call
0503 07:53:04.526524 (+1002065us) ts_tablet_manager.cc:1151] Deleting tablet 9207707e4ce14e70a6df9578c6bd54b6
0503 07:53:04.526532 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.526607 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001838}
I20260503 07:53:04.527134 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 760) took 1012 ms. Trace:
I20260503 07:53:04.527238 1175 rpcz_store.cc:276] 0503 07:53:03.514540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.535545 (+ 21005us) service_pool.cc:224] Handling call
0503 07:53:04.527044 (+991499us) ts_tablet_manager.cc:1151] Deleting tablet 6fb49d5b35994fe9b383b72f77eaebb6
0503 07:53:04.527051 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.527122 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":989404}
I20260503 07:53:04.527606 1175 tablet_replica.cc:333] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.527845 1175 raft_consensus.cc:2243] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.528034 1175 raft_consensus.cc:2272] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.528388 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b028017b7cc74ef6a199d6b9e0ba6e14 (table default.Table_569d7dd42684487a89c9749674c78b1a [id=1773e021ed7c489aa09d73e171b34837]) successfully deleted
I20260503 07:53:04.528630 1175 ts_tablet_manager.cc:1916] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:04.528662 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet a0e9349f195a406083c9a7e1432f1237 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e9349f195a406083c9a7e1432f1237 already in progress: creating tablet
W20260503 07:53:04.528872 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9207707e4ce14e70a6df9578c6bd54b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9207707e4ce14e70a6df9578c6bd54b6 already in progress: creating tablet
W20260503 07:53:04.529129 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6fb49d5b35994fe9b383b72f77eaebb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fb49d5b35994fe9b383b72f77eaebb6 already in progress: creating tablet
I20260503 07:53:04.530954 885 tablet_service.cc:1511] Processing CreateTablet for tablet 08aeef444e99416fa75b99755906c28d (DEFAULT_TABLE table=default.Table_97c7d65a379943f69aa29ae4f54a330f [id=7d54d32865e7470394847112dc130501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.531427 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08aeef444e99416fa75b99755906c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.536425 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 08aeef444e99416fa75b99755906c28d (DEFAULT_TABLE table=default.Table_97c7d65a379943f69aa29ae4f54a330f [id=7d54d32865e7470394847112dc130501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.536621 2241 raft_consensus.cc:493] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.536748 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08aeef444e99416fa75b99755906c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.536831 2241 raft_consensus.cc:515] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.539556 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bf46b34b1043e2ab6c9f8b2c871227" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.540079 716 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.540583 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b769c5cb48d147fd82aac92492b18af6 (DEFAULT_TABLE table=default.Table_d23e2aa8107a4c61a4925d15108a821d [id=0850f1325bff4c06bf69b937020c0672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.540928 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b769c5cb48d147fd82aac92492b18af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.541726 2241 leader_election.cc:290] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.542270 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ab44832fbf224a069d958cf745d914f8
I20260503 07:53:04.542685 598 catalog_manager.cc:6741] ReplaceTablet: tablet ab44832fbf224a069d958cf745d914f8 deleted and replaced by tablet 1905c11361bb445bb54ef394b76bbefe
I20260503 07:53:04.544435 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 797372a021aa48bab4ca695d897164d8 (DEFAULT_TABLE table=default.Table_9bf17cb5fa4646b29781ef58efff2450 [id=f5a1cf7572d640cf8dad4c6eaec276cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.544796 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797372a021aa48bab4ca695d897164d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.546453 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6772fe0377b249be9e247ec93cf50719
I20260503 07:53:04.547308 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e36e6f971c5e4929b42bb522e91d4eba
I20260503 07:53:04.547741 594 catalog_manager.cc:6741] ReplaceTablet: tablet e36e6f971c5e4929b42bb522e91d4eba deleted and replaced by tablet 579b36bfb4794a34907720b8b75ebf5c
I20260503 07:53:04.548245 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet eccf6c7770554ba3861e4add2f7f180a
I20260503 07:53:04.548676 592 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 950) took 1042 ms. Trace:
I20260503 07:53:04.548770 592 rpcz_store.cc:276] 0503 07:53:03.505698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.890913 (+385215us) service_pool.cc:224] Handling call
0503 07:53:03.896101 (+ 5188us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9db06 00007ff8f7832486 00007ff8f78321b5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:03.896452 (+ 351us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:03.896575 (+ 123us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:03.896632 (+ 57us) catalog_manager.cc:2824] Locking tablets
0503 07:53:04.302595 (+405963us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:04.548071 (+245476us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:04.548144 (+ 73us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:04.548205 (+ 61us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:04.548626 (+ 421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:04.471484 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:04.471624 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:04.471628 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:04.471630 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:04.471704 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:04.471712 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:04.471716 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:04.471804 (+ 88us) tablet.cc:701] Row locks acquired
0503 07:53:04.471806 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:04.471831 (+ 25us) write_op.cc:270] Start()
0503 07:53:04.471853 (+ 22us) write_op.cc:276] Timestamp: P: 1777794784471783 usec, L: 0
0503 07:53:04.471856 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:04.472530 (+ 674us) log.cc:844] Serialized 725 byte log entry
0503 07:53:04.544841 (+ 72311us) op_driver.cc:464] REPLICATION: finished
0503 07:53:04.545957 (+ 1116us) write_op.cc:301] APPLY: starting
0503 07:53:04.545965 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:04.545991 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:04.546009 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:04.546058 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:04.546089 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:04.546095 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:04.546138 (+ 43us) log.cc:844] Serialized 29 byte log entry
0503 07:53:04.546170 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:04.546181 (+ 11us) write_op.cc:454] Released schema lock
0503 07:53:04.546185 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":11385088,"child_traces":[["op",{"apply.queue_time_us":1087,"apply.run_cpu_time_us":272,"apply.run_wall_time_us":273,"num_ops":2,"prepare.queue_time_us":168390,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":6146,"replication_time_us":72969,"threads_started":1}]]}
I20260503 07:53:04.549870 757 tablet_service.cc:1511] Processing CreateTablet for tablet 17b58e042a6442658d95d373409fa25e (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.540115 879 tablet_service.cc:1511] Processing CreateTablet for tablet 17b58e042a6442658d95d373409fa25e (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.550305 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b58e042a6442658d95d373409fa25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.550460 750 tablet_service.cc:1511] Processing CreateTablet for tablet b769c5cb48d147fd82aac92492b18af6 (DEFAULT_TABLE table=default.Table_d23e2aa8107a4c61a4925d15108a821d [id=0850f1325bff4c06bf69b937020c0672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.550879 759 tablet_service.cc:1511] Processing CreateTablet for tablet 797372a021aa48bab4ca695d897164d8 (DEFAULT_TABLE table=default.Table_9bf17cb5fa4646b29781ef58efff2450 [id=f5a1cf7572d640cf8dad4c6eaec276cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.551124 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ab44832fbf224a069d958cf745d914f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1905c11361bb445bb54ef394b76bbefe) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.551369 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ab44832fbf224a069d958cf745d914f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1905c11361bb445bb54ef394b76bbefe) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.551505 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b58e042a6442658d95d373409fa25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.551561 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6772fe0377b249be9e247ec93cf50719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.551671 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet e36e6f971c5e4929b42bb522e91d4eba with delete_type TABLET_DATA_DELETED (replaced by tablet 579b36bfb4794a34907720b8b75ebf5c) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.551860 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet eccf6c7770554ba3861e4add2f7f180a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.552896 884 tablet_service.cc:1558] Processing DeleteTablet for tablet ab44832fbf224a069d958cf745d914f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1905c11361bb445bb54ef394b76bbefe) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.553071 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 6772fe0377b249be9e247ec93cf50719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.554625 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 6772fe0377b249be9e247ec93cf50719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.554847 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e36e6f971c5e4929b42bb522e91d4eba with delete_type TABLET_DATA_DELETED (replaced by tablet 579b36bfb4794a34907720b8b75ebf5c) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.555029 747 tablet_service.cc:1558] Processing DeleteTablet for tablet eccf6c7770554ba3861e4add2f7f180a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:04.555387 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ab44832fbf224a069d958cf745d914f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab44832fbf224a069d958cf745d914f8 already in progress: creating tablet
W20260503 07:53:04.555603 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6772fe0377b249be9e247ec93cf50719 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6772fe0377b249be9e247ec93cf50719 already in progress: creating tablet
I20260503 07:53:04.559381 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:04.538308 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bf46b34b1043e2ab6c9f8b2c871227" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.559728 891 tablet_service.cc:1511] Processing CreateTablet for tablet b769c5cb48d147fd82aac92492b18af6 (DEFAULT_TABLE table=default.Table_d23e2aa8107a4c61a4925d15108a821d [id=0850f1325bff4c06bf69b937020c0672]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.560039 715 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.560091 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b769c5cb48d147fd82aac92492b18af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.560137 715 leader_election.cc:304] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.560524 2241 raft_consensus.cc:2749] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.564287 889 tablet_service.cc:1558] Processing DeleteTablet for tablet e36e6f971c5e4929b42bb522e91d4eba with delete_type TABLET_DATA_DELETED (replaced by tablet 579b36bfb4794a34907720b8b75ebf5c) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.564661 892 tablet_service.cc:1511] Processing CreateTablet for tablet 797372a021aa48bab4ca695d897164d8 (DEFAULT_TABLE table=default.Table_9bf17cb5fa4646b29781ef58efff2450 [id=f5a1cf7572d640cf8dad4c6eaec276cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.565142 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797372a021aa48bab4ca695d897164d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.566887 917 raft_consensus.cc:3060] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.553242 880 tablet_service.cc:1558] Processing DeleteTablet for tablet eccf6c7770554ba3861e4add2f7f180a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:03 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:04.569231 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797372a021aa48bab4ca695d897164d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.572623 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b769c5cb48d147fd82aac92492b18af6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.573607 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ab44832fbf224a069d958cf745d914f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab44832fbf224a069d958cf745d914f8 already in progress: creating tablet
I20260503 07:53:04.573694 2113 raft_consensus.cc:493] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:04.573868 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6772fe0377b249be9e247ec93cf50719 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6772fe0377b249be9e247ec93cf50719 already in progress: creating tablet
I20260503 07:53:04.573808 2113 raft_consensus.cc:515] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:04.574055 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e36e6f971c5e4929b42bb522e91d4eba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36e6f971c5e4929b42bb522e91d4eba already in progress: creating tablet
W20260503 07:53:04.574245 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet eccf6c7770554ba3861e4add2f7f180a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eccf6c7770554ba3861e4add2f7f180a already in progress: creating tablet
I20260503 07:53:04.574424 2113 leader_election.cc:290] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.574803 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e36e6f971c5e4929b42bb522e91d4eba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36e6f971c5e4929b42bb522e91d4eba already in progress: creating tablet
W20260503 07:53:04.575018 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet eccf6c7770554ba3861e4add2f7f180a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eccf6c7770554ba3861e4add2f7f180a already in progress: creating tablet
I20260503 07:53:04.576545 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bdaa3dd3a844d8b57def2b9faa03d8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.577275 986 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b5bdaa3dd3a844d8b57def2b9faa03d8
W20260503 07:53:04.577517 988 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.577639 988 leader_election.cc:304] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.578030 2113 raft_consensus.cc:2749] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.580864 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c07d1c22bddc4542a2548c783107cd3c" } new_table_name: "default.Table_c8358ee48d14474cb1bfb40be55ee485" modify_external_catalogs: true
I20260503 07:53:04.582312 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ded7810841684e97ba79192f06d51bff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.582428 988 consensus_peers.cc:597] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:04.582790 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ded7810841684e97ba79192f06d51bff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.584153 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_39fbb94c49ba4745b175e809b6cea52e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.584589 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39fbb94c49ba4745b175e809b6cea52e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.593964 595 master_service.cc:954] ReplaceTablet: received request to replace tablet 9e162006cee34182b51f97629a174509 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.594339 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6de27712304a49a9aaaeaff474e61f08
I20260503 07:53:04.594765 599 catalog_manager.cc:6741] ReplaceTablet: tablet 6de27712304a49a9aaaeaff474e61f08 deleted and replaced by tablet 91b9a724c6354a9eb17cc024c8f84669
I20260503 07:53:04.598124 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6de27712304a49a9aaaeaff474e61f08 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b9a724c6354a9eb17cc024c8f84669) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:04.598721 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6de27712304a49a9aaaeaff474e61f08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de27712304a49a9aaaeaff474e61f08 already in progress: creating tablet
I20260503 07:53:04.601475 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 6de27712304a49a9aaaeaff474e61f08 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b9a724c6354a9eb17cc024c8f84669) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:04.601972 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74af21d58e4fe7aaad590adff10c4e (DEFAULT_TABLE table=default.Table_4483da8794df4f2a94b7b28908a76dc2 [id=6b6d727108754e3088b7ebfa5ca01eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.602421 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74af21d58e4fe7aaad590adff10c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.604667 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6de27712304a49a9aaaeaff474e61f08 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b9a724c6354a9eb17cc024c8f84669) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:04.605257 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6de27712304a49a9aaaeaff474e61f08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de27712304a49a9aaaeaff474e61f08 already in progress: creating tablet
I20260503 07:53:04.606560 753 tablet_service.cc:1511] Processing CreateTablet for tablet 08aeef444e99416fa75b99755906c28d (DEFAULT_TABLE table=default.Table_97c7d65a379943f69aa29ae4f54a330f [id=7d54d32865e7470394847112dc130501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.607338 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_21181bc56266453cb0d0e66c438426ce" } new_table_name: "default.Table_53b5921c9e6d47b9bd7413ec80361d51" modify_external_catalogs: true
I20260503 07:53:04.608394 1171 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.608549 1171 ts_tablet_manager.cc:1403] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.140s user 0.017s sys 0.040s
I20260503 07:53:04.608963 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1e5903e6c78e49cdb24528dcdd8ec0ea" } new_table_name: "default.Table_b15c133b67274af2aadcda424ddb5ed7" modify_external_catalogs: true
I20260503 07:53:04.609634 1171 raft_consensus.cc:359] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.609881 1171 raft_consensus.cc:385] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.609970 1171 raft_consensus.cc:740] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.610268 1171 consensus_queue.cc:260] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.611210 1171 ts_tablet_manager.cc:1434] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:04.612794 1171 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.613204 1165 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.613305 1165 ts_tablet_manager.cc:1403] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.119s user 0.004s sys 0.000s
I20260503 07:53:04.614046 1165 raft_consensus.cc:359] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.614189 1165 raft_consensus.cc:385] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.614234 1165 raft_consensus.cc:740] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.614423 1165 consensus_queue.cc:260] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.615005 1165 ts_tablet_manager.cc:1434] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:04.615664 1171 tablet_bootstrap.cc:654] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.650202 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08aeef444e99416fa75b99755906c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.650288 1165 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.650241 2241 raft_consensus.cc:493] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.650478 2241 raft_consensus.cc:515] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.651101 2241 leader_election.cc:290] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.651929 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.652475 716 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.652560 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.653120 715 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.653232 715 leader_election.cc:304] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.653620 2241 raft_consensus.cc:2749] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.654153 1165 tablet_bootstrap.cc:654] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.655541 2241 raft_consensus.cc:493] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.655689 2241 raft_consensus.cc:515] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.656307 2241 leader_election.cc:290] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.656854 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:04.657316 716 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.657294 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.657789 715 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.657897 715 leader_election.cc:304] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.660333 2176 raft_consensus.cc:493] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.660454 2176 raft_consensus.cc:515] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.660594 2241 raft_consensus.cc:2749] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.661000 2176 leader_election.cc:290] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.662817 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.662981 778 raft_consensus.cc:2468] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:04.663479 986 leader_election.cc:304] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.663993 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.664568 988 leader_election.cc:343] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.664918 2176 raft_consensus.cc:2804] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.664985 2176 raft_consensus.cc:493] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.665036 2176 raft_consensus.cc:3060] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.664943 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3c54e1e24a1f48788280713893df5928 (DEFAULT_TABLE table=default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c [id=422342826f00463ebaabd7ba272e309c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.665355 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c54e1e24a1f48788280713893df5928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.667514 2176 raft_consensus.cc:515] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.668541 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:04.669063 988 leader_election.cc:343] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.669867 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.670014 778 raft_consensus.cc:3060] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.673247 778 raft_consensus.cc:2468] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.673794 986 leader_election.cc:304] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.674041 1952 raft_consensus.cc:2804] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.674127 1952 raft_consensus.cc:697] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.674330 1952 consensus_queue.cc:237] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.675592 2241 raft_consensus.cc:493] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.675699 2241 raft_consensus.cc:515] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.676252 2241 leader_election.cc:290] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.676703 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.676841 1052 raft_consensus.cc:2468] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:04.676954 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.677309 716 leader_election.cc:304] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:04.677449 715 leader_election.cc:343] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.677784 2241 raft_consensus.cc:2804] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.677855 2241 raft_consensus.cc:493] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.677906 2241 raft_consensus.cc:3060] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.678797 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3d454384a9da4ca3ae6089eac78d92a7" } new_table_name: "default.Table_ca056b819de74bf8b0deed491d863e02" modify_external_catalogs: true
I20260503 07:53:04.680343 2176 leader_election.cc:290] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.681512 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3c54e1e24a1f48788280713893df5928 (DEFAULT_TABLE table=default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c [id=422342826f00463ebaabd7ba272e309c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.682634 2241 raft_consensus.cc:515] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.684928 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.685240 2241 leader_election.cc:290] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:04.685518 715 leader_election.cc:343] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.685114 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:04.687358 1171 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.691218 1052 raft_consensus.cc:3060] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.691254 1171 ts_tablet_manager.cc:1403] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.079s user 0.019s sys 0.014s
I20260503 07:53:04.691356 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c54e1e24a1f48788280713893df5928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.691948 1171 raft_consensus.cc:359] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.692070 1171 raft_consensus.cc:385] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.692118 1171 raft_consensus.cc:740] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.692289 1171 consensus_queue.cc:260] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.692739 1171 ts_tablet_manager.cc:1434] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:53:04.693006 1171 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.693638 1052 raft_consensus.cc:2468] T 08cfc6488f404a14af0b7aca20710101 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:04.694093 716 leader_election.cc:304] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.694686 1171 tablet_bootstrap.cc:654] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.694881 2241 raft_consensus.cc:2804] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.695497 2241 raft_consensus.cc:697] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:04.696107 2241 consensus_queue.cc:237] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.698953 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 17b58e042a6442658d95d373409fa25e (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.699424 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b58e042a6442658d95d373409fa25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.704792 1952 raft_consensus.cc:493] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.704918 1952 raft_consensus.cc:515] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.705430 1952 leader_election.cc:290] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.706637 986 leader_election.cc:343] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 596130e78eb1444a96480fc1075478cd
I20260503 07:53:04.712142 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:04.714524 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:04.714890 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]). Expected version 1 got 0
I20260503 07:53:04.715260 598 catalog_manager.cc:5671] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.715845 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_fd434aa643a94db8b792d842cddbede3 [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 1 got 0
I20260503 07:53:04.716408 598 catalog_manager.cc:5671] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.717129 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:04.717470 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:04.717741 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:04.718008 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:04.718461 598 catalog_manager.cc:5671] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.718969 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:04.719436 598 catalog_manager.cc:5671] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.720221 598 catalog_manager.cc:5671] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:04.720862 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:04.730906 892 tablet_service.cc:1511] Processing CreateTablet for tablet 477d24ea5c8c42e1a8614f30859e36df (DEFAULT_TABLE table=default.Table_f6e42e25b016431f818e2d8fd9d3c5ba [id=ed4b1a2669844aef9e7eb24cf1a446cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.731654 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477d24ea5c8c42e1a8614f30859e36df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.734731 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f331a5d6fa53414699446191d6622545" } new_table_name: "default.Table_f5c89a6d8ef0470aa5c38d69321e49a8" modify_external_catalogs: true
I20260503 07:53:04.747905 1165 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:04.748335 1165 ts_tablet_manager.cc:1403] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.098s user 0.005s sys 0.005s
I20260503 07:53:04.749933 1165 raft_consensus.cc:359] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.750625 1165 raft_consensus.cc:385] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.750821 750 tablet_service.cc:1511] Processing CreateTablet for tablet 477d24ea5c8c42e1a8614f30859e36df (DEFAULT_TABLE table=default.Table_f6e42e25b016431f818e2d8fd9d3c5ba [id=ed4b1a2669844aef9e7eb24cf1a446cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.750838 1165 raft_consensus.cc:740] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.751230 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477d24ea5c8c42e1a8614f30859e36df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.751542 1165 consensus_queue.cc:260] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:04.757071 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8c26bdda34a4bb9b980401ad6f0cad2 consensus state has no leader
I20260503 07:53:04.758733 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a66ef721a023434faffe15f6e6898fc1 (DEFAULT_TABLE table=default.Table_db4eb84f6f264f13b5921eb799ae104b [id=87f3bad4db5a474b93a7832243df6bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.759182 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66ef721a023434faffe15f6e6898fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.759778 880 tablet_service.cc:1511] Processing CreateTablet for tablet d24ae9e604144ca589008d6697d849df (DEFAULT_TABLE table=default.Table_e05a268800c741258262ebbef730615c [id=dbf203201f404830bb84ca8b8dac4e93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.760075 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ac9db54171c456ca30c0cc65984d36c consensus state has no leader
I20260503 07:53:04.760221 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ae9e604144ca589008d6697d849df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.760447 1014 tablet_service.cc:1511] Processing CreateTablet for tablet b8c26bdda34a4bb9b980401ad6f0cad2 (DEFAULT_TABLE table=default.Table_c8358ee48d14474cb1bfb40be55ee485 [id=e3772aa84ce74e5bb28cb957e7950a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.760753 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c26bdda34a4bb9b980401ad6f0cad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.760720 759 tablet_service.cc:1511] Processing CreateTablet for tablet b8c26bdda34a4bb9b980401ad6f0cad2 (DEFAULT_TABLE table=default.Table_c8358ee48d14474cb1bfb40be55ee485 [id=e3772aa84ce74e5bb28cb957e7950a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.761085 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c26bdda34a4bb9b980401ad6f0cad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.764444 879 tablet_service.cc:1511] Processing CreateTablet for tablet b8c26bdda34a4bb9b980401ad6f0cad2 (DEFAULT_TABLE table=default.Table_c8358ee48d14474cb1bfb40be55ee485 [id=e3772aa84ce74e5bb28cb957e7950a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.764786 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c26bdda34a4bb9b980401ad6f0cad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.767804 750 tablet_service.cc:1511] Processing CreateTablet for tablet a66ef721a023434faffe15f6e6898fc1 (DEFAULT_TABLE table=default.Table_db4eb84f6f264f13b5921eb799ae104b [id=87f3bad4db5a474b93a7832243df6bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.768128 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66ef721a023434faffe15f6e6898fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.768344 1165 ts_tablet_manager.cc:1434] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260503 07:53:04.770093 1165 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:04.774410 891 tablet_service.cc:1511] Processing CreateTablet for tablet a66ef721a023434faffe15f6e6898fc1 (DEFAULT_TABLE table=default.Table_db4eb84f6f264f13b5921eb799ae104b [id=87f3bad4db5a474b93a7832243df6bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.774797 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66ef721a023434faffe15f6e6898fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.778656 1175 ts_tablet_manager.cc:1929] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.780076 759 tablet_service.cc:1511] Processing CreateTablet for tablet d24ae9e604144ca589008d6697d849df (DEFAULT_TABLE table=default.Table_e05a268800c741258262ebbef730615c [id=dbf203201f404830bb84ca8b8dac4e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.781278 1166 tablet_bootstrap.cc:492] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:04.781450 1166 ts_tablet_manager.cc:1403] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.380s user 0.020s sys 0.023s
I20260503 07:53:04.782418 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b (DEFAULT_TABLE table=default.Table_259dfd3e0f54418c84a01d011786ebdb [id=d8b6f49f9472416fb3d73fdffe353892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.782709 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25b29188224fbe98ee8c6f6b7b956b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.785544 1175 log.cc:1199] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:53:04.780609 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d24ae9e604144ca589008d6697d849df (DEFAULT_TABLE table=default.Table_e05a268800c741258262ebbef730615c [id=dbf203201f404830bb84ca8b8dac4e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.785846 1175 ts_tablet_manager.cc:1950] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.785945 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ae9e604144ca589008d6697d849df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.786518 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 764) took 1146 ms. Trace:
I20260503 07:53:04.786600 1175 rpcz_store.cc:276] 0503 07:53:03.639772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.640028 (+ 256us) service_pool.cc:224] Handling call
0503 07:53:04.527571 (+887543us) ts_tablet_manager.cc:1151] Deleting tablet 75419ed8fabc4c36ae2d2b128ec4f5b5
0503 07:53:04.527578 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.774963 (+247385us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.778615 (+ 3652us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:04.786500 (+ 7885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":887339}
I20260503 07:53:04.786949 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
I20260503 07:53:04.787272 757 tablet_service.cc:1511] Processing CreateTablet for tablet bb406f1ca50e480e8f621106620fa261 (DEFAULT_TABLE table=default.Table_32a0cef7755c4b14b4b97855b791b883 [id=394a930e05824754bc3942c4b2d4f12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.787964 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b (DEFAULT_TABLE table=default.Table_259dfd3e0f54418c84a01d011786ebdb [id=d8b6f49f9472416fb3d73fdffe353892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.788344 884 tablet_service.cc:1511] Processing CreateTablet for tablet c5a592a14c3e4659ba81754cbe62c438 (DEFAULT_TABLE table=default.Table_709c32e6c48c4f3cac8a32c47d3c8db9 [id=8143d6d8c64d463889e8f3998d016b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.788666 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a592a14c3e4659ba81754cbe62c438. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.790112 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31864ef969e94f5e9e9a7987ed88feb6 consensus state has no leader
I20260503 07:53:04.790153 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c5a592a14c3e4659ba81754cbe62c438 (DEFAULT_TABLE table=default.Table_709c32e6c48c4f3cac8a32c47d3c8db9 [id=8143d6d8c64d463889e8f3998d016b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.790464 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a592a14c3e4659ba81754cbe62c438. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.790767 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 949c2dc3bcb144578739aec2ea066fdf consensus state has no leader
I20260503 07:53:04.791221 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71] alter complete (version 1)
I20260503 07:53:04.791265 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 765) took 1107 ms. Trace:
I20260503 07:53:04.791326 1175 rpcz_store.cc:276] 0503 07:53:03.683599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.683654 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:04.791149 (+1107495us) ts_tablet_manager.cc:1151] Deleting tablet 57dd3c136b364aee91a733132d4caef5
0503 07:53:04.791157 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.791249 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107301}
I20260503 07:53:04.791733 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 766) took 1067 ms. Trace:
I20260503 07:53:04.791796 1175 rpcz_store.cc:276] 0503 07:53:03.724379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:03.725849 (+ 1470us) service_pool.cc:224] Handling call
0503 07:53:04.791643 (+1065794us) ts_tablet_manager.cc:1151] Deleting tablet 24e6193c682b44c5aec60cb6e64a7fac
0503 07:53:04.791652 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:04.791718 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1065610}
I20260503 07:53:04.793612 897 tablet_service.cc:1511] Processing CreateTablet for tablet 784f3f234927484d8e9cca834f738c98 (DEFAULT_TABLE table=default.Table_1c68da010fec44829aa7de3ba818cc1a [id=e7759e4681d647bf81134d2353ef4861]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.794214 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 57dd3c136b364aee91a733132d4caef5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57dd3c136b364aee91a733132d4caef5 already in progress: creating tablet
W20260503 07:53:04.794451 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 24e6193c682b44c5aec60cb6e64a7fac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24e6193c682b44c5aec60cb6e64a7fac already in progress: creating tablet
I20260503 07:53:04.794557 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 (DEFAULT_TABLE table=default.Table_788af50afe2f4b44a37aad1c77d49d22 [id=590b6ee4ed874837a64dd6a67483495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.794821 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bffda3cc5e8484ea1666c788a11a6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.794844 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 784f3f234927484d8e9cca834f738c98 (DEFAULT_TABLE table=default.Table_1c68da010fec44829aa7de3ba818cc1a [id=e7759e4681d647bf81134d2353ef4861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.795111 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784f3f234927484d8e9cca834f738c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.785286 1014 tablet_service.cc:1511] Processing CreateTablet for tablet bb406f1ca50e480e8f621106620fa261 (DEFAULT_TABLE table=default.Table_32a0cef7755c4b14b4b97855b791b883 [id=394a930e05824754bc3942c4b2d4f12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.797379 2241 raft_consensus.cc:493] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.797500 2241 raft_consensus.cc:515] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.798100 2241 leader_election.cc:290] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.799019 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:04.799485 715 leader_election.cc:343] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.800820 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4f7c8dcb2640af8d4426cc69f8ba37 already in progress: creating tablet
W20260503 07:53:04.801090 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f7fed679a54441b591801542b9e8dc22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7fed679a54441b591801542b9e8dc22 already in progress: creating tablet
W20260503 07:53:04.801360 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f9e78eb6d2a3489dbb15806dd93867a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9e78eb6d2a3489dbb15806dd93867a4 already in progress: creating tablet
W20260503 07:53:04.801594 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0f87f5ea057349b7a940bfe36a55183d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f87f5ea057349b7a940bfe36a55183d already in progress: creating tablet
W20260503 07:53:04.801862 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 40f24fb277ff43f68dcb0d2ac5faa704 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f24fb277ff43f68dcb0d2ac5faa704 already in progress: creating tablet
W20260503 07:53:04.802088 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 703363a7e1544cf694ab05dab855d1d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703363a7e1544cf694ab05dab855d1d4 already in progress: creating tablet
I20260503 07:53:04.804513 747 tablet_service.cc:1511] Processing CreateTablet for tablet c5a592a14c3e4659ba81754cbe62c438 (DEFAULT_TABLE table=default.Table_709c32e6c48c4f3cac8a32c47d3c8db9 [id=8143d6d8c64d463889e8f3998d016b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.804909 758 tablet_service.cc:1511] Processing CreateTablet for tablet 784f3f234927484d8e9cca834f738c98 (DEFAULT_TABLE table=default.Table_1c68da010fec44829aa7de3ba818cc1a [id=e7759e4681d647bf81134d2353ef4861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.805162 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.805338 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.805490 744 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.805565 748 tablet_service.cc:1511] Processing CreateTablet for tablet f158ee50be904cee95383a3808f148f2 (DEFAULT_TABLE table=default.Table_9646530ccdda41a5a44559346f8868a0 [id=26d4f80f88694ecf8be34919ae4cf674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.805655 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.805811 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.805958 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.806113 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:04.806387 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 (DEFAULT_TABLE table=default.Table_788af50afe2f4b44a37aad1c77d49d22 [id=590b6ee4ed874837a64dd6a67483495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.806809 743 tablet_service.cc:1511] Processing CreateTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.807521 752 tablet_service.cc:1511] Processing CreateTablet for tablet 25e59c5111f0465d856344b0a18e5756 (DEFAULT_TABLE table=default.Table_68406bd365a8436db1ba7c29c23aa199 [id=d491135505de4fac8f2a6e574630f7b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.807788 746 tablet_service.cc:1511] Processing CreateTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b (DEFAULT_TABLE table=default.Table_b79b96b9ab1542e48bd33c363698ae1f [id=703753c1ffcb48639d98a339484ffaeb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.810256 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 423d4178b5c040d5b12f0f225d112449 consensus state has no leader
I20260503 07:53:04.810494 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 34fa92517beb4622bdfa3fd824e78648 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:04.812287 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ae9e604144ca589008d6697d849df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.815007 882 tablet_service.cc:1511] Processing CreateTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b (DEFAULT_TABLE table=default.Table_b79b96b9ab1542e48bd33c363698ae1f [id=703753c1ffcb48639d98a339484ffaeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.815760 894 tablet_service.cc:1511] Processing CreateTablet for tablet bb406f1ca50e480e8f621106620fa261 (DEFAULT_TABLE table=default.Table_32a0cef7755c4b14b4b97855b791b883 [id=394a930e05824754bc3942c4b2d4f12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.816437 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e37bc65d9d14a65a78bde18730ebace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.816618 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb406f1ca50e480e8f621106620fa261. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.816972 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e37bc65d9d14a65a78bde18730ebace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.817566 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50de55ae9d5940d08b84f37e93bb41fc" } modify_external_catalogs: true
I20260503 07:53:04.817742 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50de55ae9d5940d08b84f37e93bb41fc" } modify_external_catalogs: true
I20260503 07:53:04.818033 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784f3f234927484d8e9cca834f738c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.818596 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ad3393d69e914af6bc8c5f82b09418ab" } modify_external_catalogs: true
I20260503 07:53:04.818763 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ad3393d69e914af6bc8c5f82b09418ab" } modify_external_catalogs: true
I20260503 07:53:04.818904 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4f4e33c65524d7c8a4647b7e648f9f2" } modify_external_catalogs: true
I20260503 07:53:04.819104 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4f4e33c65524d7c8a4647b7e648f9f2" } modify_external_catalogs: true
I20260503 07:53:04.820202 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c089f502b5c44a8683680c392d35a8f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.820724 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c089f502b5c44a8683680c392d35a8f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.823468 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fa00182294cd45cc9b8b17e2a1cb2072"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.823897 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa00182294cd45cc9b8b17e2a1cb2072 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.824453 890 tablet_service.cc:1511] Processing CreateTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.824740 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 (DEFAULT_TABLE table=default.Table_788af50afe2f4b44a37aad1c77d49d22 [id=590b6ee4ed874837a64dd6a67483495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.785378 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b (DEFAULT_TABLE table=default.Table_259dfd3e0f54418c84a01d011786ebdb [id=d8b6f49f9472416fb3d73fdffe353892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.798552 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.825016 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d6eff74f66a7422495c40dd3a55319e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.825138 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb406f1ca50e480e8f621106620fa261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.800561 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f158ee50be904cee95383a3808f148f2 (DEFAULT_TABLE table=default.Table_9646530ccdda41a5a44559346f8868a0 [id=26d4f80f88694ecf8be34919ae4cf674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.823223 883 tablet_service.cc:1511] Processing CreateTablet for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7 (DEFAULT_TABLE table=default.Table_5f37055c47de4dd08186694d3c04ee17 [id=d4777e23cf934feea02af20b501cb138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.825440 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f158ee50be904cee95383a3808f148f2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.825461 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6eff74f66a7422495c40dd3a55319e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:04.826691 716 leader_election.cc:343] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.826797 716 leader_election.cc:304] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.827150 2241 raft_consensus.cc:2749] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.827877 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d89f1787e5a40f48708c777ff164671"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.828328 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d89f1787e5a40f48708c777ff164671 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.816293 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596130e78eb1444a96480fc1075478cd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.829800 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb406f1ca50e480e8f621106620fa261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.830001 1171 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.830117 1171 ts_tablet_manager.cc:1403] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.137s user 0.007s sys 0.005s
I20260503 07:53:04.830389 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe059e59c2b24ead87ef36e5b7cac5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.830691 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bffda3cc5e8484ea1666c788a11a6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.830876 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.830897 1171 raft_consensus.cc:359] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.831048 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25b29188224fbe98ee8c6f6b7b956b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.831036 1171 raft_consensus.cc:385] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.834002 1171 raft_consensus.cc:740] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.835438 754 tablet_service.cc:1511] Processing CreateTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.835649 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5b444896cb414ab212f96b41edc9db (DEFAULT_TABLE table=default.Table_3a7b104c6633409085757a7fce0f7028 [id=9770df7100c94a0b9bd33837e937ac83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.835806 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe059e59c2b24ead87ef36e5b7cac5bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.837747 715 consensus_peers.cc:597] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:04.837932 886 tablet_service.cc:1511] Processing CreateTablet for tablet f158ee50be904cee95383a3808f148f2 (DEFAULT_TABLE table=default.Table_9646530ccdda41a5a44559346f8868a0 [id=26d4f80f88694ecf8be34919ae4cf674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.839143 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5b444896cb414ab212f96b41edc9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.840478 893 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5b444896cb414ab212f96b41edc9db (DEFAULT_TABLE table=default.Table_3a7b104c6633409085757a7fce0f7028 [id=9770df7100c94a0b9bd33837e937ac83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.841105 750 tablet_service.cc:1511] Processing CreateTablet for tablet e210e9e635b6449e9d48f3520120ac97 (DEFAULT_TABLE table=default.Table_417eac5b97e84183ba5bd85c32593d95 [id=33ad67e43c804263bec763baad02d2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.841413 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210e9e635b6449e9d48f3520120ac97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.842615 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f158ee50be904cee95383a3808f148f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.844283 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5b444896cb414ab212f96b41edc9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.846048 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9036a95f9a4a3db7de4551da5e93c8 (DEFAULT_TABLE table=default.Table_d148d37a79a1439b98b2caa0f672c96f [id=48ddc3d24b2b4a86aabb108e35a34d35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.846422 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9036a95f9a4a3db7de4551da5e93c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.847569 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a592a14c3e4659ba81754cbe62c438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.847800 759 tablet_service.cc:1511] Processing CreateTablet for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7 (DEFAULT_TABLE table=default.Table_5f37055c47de4dd08186694d3c04ee17 [id=d4777e23cf934feea02af20b501cb138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.848119 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.850881 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784f3f234927484d8e9cca834f738c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.852288 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c917e1bc514bcbb859340f9ef99f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.853075 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f158ee50be904cee95383a3808f148f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.853575 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bffda3cc5e8484ea1666c788a11a6a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.853720 1171 consensus_queue.cc:260] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.854146 1171 ts_tablet_manager.cc:1434] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260503 07:53:04.854750 1174 tablet_replica.cc:333] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:04.854939 1174 raft_consensus.cc:2243] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:04.855125 1174 pending_rounds.cc:70] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:04.855165 1174 pending_rounds.cc:77] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847437421527040 op_type: NO_OP noop_request { }
I20260503 07:53:04.855238 1174 raft_consensus.cc:2889] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:04.855312 1174 raft_consensus.cc:2272] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.855580 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d052abe9234579b450cc6e92b6ddf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.855914 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e59c5111f0465d856344b0a18e5756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.856578 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c917e1bc514bcbb859340f9ef99f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.807369 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.857120 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d052abe9234579b450cc6e92b6ddf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.857529 1174 ts_tablet_manager.cc:1916] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.858820 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5b444896cb414ab212f96b41edc9db (DEFAULT_TABLE table=default.Table_3a7b104c6633409085757a7fce0f7028 [id=9770df7100c94a0b9bd33837e937ac83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.859144 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5b444896cb414ab212f96b41edc9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.840216 881 tablet_service.cc:1511] Processing CreateTablet for tablet 25e59c5111f0465d856344b0a18e5756 (DEFAULT_TABLE table=default.Table_68406bd365a8436db1ba7c29c23aa199 [id=d491135505de4fac8f2a6e574630f7b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.860783 742 tablet_service.cc:1511] Processing CreateTablet for tablet f2de368e66424e4d9edf7c840ac8071e (DEFAULT_TABLE table=default.Table_2f58c734c20e4da180b30b1fbc3f2031 [id=89ffe7fbd506430bae791bd0c95c7137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.860955 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e59c5111f0465d856344b0a18e5756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.861120 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2de368e66424e4d9edf7c840ac8071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.860631 750 tablet_service.cc:1511] Processing CreateTablet for tablet 214eea0dddd84df888db78aaebce3eda (DEFAULT_TABLE table=default.Table_7bab3c5163f04dc3b37396189dacdc63 [id=7959c8a776944be18abf519407f5912d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.862157 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214eea0dddd84df888db78aaebce3eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.864262 898 tablet_service.cc:1511] Processing CreateTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.864617 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d052abe9234579b450cc6e92b6ddf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.867311 760 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7807a41124ed192096d89fd740ddf (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.867607 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7807a41124ed192096d89fd740ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.869342 1171 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.870939 1171 tablet_bootstrap.cc:654] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.808041 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b (DEFAULT_TABLE table=default.Table_b79b96b9ab1542e48bd33c363698ae1f [id=703753c1ffcb48639d98a339484ffaeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.808243 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 25e59c5111f0465d856344b0a18e5756 (DEFAULT_TABLE table=default.Table_68406bd365a8436db1ba7c29c23aa199 [id=d491135505de4fac8f2a6e574630f7b5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.836898 988 leader_election.cc:343] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.871563 988 leader_election.cc:304] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:04.801985 1175 tablet_replica.cc:333] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.872839 2113 raft_consensus.cc:2749] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.873557 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 07f79085c25d43e58f221af146d252cf (DEFAULT_TABLE table=default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.873888 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 214eea0dddd84df888db78aaebce3eda (DEFAULT_TABLE table=default.Table_7bab3c5163f04dc3b37396189dacdc63 [id=7959c8a776944be18abf519407f5912d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.874266 1020 tablet_service.cc:1511] Processing CreateTablet for tablet f2de368e66424e4d9edf7c840ac8071e (DEFAULT_TABLE table=default.Table_2f58c734c20e4da180b30b1fbc3f2031 [id=89ffe7fbd506430bae791bd0c95c7137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.874609 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9036a95f9a4a3db7de4551da5e93c8 (DEFAULT_TABLE table=default.Table_d148d37a79a1439b98b2caa0f672c96f [id=48ddc3d24b2b4a86aabb108e35a34d35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.837249 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7 (DEFAULT_TABLE table=default.Table_5f37055c47de4dd08186694d3c04ee17 [id=d4777e23cf934feea02af20b501cb138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.838737 1952 consensus_queue.cc:1048] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:04.847602 1030 tablet_service.cc:1511] Processing CreateTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf (DEFAULT_TABLE table=default.Table_414cb9527c374653ab8763194d3af29c [id=8311ea15979c4f3c9518e521aa2a9fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.877379 2241 raft_consensus.cc:493] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.877493 2241 raft_consensus.cc:515] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.877975 879 tablet_service.cc:1511] Processing CreateTablet for tablet e210e9e635b6449e9d48f3520120ac97 (DEFAULT_TABLE table=default.Table_417eac5b97e84183ba5bd85c32593d95 [id=33ad67e43c804263bec763baad02d2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.878075 2241 leader_election.cc:290] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.878335 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210e9e635b6449e9d48f3520120ac97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.878391 1175 raft_consensus.cc:2243] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.878533 1175 raft_consensus.cc:2272] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.878981 1175 ts_tablet_manager.cc:1916] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.883312 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e59c5111f0465d856344b0a18e5756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.884527 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a117f416c611418a96963db600da1d04" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.884824 1952 raft_consensus.cc:493] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.884927 1952 raft_consensus.cc:515] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.885486 1952 leader_election.cc:290] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.885896 716 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.886790 988 consensus_peers.cc:597] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:04.887610 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.887784 777 raft_consensus.cc:2468] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:04.888846 986 leader_election.cc:304] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.889115 1952 raft_consensus.cc:2804] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.889173 1952 raft_consensus.cc:493] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.889225 1952 raft_consensus.cc:3060] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.890661 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.891728 1952 raft_consensus.cc:515] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:04.892387 988 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.892942 751 tablet_service.cc:1511] Processing CreateTablet for tablet 07f79085c25d43e58f221af146d252cf (DEFAULT_TABLE table=default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.893313 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f79085c25d43e58f221af146d252cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.895879 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f79085c25d43e58f221af146d252cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.896399 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214eea0dddd84df888db78aaebce3eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.897081 2241 consensus_queue.cc:1048] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:04.898435 1952 leader_election.cc:290] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.899186 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.899372 777 raft_consensus.cc:3060] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.900372 1014 tablet_service.cc:1511] Processing CreateTablet for tablet e210e9e635b6449e9d48f3520120ac97 (DEFAULT_TABLE table=default.Table_417eac5b97e84183ba5bd85c32593d95 [id=33ad67e43c804263bec763baad02d2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.900458 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2de368e66424e4d9edf7c840ac8071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.900700 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210e9e635b6449e9d48f3520120ac97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.904963 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe059e59c2b24ead87ef36e5b7cac5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.910277 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb2d3c13ded4b8e80e3c8c3fa7000e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.910936 1174 ts_tablet_manager.cc:1929] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:04.911036 1174 log.cc:1199] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:04.911353 1174 ts_tablet_manager.cc:1950] T ecc39d127c71412ea867a0b3cad10452 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:04.912334 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9036a95f9a4a3db7de4551da5e93c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.913069 1171 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.913178 1171 ts_tablet_manager.cc:1403] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.004s
I20260503 07:53:04.913926 1171 raft_consensus.cc:359] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.914062 1171 raft_consensus.cc:385] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.914108 1171 raft_consensus.cc:740] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.914276 1171 consensus_queue.cc:260] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.915710 1174 tablet_replica.cc:333] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:04.915889 1174 raft_consensus.cc:2243] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.916021 1174 raft_consensus.cc:2272] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.916041 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet ecc39d127c71412ea867a0b3cad10452 (table default.Table_63d40973d4274e249dabcfbeb69433aa [id=9290461419df4394a2c203b5ca8992eb]) successfully deleted
I20260503 07:53:04.919029 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25b29188224fbe98ee8c6f6b7b956b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.919238 1175 ts_tablet_manager.cc:1929] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:04.920257 1174 ts_tablet_manager.cc:1916] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.926141 1175 log.cc:1199] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/fb821b329d284643a889b07f9a4f287e
I20260503 07:53:04.922214 1171 ts_tablet_manager.cc:1434] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260503 07:53:04.922463 1952 raft_consensus.cc:493] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.926784 1175 ts_tablet_manager.cc:1950] T fb821b329d284643a889b07f9a4f287e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:04.926854 1952 raft_consensus.cc:515] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.926784 1171 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.927605 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet fb821b329d284643a889b07f9a4f287e (table default.Table_f3f0440daf4a4fe89f92e6c20afef7e5 [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:53:04.927845 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.928025 778 raft_consensus.cc:2468] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:04.928089 1952 leader_election.cc:290] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:04.931006 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f1f86609fc7b4007ab4c730002918613 because the tablet was not found. No further retry: Not found: Tablet not found: f1f86609fc7b4007ab4c730002918613
I20260503 07:53:04.925366 2176 raft_consensus.cc:493] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.921483 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c917e1bc514bcbb859340f9ef99f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.929544 986 leader_election.cc:304] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.931375 2176 raft_consensus.cc:515] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.932022 2174 raft_consensus.cc:2804] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.931960 2176 leader_election.cc:290] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.932128 2174 raft_consensus.cc:493] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.932201 2174 raft_consensus.cc:3060] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.931671 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 477d24ea5c8c42e1a8614f30859e36df (DEFAULT_TABLE table=default.Table_f6e42e25b016431f818e2d8fd9d3c5ba [id=ed4b1a2669844aef9e7eb24cf1a446cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.933506 777 raft_consensus.cc:2468] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.933691 1171 tablet_bootstrap.cc:654] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.934695 2174 raft_consensus.cc:515] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.935247 2174 leader_election.cc:290] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.936323 986 leader_election.cc:304] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.936614 1952 raft_consensus.cc:2804] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.936759 1952 raft_consensus.cc:697] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.937019 1952 consensus_queue.cc:237] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:04.937609 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.937772 778 raft_consensus.cc:3060] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.937506 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477d24ea5c8c42e1a8614f30859e36df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.940404 886 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9036a95f9a4a3db7de4551da5e93c8 (DEFAULT_TABLE table=default.Table_d148d37a79a1439b98b2caa0f672c96f [id=48ddc3d24b2b4a86aabb108e35a34d35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.940793 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9036a95f9a4a3db7de4551da5e93c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.924835 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:04.942675 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a117f416c611418a96963db600da1d04" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.942821 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:04.942996 777 raft_consensus.cc:2468] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:04.943215 715 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.931051 1175 tablet_replica.cc:333] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:04.943325 715 leader_election.cc:304] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.943382 778 raft_consensus.cc:2468] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:04.943472 1175 raft_consensus.cc:2243] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:04.943604 1175 raft_consensus.cc:2272] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:04.943747 986 leader_election.cc:304] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.944005 986 leader_election.cc:304] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:04.944047 1175 ts_tablet_manager.cc:1916] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:04.944342 2241 raft_consensus.cc:2749] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.944607 2174 raft_consensus.cc:2804] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:04.944674 2174 raft_consensus.cc:493] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:04.944726 2174 raft_consensus.cc:3060] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.947106 2174 raft_consensus.cc:515] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.948094 2174 leader_election.cc:290] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:04.947796 1165 tablet_bootstrap.cc:654] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:04.948364 2174 raft_consensus.cc:2804] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.948529 2174 raft_consensus.cc:697] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.949028 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:04.949190 778 raft_consensus.cc:3060] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:04.948933 2174 consensus_queue.cc:237] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.950647 2241 raft_consensus.cc:493] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:04.950771 2241 raft_consensus.cc:515] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.951328 2241 leader_election.cc:290] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:04.951728 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:04.952067 778 raft_consensus.cc:2468] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:53:04.952237 716 leader_election.cc:343] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.952273 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.952955 986 leader_election.cc:304] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:04.953276 715 leader_election.cc:343] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.953368 715 leader_election.cc:304] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:04.953413 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7807a41124ed192096d89fd740ddf (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.953718 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7807a41124ed192096d89fd740ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.953768 2241 raft_consensus.cc:2749] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:04.954028 1952 raft_consensus.cc:2804] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:04.954283 1952 raft_consensus.cc:697] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:04.954543 1952 consensus_queue.cc:237] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.958773 892 tablet_service.cc:1511] Processing CreateTablet for tablet 214eea0dddd84df888db78aaebce3eda (DEFAULT_TABLE table=default.Table_7bab3c5163f04dc3b37396189dacdc63 [id=7959c8a776944be18abf519407f5912d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.959245 889 tablet_service.cc:1511] Processing CreateTablet for tablet f2de368e66424e4d9edf7c840ac8071e (DEFAULT_TABLE table=default.Table_2f58c734c20e4da180b30b1fbc3f2031 [id=89ffe7fbd506430bae791bd0c95c7137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.959231 751 tablet_service.cc:1511] Processing CreateTablet for tablet 81b3a0c30b274a2e9a411b9b835f04a2 (DEFAULT_TABLE table=default.Table_3e50e303a9124c588bb671f5ca64a04c [id=9b2d39c3a5b6465c89a1288c145f1b7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.959681 885 tablet_service.cc:1511] Processing CreateTablet for tablet 07f79085c25d43e58f221af146d252cf (DEFAULT_TABLE table=default.Table_7f4e04b692cd401c8f8248d2b54732e3 [id=f54acc5b0d3742978604276ac2cec842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.960042 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f79085c25d43e58f221af146d252cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.960366 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.961476 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.962098 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:04.963886 754 tablet_service.cc:1511] Processing CreateTablet for tablet 53de1c39d3884a158d92fa487091215c (DEFAULT_TABLE table=default.Table_01432a8a7eac48f3b2d392e5ee734b0e [id=17364122c22f45538faa1143d83ff53d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:04.964452 988 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.965320 988 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.966377 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7807a41124ed192096d89fd740ddf (DEFAULT_TABLE table=default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c [id=b6aa38bf5f394ebd9edf235649b37689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.962464 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296541e4c2fc4bc193d6f4cee8e65da0" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:04.967610 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a178957514e4f77afe8a1879b57a96b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:04.970674 988 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.970844 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a2f4f64a80a0412fbaecc20893120f76" } modify_external_catalogs: true
I20260503 07:53:04.971035 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a2f4f64a80a0412fbaecc20893120f76" } modify_external_catalogs: true
W20260503 07:53:04.971637 988 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:04.972328 988 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:04.972667 593 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 4fcf2415d8bf4a25a08ea3cbabe9c0e8
I20260503 07:53:04.973058 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42152ea98fcc4c7197cbc65c60e0a583" } modify_external_catalogs: true
I20260503 07:53:04.973248 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42152ea98fcc4c7197cbc65c60e0a583" } modify_external_catalogs: true
I20260503 07:53:04.976083 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_de8f39e067d944a1aa4452fc4b956897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.976830 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de8f39e067d944a1aa4452fc4b956897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.977828 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7807a41124ed192096d89fd740ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.978782 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214eea0dddd84df888db78aaebce3eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.978679 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87c17af8fa6744e69eb0677e173f6372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:04.978966 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2de368e66424e4d9edf7c840ac8071e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:04.979323 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c17af8fa6744e69eb0677e173f6372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:04.981637 882 tablet_service.cc:1511] Processing CreateTablet for tablet baf176bdc6d54088846ee5eaf5e61447 (DEFAULT_TABLE table=default.Table_c73353e0401c48e98892a62a22b8496f [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.982089 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cb8e3c37b65a4f3b8fb3d6357af50325
I20260503 07:53:04.982827 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_43d39570e97b440c823a2857ed6d3740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:04.983230 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43d39570e97b440c823a2857ed6d3740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:04.986861 988 consensus_peers.cc:597] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:04.988696 1171 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:04.988821 1171 ts_tablet_manager.cc:1403] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260503 07:53:04.989624 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf176bdc6d54088846ee5eaf5e61447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.989603 1171 raft_consensus.cc:359] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.989746 1171 raft_consensus.cc:385] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:04.989796 1171 raft_consensus.cc:740] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:04.990002 1171 consensus_queue.cc:260] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:04.990478 1171 ts_tablet_manager.cc:1434] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:04.990731 1171 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:04.993716 2203 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:04.995316 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 79d43ae066e6411896c490f7c0b11180 (table default.Table_66b153f206f74219a6cd3b0b8ecfa6be [id=02296eaf13b0418ea0c47dfc4eeeb22c]). Expected version 2 got 0
I20260503 07:53:04.995604 600 catalog_manager.cc:5671] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:04.996152 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:04.996395 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:04.988008 887 tablet_service.cc:1511] Processing CreateTablet for tablet 53de1c39d3884a158d92fa487091215c (DEFAULT_TABLE table=default.Table_01432a8a7eac48f3b2d392e5ee734b0e [id=17364122c22f45538faa1143d83ff53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:04.997269 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53de1c39d3884a158d92fa487091215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:04.999073 598 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc] alter complete (version 1)
I20260503 07:53:05.001278 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.001535 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 53de1c39d3884a158d92fa487091215c (DEFAULT_TABLE table=default.Table_01432a8a7eac48f3b2d392e5ee734b0e [id=17364122c22f45538faa1143d83ff53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.001767 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 (DEFAULT_TABLE table=default.Table_838891067c3b4d54a5e0f2f6cdd18aca [id=d4ec9b8cc1b84fd9a56350df73e5378c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.001943 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53de1c39d3884a158d92fa487091215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.002187 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2beb13a5d2844d44a3146d7937c8e964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.002506 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 3f142af0cf6a40e29f8b6faa6a400395 (DEFAULT_TABLE table=default.Table_b80f2de2517343d79af84f18e972c101 [id=403d3b5f75644f55b328e0337fee7fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.002874 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f142af0cf6a40e29f8b6faa6a400395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.004508 1033 tablet_service.cc:1511] Processing CreateTablet for tablet edfe937339914b29afbceb9cd3cd7c1c (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.004830 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfe937339914b29afbceb9cd3cd7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.008453 1023 tablet_service.cc:1511] Processing CreateTablet for tablet baf176bdc6d54088846ee5eaf5e61447 (DEFAULT_TABLE table=default.Table_c73353e0401c48e98892a62a22b8496f [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.008827 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf176bdc6d54088846ee5eaf5e61447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.010479 742 tablet_service.cc:1511] Processing CreateTablet for tablet 3f142af0cf6a40e29f8b6faa6a400395 (DEFAULT_TABLE table=default.Table_b80f2de2517343d79af84f18e972c101 [id=403d3b5f75644f55b328e0337fee7fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.011070 760 tablet_service.cc:1511] Processing CreateTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 (DEFAULT_TABLE table=default.Table_838891067c3b4d54a5e0f2f6cdd18aca [id=d4ec9b8cc1b84fd9a56350df73e5378c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.011339 746 tablet_service.cc:1511] Processing CreateTablet for tablet edfe937339914b29afbceb9cd3cd7c1c (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.013454 891 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.014230 884 tablet_service.cc:1511] Processing CreateTablet for tablet 3f142af0cf6a40e29f8b6faa6a400395 (DEFAULT_TABLE table=default.Table_b80f2de2517343d79af84f18e972c101 [id=403d3b5f75644f55b328e0337fee7fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.014585 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f142af0cf6a40e29f8b6faa6a400395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.019995 880 tablet_service.cc:1511] Processing CreateTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 (DEFAULT_TABLE table=default.Table_838891067c3b4d54a5e0f2f6cdd18aca [id=d4ec9b8cc1b84fd9a56350df73e5378c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.020455 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2beb13a5d2844d44a3146d7937c8e964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.020871 1166 raft_consensus.cc:359] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.021014 1166 raft_consensus.cc:385] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.021056 1166 raft_consensus.cc:740] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.021242 1166 consensus_queue.cc:260] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.021673 1166 ts_tablet_manager.cc:1434] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.240s user 0.001s sys 0.000s
I20260503 07:53:05.021934 1166 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.001536 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 81b3a0c30b274a2e9a411b9b835f04a2 (DEFAULT_TABLE table=default.Table_3e50e303a9124c588bb671f5ca64a04c [id=9b2d39c3a5b6465c89a1288c145f1b7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.023675 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b3a0c30b274a2e9a411b9b835f04a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.023540 757 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8e3c37b65a4f3b8fb3d6357af50325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:05.025444 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cb8e3c37b65a4f3b8fb3d6357af50325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8e3c37b65a4f3b8fb3d6357af50325 already in progress: creating tablet
I20260503 07:53:05.024910 750 tablet_service.cc:1511] Processing CreateTablet for tablet baf176bdc6d54088846ee5eaf5e61447 (DEFAULT_TABLE table=default.Table_c73353e0401c48e98892a62a22b8496f [id=e71ef6c2ea5144c4953402becac9a79d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.029048 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2beb13a5d2844d44a3146d7937c8e964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.029255 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53de1c39d3884a158d92fa487091215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.029596 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b3a0c30b274a2e9a411b9b835f04a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.029919 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfe937339914b29afbceb9cd3cd7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.030342 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f142af0cf6a40e29f8b6faa6a400395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.030551 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf176bdc6d54088846ee5eaf5e61447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.030521 891 tablet_service.cc:1511] Processing CreateTablet for tablet edfe937339914b29afbceb9cd3cd7c1c (DEFAULT_TABLE table=default.Table_95acba54e2b94b8886d748f6ffa87d7e [id=35a95f27527e497eaa22fd30ac43b008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.030941 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfe937339914b29afbceb9cd3cd7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.046496 1174 ts_tablet_manager.cc:1929] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.067211 598 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9] alter complete (version 3)
I20260503 07:53:05.079012 896 tablet_service.cc:1511] Processing CreateTablet for tablet 81b3a0c30b274a2e9a411b9b835f04a2 (DEFAULT_TABLE table=default.Table_3e50e303a9124c588bb671f5ca64a04c [id=9b2d39c3a5b6465c89a1288c145f1b7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.079577 1174 log.cc:1199] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/057b62a991b74c859045a74df7dc716f
I20260503 07:53:05.080044 1174 ts_tablet_manager.cc:1950] T 057b62a991b74c859045a74df7dc716f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:05.082283 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 057b62a991b74c859045a74df7dc716f (table default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81 [id=cab292402d754907b98a0e395457ce95]) successfully deleted
I20260503 07:53:05.083508 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6c6d0c557fe34e588e5baddc3a30774e
I20260503 07:53:05.084160 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_aa3c00ec689d4fac865d16978a0ecc58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.084440 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fcc06f2c258f44a0beb34324b577713c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.084611 1174 tablet_replica.cc:333] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:05.084750 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa3c00ec689d4fac865d16978a0ecc58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.084786 1174 raft_consensus.cc:2243] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.084920 1174 raft_consensus.cc:2272] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:05.085018 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcc06f2c258f44a0beb34324b577713c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.085433 1174 ts_tablet_manager.cc:1916] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.086810 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_79153d9f56f84e01937636fc78074f46" } new_table_name: "default.Table_c9620a5abef84a94bcf88d1a511d9449" modify_external_catalogs: true
I20260503 07:53:05.088271 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fc403bfa4191450b8997da247d3131c9" } new_table_name: "default.Table_eb80e7b5f0714315aee7abdfca47508b" modify_external_catalogs: true
I20260503 07:53:05.089429 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 34fa92517beb4622bdfa3fd824e78648
I20260503 07:53:05.089946 601 catalog_manager.cc:6741] ReplaceTablet: tablet 34fa92517beb4622bdfa3fd824e78648 deleted and replaced by tablet b56ee573586b49d596592c32c509969f
I20260503 07:53:05.090234 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_788af50afe2f4b44a37aad1c77d49d22" } new_table_name: "default.Table_2072505f72ef4481aa77f2c6b8354aaa" modify_external_catalogs: true
I20260503 07:53:05.091441 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8160807f463042e7bd65ba846a726922
I20260503 07:53:05.092316 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e3e7b653cf44e7f9b0fc0e26a66c2e4" } new_table_name: "default.Table_7e721b1e3da6400b9f668b14171f376b" modify_external_catalogs: true
I20260503 07:53:05.083546 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_785d45f016d940afba4884beadbe2146" } new_table_name: "default.Table_36ca42c573384550909d2eb25a75785e" modify_external_catalogs: true
I20260503 07:53:05.094599 1175 ts_tablet_manager.cc:1929] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.094759 1175 log.cc:1199] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ab33d15e70ec4856a15ed7c6175cd334
I20260503 07:53:05.095209 1175 ts_tablet_manager.cc:1950] T ab33d15e70ec4856a15ed7c6175cd334 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.095520 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.095849 1175 tablet_replica.cc:333] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.096077 1175 raft_consensus.cc:2243] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.096098 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 8160807f463042e7bd65ba846a726922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.096328 1175 raft_consensus.cc:2272] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:05.096702 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6c6d0c557fe34e588e5baddc3a30774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c6d0c557fe34e588e5baddc3a30774e already in progress: creating tablet
I20260503 07:53:05.096948 1175 ts_tablet_manager.cc:1916] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:05.096956 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8160807f463042e7bd65ba846a726922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8160807f463042e7bd65ba846a726922 already in progress: creating tablet
I20260503 07:53:05.097170 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fa92517beb4622bdfa3fd824e78648 with delete_type TABLET_DATA_DELETED (replaced by tablet b56ee573586b49d596592c32c509969f) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.099526 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fa92517beb4622bdfa3fd824e78648 with delete_type TABLET_DATA_DELETED (replaced by tablet b56ee573586b49d596592c32c509969f) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.099778 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.100016 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 8160807f463042e7bd65ba846a726922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:05.101936 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 34fa92517beb4622bdfa3fd824e78648 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fa92517beb4622bdfa3fd824e78648 already in progress: creating tablet
I20260503 07:53:05.109613 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1e2546e95e0f40ad99f1ba6bc512debe
I20260503 07:53:05.110787 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b3a0c30b274a2e9a411b9b835f04a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.112568 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.113499 753 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.114859 1171 tablet_bootstrap.cc:654] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.115688 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.116911 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.117002 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ab33d15e70ec4856a15ed7c6175cd334 (table default.Table_dad6c6e91b084308a94abf81b5c120a3 [id=cb3204cb6061405bb6a2cdff89916775]) successfully deleted
W20260503 07:53:05.117228 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet aa9153d3245f4dcfacf26f174bced2ba because the tablet was not found. No further retry: Not found: Tablet not found: aa9153d3245f4dcfacf26f174bced2ba
I20260503 07:53:05.117622 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.117486 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fa92517beb4622bdfa3fd824e78648 with delete_type TABLET_DATA_DELETED (replaced by tablet b56ee573586b49d596592c32c509969f) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.117906 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.118070 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.118257 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.118268 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.118274 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8160807f463042e7bd65ba846a726922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.117479 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c6d0c557fe34e588e5baddc3a30774e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.120138 1165 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.120359 1165 ts_tablet_manager.cc:1403] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.351s user 0.001s sys 0.005s
I20260503 07:53:05.121146 1165 raft_consensus.cc:359] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.121394 1165 raft_consensus.cc:385] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.121493 600 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:05.121615 1165 raft_consensus.cc:740] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.122151 1165 consensus_queue.cc:260] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.123145 1165 ts_tablet_manager.cc:1434] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:05.127965 1165 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.131042 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.137388 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.118309 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.141019 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.141049 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.129909 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.147073 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 1e2546e95e0f40ad99f1ba6bc512debe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e2546e95e0f40ad99f1ba6bc512debe already in progress: creating tablet
I20260503 07:53:05.157262 1165 tablet_bootstrap.cc:654] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.161257 1175 ts_tablet_manager.cc:1929] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.161437 1175 log.cc:1199] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/feb88812c6b0459d86bd441926f57ecf
I20260503 07:53:05.161789 1175 ts_tablet_manager.cc:1950] T feb88812c6b0459d86bd441926f57ecf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.162377 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet feb88812c6b0459d86bd441926f57ecf (table default.Table_f758e269b4d74a1a93e7c2e458442f35 [id=07bab04461974a1088917f8c34d18388]) successfully deleted
I20260503 07:53:05.171188 1174 ts_tablet_manager.cc:1929] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260503 07:53:05.172046 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3e5be5ce78c4da2a76e819a050d56f4 consensus state has no leader
I20260503 07:53:05.172322 1174 log.cc:1199] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:05.172621 1174 ts_tablet_manager.cc:1950] T cac435b09639484ca1ae82f3d4990d48 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:05.172857 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3724490a7ed4afc82e4f7ebc1190f76 consensus state has no leader
I20260503 07:53:05.175266 2082 raft_consensus.cc:493] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.175403 2082 raft_consensus.cc:515] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.176055 2082 leader_election.cc:290] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.176904 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:05.180675 1171 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:05.180868 1171 ts_tablet_manager.cc:1403] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.190s user 0.001s sys 0.008s
I20260503 07:53:05.181546 1171 raft_consensus.cc:359] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.181751 1171 raft_consensus.cc:385] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.181831 1171 raft_consensus.cc:740] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.182046 1171 consensus_queue.cc:260] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.182401 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a14d62ecc9544ee5bc5344a57f1a6c5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.183044 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a14d62ecc9544ee5bc5344a57f1a6c5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.184295 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3539f556a19b42f4ae64f57560d2f740" } modify_external_catalogs: true
I20260503 07:53:05.184500 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3539f556a19b42f4ae64f57560d2f740" } modify_external_catalogs: true
I20260503 07:53:05.185092 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6644f47cf4974ac28fcc3d3529d0b88f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.185652 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6644f47cf4974ac28fcc3d3529d0b88f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:05.186180 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ab44832fbf224a069d958cf745d914f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab44832fbf224a069d958cf745d914f8 already in progress: creating tablet
I20260503 07:53:05.186933 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3571003422e4455f9f765cf5a1b64104"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.187304 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6772fe0377b249be9e247ec93cf50719 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6772fe0377b249be9e247ec93cf50719 already in progress: creating tablet
W20260503 07:53:05.187381 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3571003422e4455f9f765cf5a1b64104 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.187929 1165 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.188064 1165 ts_tablet_manager.cc:1403] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260503 07:53:05.188695 1165 raft_consensus.cc:359] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.188853 1165 raft_consensus.cc:385] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.188912 1165 raft_consensus.cc:740] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.189085 1165 consensus_queue.cc:260] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.189570 1165 ts_tablet_manager.cc:1434] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:53:05.189725 915 raft_consensus.cc:3060] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:05.190389 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e36e6f971c5e4929b42bb522e91d4eba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36e6f971c5e4929b42bb522e91d4eba already in progress: creating tablet
W20260503 07:53:05.190915 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet eccf6c7770554ba3861e4add2f7f180a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eccf6c7770554ba3861e4add2f7f180a already in progress: creating tablet
I20260503 07:53:05.192979 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet cac435b09639484ca1ae82f3d4990d48 (table default.Table_ea3cc36f50214961844fbc9f28877922 [id=cda676ee3d634f52aeefda3c2680f941]) successfully deleted
I20260503 07:53:05.193658 1174 tablet_replica.cc:333] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:05.193770 1165 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.197059 750 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:05.199512 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0bffda3cc5e8484ea1666c788a11a6a3 consensus state has no leader
I20260503 07:53:05.205057 1174 raft_consensus.cc:2243] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.205279 1174 raft_consensus.cc:2272] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.205498 2270 tablet.cc:1724] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:05.205825 1174 ts_tablet_manager.cc:1916] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.207918 1171 ts_tablet_manager.cc:1434] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.027s user 0.000s sys 0.001s
I20260503 07:53:05.207976 1165 tablet_bootstrap.cc:654] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.208617 1171 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:05.210465 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e2a6aac10a79471f91a7e631116df017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.211130 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2a6aac10a79471f91a7e631116df017 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.211217 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78caf320cd8d42a4b19d6ba70437b2fd" } modify_external_catalogs: true
I20260503 07:53:05.211409 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78caf320cd8d42a4b19d6ba70437b2fd" } modify_external_catalogs: true
W20260503 07:53:05.215456 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a328057ceb3640d1a26b773862492f04 consensus state has no leader
W20260503 07:53:05.225580 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94b987096aaa46d18c7c93763c70dd99 has no consensus state
W20260503 07:53:05.226508 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6de27712304a49a9aaaeaff474e61f08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de27712304a49a9aaaeaff474e61f08 already in progress: creating tablet
W20260503 07:53:05.227200 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cb8e3c37b65a4f3b8fb3d6357af50325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8e3c37b65a4f3b8fb3d6357af50325 already in progress: creating tablet
W20260503 07:53:05.227746 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fb821b329d284643a889b07f9a4f287e because the tablet was not found. No further retry: Not found: Tablet not found: fb821b329d284643a889b07f9a4f287e
I20260503 07:53:05.228067 1175 tablet_replica.cc:333] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.228551 1175 raft_consensus.cc:2243] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.228786 1175 raft_consensus.cc:2272] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.229416 1175 ts_tablet_manager.cc:1916] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.231067 1165 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.231334 1165 ts_tablet_manager.cc:1403] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.000s
I20260503 07:53:05.233520 1165 raft_consensus.cc:359] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.233976 1171 tablet_bootstrap.cc:654] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.233855 1165 raft_consensus.cc:385] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.235183 1165 raft_consensus.cc:740] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.235833 2270 tablet.cc:1719] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3: Skipping requested alter to schema version 2, tablet already version 2
I20260503 07:53:05.237007 1165 consensus_queue.cc:260] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.240556 2242 raft_consensus.cc:493] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.240679 2242 raft_consensus.cc:515] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:05.240854 586 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a328057ceb3640d1a26b773862492f04 (table default.Table_7e721b1e3da6400b9f668b14171f376b [id=362e0f41e20d4f74bcc451256745d5db], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a328057ceb3640d1a26b773862492f04 consensus state has no leader
I20260503 07:53:05.241305 2242 leader_election.cc:290] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:05.241609 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:05.241462 1165 ts_tablet_manager.cc:1434] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260503 07:53:05.242070 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:05.242152 715 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:05.242643 716 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.242736 716 leader_election.cc:304] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.243152 2242 raft_consensus.cc:2749] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:05.243717 1165 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.259013 2270 tablet.cc:1724] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:05.259567 1165 tablet_bootstrap.cc:654] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.264046 1174 ts_tablet_manager.cc:1929] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.284535 1174 log.cc:1199] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/a117f416c611418a96963db600da1d04
I20260503 07:53:05.285151 1174 ts_tablet_manager.cc:1950] T a117f416c611418a96963db600da1d04 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:05.289675 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet a117f416c611418a96963db600da1d04 (table default.Table_ae5c088a97ba4ae4b68eaa5de9349bff [id=5a2aa391752141b78b08192babdec820]) successfully deleted
I20260503 07:53:05.293337 1174 tablet_replica.cc:333] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:05.293574 1174 raft_consensus.cc:2243] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.293788 1174 raft_consensus.cc:2272] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.294358 1174 ts_tablet_manager.cc:1916] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.296589 1166 tablet_bootstrap.cc:654] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.298527 1165 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.298729 1165 ts_tablet_manager.cc:1403] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.056s user 0.007s sys 0.000s
I20260503 07:53:05.299937 1165 raft_consensus.cc:359] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.300221 1165 raft_consensus.cc:385] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.300355 1165 raft_consensus.cc:740] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.302716 1166 tablet_bootstrap.cc:492] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.302901 1166 ts_tablet_manager.cc:1403] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.281s user 0.020s sys 0.000s
I20260503 07:53:05.303550 1166 raft_consensus.cc:359] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.303791 1166 raft_consensus.cc:385] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.303884 1166 raft_consensus.cc:740] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.304164 1166 consensus_queue.cc:260] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.304875 1165 consensus_queue.cc:260] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.305876 1165 ts_tablet_manager.cc:1434] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260503 07:53:05.307969 1165 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.310464 1166 ts_tablet_manager.cc:1434] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260503 07:53:05.311432 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:05.317713 1166 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.319187 1166 tablet_bootstrap.cc:654] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.324146 1165 tablet_bootstrap.cc:654] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.325289 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.325739 1174 ts_tablet_manager.cc:1929] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.325827 1174 log.cc:1199] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/54bf46b34b1043e2ab6c9f8b2c871227
W20260503 07:53:05.325903 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.326119 1174 ts_tablet_manager.cc:1950] T 54bf46b34b1043e2ab6c9f8b2c871227 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:05.327409 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_380ccf69fa8943d6ac4c87a883a25068" } modify_external_catalogs: true
I20260503 07:53:05.327594 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_380ccf69fa8943d6ac4c87a883a25068" } modify_external_catalogs: true
I20260503 07:53:05.327869 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 54bf46b34b1043e2ab6c9f8b2c871227 (table default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]) successfully deleted
I20260503 07:53:05.328289 1174 tablet_replica.cc:333] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:05.328454 1174 raft_consensus.cc:2243] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.328591 1174 raft_consensus.cc:2272] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.328991 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_faabda34589444c8bb45450d25e35376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.329129 1174 ts_tablet_manager.cc:1916] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:05.329501 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faabda34589444c8bb45450d25e35376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.330680 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b393ca71b84744349940320f484cae6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.331154 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b393ca71b84744349940320f484cae6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.333738 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]). Expected version 1 got 0
I20260503 07:53:05.333940 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]). Expected version 2 got 0
I20260503 07:53:05.335577 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_55cec2a278e54eb2931506731ca04e8f" } modify_external_catalogs: true
I20260503 07:53:05.335709 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_55cec2a278e54eb2931506731ca04e8f" } modify_external_catalogs: true
I20260503 07:53:05.337910 1952 raft_consensus.cc:493] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.338148 2268 raft_consensus.cc:493] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.339434 1166 tablet_bootstrap.cc:492] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.339565 1166 ts_tablet_manager.cc:1403] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
W20260503 07:53:05.341768 988 consensus_peers.cc:597] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.338274 2268 raft_consensus.cc:515] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.338050 1952 raft_consensus.cc:515] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.344527 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b62a991b74c859045a74df7dc716f" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:05.344720 1952 leader_election.cc:290] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:05.345057 988 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.347966 2268 leader_election.cc:290] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.348133 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:05.348794 1166 raft_consensus.cc:359] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.349007 1166 raft_consensus.cc:385] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.349116 1166 raft_consensus.cc:740] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.349409 1166 consensus_queue.cc:260] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:05.349635 988 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.351214 1175 ts_tablet_manager.cc:1929] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.351356 1175 log.cc:1199] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:05.351706 1175 ts_tablet_manager.cc:1950] T 8fb4d150eadb479d9978f2450637bd3e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.353058 1175 tablet_replica.cc:333] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.353158 1165 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.353400 1165 ts_tablet_manager.cc:1403] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.003s
I20260503 07:53:05.353562 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8fb4d150eadb479d9978f2450637bd3e (table default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]) successfully deleted
W20260503 07:53:05.353830 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 34fa92517beb4622bdfa3fd824e78648 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fa92517beb4622bdfa3fd824e78648 already in progress: creating tablet
I20260503 07:53:05.354223 1175 raft_consensus.cc:2243] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.354413 1175 raft_consensus.cc:2272] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.354947 1175 ts_tablet_manager.cc:1916] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.355504 1166 ts_tablet_manager.cc:1434] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260503 07:53:05.356277 1165 raft_consensus.cc:359] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.356529 1165 raft_consensus.cc:385] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.356606 1165 raft_consensus.cc:740] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.358385 1165 consensus_queue.cc:260] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.359198 1165 ts_tablet_manager.cc:1434] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:53:05.361754 1166 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.361754 1165 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.363164 1166 tablet_bootstrap.cc:654] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.378378 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:05.379842 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_42211d76c1f247b9928bafb30b2b26f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.380903 886 tablet_service.cc:1558] Processing DeleteTablet for tablet eea048c5820349d481ac54a570b57649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.381219 1173 tablet_replica.cc:333] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:05.381451 1173 raft_consensus.cc:2243] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.381615 1173 raft_consensus.cc:2272] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.382246 1173 ts_tablet_manager.cc:1916] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.383562 1171 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:05.383446 1165 tablet_bootstrap.cc:654] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.383689 1171 ts_tablet_manager.cc:1403] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.175s user 0.001s sys 0.001s
I20260503 07:53:05.384418 1171 raft_consensus.cc:359] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.384598 1171 raft_consensus.cc:385] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.384649 1171 raft_consensus.cc:740] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.384821 1171 consensus_queue.cc:260] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.385201 1171 ts_tablet_manager.cc:1434] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:53:05.385466 1171 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:05.386814 1171 tablet_bootstrap.cc:654] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:05.389757 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42211d76c1f247b9928bafb30b2b26f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.391276 827 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:05.395340 1173 ts_tablet_manager.cc:1929] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.395509 1173 log.cc:1199] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/eea048c5820349d481ac54a570b57649
I20260503 07:53:05.395874 1173 ts_tablet_manager.cc:1950] T eea048c5820349d481ac54a570b57649 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:05.396488 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet eea048c5820349d481ac54a570b57649 (table default.Table_312a588ec1c840c187461ae93b58a342 [id=4a4b254dd7674586b99156081b1c83fa]) successfully deleted
I20260503 07:53:05.403263 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:05.403429 779 raft_consensus.cc:2468] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:05.407712 1165 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.407872 1165 ts_tablet_manager.cc:1403] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.002s
I20260503 07:53:05.410068 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56749914e1a349f0876f52157affdf69" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:05.410182 988 consensus_peers.cc:597] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.411438 1952 consensus_queue.cc:1048] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.411468 2269 consensus_queue.cc:1048] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.413501 917 raft_consensus.cc:3060] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.413600 1174 ts_tablet_manager.cc:1929] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.413690 1174 log.cc:1199] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:05.413954 1174 ts_tablet_manager.cc:1950] T 94cd6a702c59445882a81ca2e3a0f3f6 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:05.416129 986 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:05.416263 986 leader_election.cc:304] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:05.416997 2281 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:05.418166 1175 ts_tablet_manager.cc:1929] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.418295 1175 log.cc:1199] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:05.418584 1175 ts_tablet_manager.cc:1950] T e16d225dde3247d1b61a03cf14b21d63 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.419027 1952 raft_consensus.cc:2749] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:05.419184 1165 raft_consensus.cc:359] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.419565 1165 raft_consensus.cc:385] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.419706 1165 raft_consensus.cc:740] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.420357 1952 consensus_queue.cc:1048] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.421041 593 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 262678b948bd46b6886277f8dd790441 (table default.Table_c081581d0e69483a9c4fdc42e9abec77 [id=6f2dee6dc12f4eb1a99cf69412d2d256]). Expected version 1 got 0
I20260503 07:53:05.420840 1165 consensus_queue.cc:260] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.422078 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cd3761aae67d400e9781b631dc57766b" } modify_external_catalogs: true
I20260503 07:53:05.422271 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cd3761aae67d400e9781b631dc57766b" } modify_external_catalogs: true
I20260503 07:53:05.422739 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2d647277295e42cdb65f45a619e63960
I20260503 07:53:05.423280 596 master_service.cc:954] ReplaceTablet: received request to replace tablet cb8e3c37b65a4f3b8fb3d6357af50325 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:05.423883 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_68891bf0cd2c4b0f96e3840dbb19dfe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.424161 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d647277295e42cdb65f45a619e63960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:05.424409 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68891bf0cd2c4b0f96e3840dbb19dfe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.425657 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2be120c3879e4a42bac0f6afd20cf9ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.425848 1171 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:05.425976 1171 ts_tablet_manager.cc:1403] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.002s
I20260503 07:53:05.425385 1165 ts_tablet_manager.cc:1434] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
W20260503 07:53:05.426077 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2be120c3879e4a42bac0f6afd20cf9ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.426623 1171 raft_consensus.cc:359] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.426789 1171 raft_consensus.cc:385] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.426836 1171 raft_consensus.cc:740] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.427021 1171 consensus_queue.cc:260] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.427194 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 84d1372ba462479db6cf9e865c104df4 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:05.429324 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d647277295e42cdb65f45a619e63960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.429703 1165 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.431962 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d647277295e42cdb65f45a619e63960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.432114 1171 ts_tablet_manager.cc:1434] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:53:05.436800 1171 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:05.436897 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e16d225dde3247d1b61a03cf14b21d63 (table default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]) successfully deleted
I20260503 07:53:05.438238 1171 tablet_bootstrap.cc:654] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.438591 1175 tablet_replica.cc:333] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.440834 986 leader_election.cc:304] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.441108 1952 raft_consensus.cc:2804] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:05.441190 1952 raft_consensus.cc:493] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:05.441263 1952 raft_consensus.cc:3060] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.442920 2270 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:05.443903 1952 raft_consensus.cc:515] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.444060 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]). Expected version 3 got 0
I20260503 07:53:05.444118 2272 mvcc.cc:204] Tried to move back new op lower bound from 7281847428825079808 to 7281847422603354112. Current Snapshot: MvccSnapshot[applied={T|T < 7281847428825079808}]
I20260503 07:53:05.444340 1175 raft_consensus.cc:2243] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.444931 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c9620a5abef84a94bcf88d1a511d9449" } new_table_name: "default.Table_d6075024016c4f2898745afd40d626cd" modify_external_catalogs: true
I20260503 07:53:05.444772 1952 leader_election.cc:290] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.445950 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:05.445592 1175 raft_consensus.cc:2272] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:05.447361 988 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.449255 1165 tablet_bootstrap.cc:654] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.450528 1175 ts_tablet_manager.cc:1916] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.451839 1173 tablet_replica.cc:333] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:05.453161 1952 consensus_queue.cc:1048] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.454061 854 leader_election.cc:304] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:05.454439 2082 raft_consensus.cc:2749] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:05.454972 1173 raft_consensus.cc:2243] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.459051 1173 raft_consensus.cc:2272] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.460233 1173 ts_tablet_manager.cc:1916] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.462383 1171 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:05.462507 1171 ts_tablet_manager.cc:1403] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.007s
I20260503 07:53:05.463250 1171 raft_consensus.cc:359] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.463410 1171 raft_consensus.cc:385] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.463469 1171 raft_consensus.cc:740] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.463644 1171 consensus_queue.cc:260] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.464411 598 catalog_manager.cc:5671] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:05.464942 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:05.465266 1171 ts_tablet_manager.cc:1434] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 07:53:05.465252 598 catalog_manager.cc:5671] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:05.465672 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:05.465938 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 1 got 0
I20260503 07:53:05.466393 598 catalog_manager.cc:5671] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:05.466867 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:05.475422 747 tablet_service.cc:1511] Processing CreateTablet for tablet 378cc6d613584f308d3c0fb68b31f26e (DEFAULT_TABLE table=default.Table_d6eff74f66a7422495c40dd3a55319e0 [id=e9a6a27e53764b6a80f7a5e6a8beee7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.475818 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378cc6d613584f308d3c0fb68b31f26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.464547 1166 tablet_bootstrap.cc:492] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.471587 886 tablet_service.cc:1511] Processing CreateTablet for tablet 378cc6d613584f308d3c0fb68b31f26e (DEFAULT_TABLE table=default.Table_d6eff74f66a7422495c40dd3a55319e0 [id=e9a6a27e53764b6a80f7a5e6a8beee7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.476459 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378cc6d613584f308d3c0fb68b31f26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.477505 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 (DEFAULT_TABLE table=default.Table_fa00182294cd45cc9b8b17e2a1cb2072 [id=776f053d4b144bf2ba970d89173aaae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.477787 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2ed7d2563487aa15fe917b3fcf313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.480108 2242 consensus_queue.cc:1048] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.480268 1166 ts_tablet_manager.cc:1403] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.119s user 0.012s sys 0.007s
I20260503 07:53:05.480978 1166 raft_consensus.cc:359] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.481045 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 378cc6d613584f308d3c0fb68b31f26e (DEFAULT_TABLE table=default.Table_d6eff74f66a7422495c40dd3a55319e0 [id=e9a6a27e53764b6a80f7a5e6a8beee7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.483017 1166 raft_consensus.cc:385] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.483099 1166 raft_consensus.cc:740] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.483361 1166 consensus_queue.cc:260] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.483935 1166 ts_tablet_manager.cc:1434] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:53:05.485426 1166 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.487551 1166 tablet_bootstrap.cc:654] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.488277 1165 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.488461 1165 ts_tablet_manager.cc:1403] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.000s
I20260503 07:53:05.489568 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 (DEFAULT_TABLE table=default.Table_fa00182294cd45cc9b8b17e2a1cb2072 [id=776f053d4b144bf2ba970d89173aaae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.489650 1165 raft_consensus.cc:359] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.489826 1165 raft_consensus.cc:385] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.489888 1165 raft_consensus.cc:740] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.490087 1165 consensus_queue.cc:260] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.490290 747 tablet_service.cc:1511] Processing CreateTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 (DEFAULT_TABLE table=default.Table_fa00182294cd45cc9b8b17e2a1cb2072 [id=776f053d4b144bf2ba970d89173aaae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.490617 1165 ts_tablet_manager.cc:1434] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:05.490661 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2ed7d2563487aa15fe917b3fcf313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.490864 1165 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.492816 1165 tablet_bootstrap.cc:654] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.493960 886 tablet_service.cc:1511] Processing CreateTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 (DEFAULT_TABLE table=default.Table_c089f502b5c44a8683680c392d35a8f3 [id=0e51b9c52b7c4cf4980718b72e97acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.495468 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 94cd6a702c59445882a81ca2e3a0f3f6 (table default.Table_51fb3eec8b874340a588a54ee74d00cf [id=4b72deda123e4973bb5bad7303ca2fbd]) successfully deleted
I20260503 07:53:05.495903 1174 tablet_replica.cc:333] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:05.497400 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f85848e3ad467a98b34e314c4c0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.498116 750 tablet_service.cc:1511] Processing CreateTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 (DEFAULT_TABLE table=default.Table_c089f502b5c44a8683680c392d35a8f3 [id=0e51b9c52b7c4cf4980718b72e97acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.498404 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f85848e3ad467a98b34e314c4c0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.500358 1174 raft_consensus.cc:2243] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.500492 1174 raft_consensus.cc:2272] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.503059 1175 ts_tablet_manager.cc:1929] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.503825 1175 log.cc:1199] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:05.504827 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 (DEFAULT_TABLE table=default.Table_c089f502b5c44a8683680c392d35a8f3 [id=0e51b9c52b7c4cf4980718b72e97acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.506659 896 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0 (DEFAULT_TABLE table=default.Table_a0728a1f5a0249b89b542847e73c0396 [id=8fb1d47f638847d6950d5026aaeb87a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.507042 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.506626 1175 ts_tablet_manager.cc:1950] T 3650ec1de28c4f1bafd979257dd2b778 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.508390 1165 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.508589 1165 ts_tablet_manager.cc:1403] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260503 07:53:05.512387 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:05.512552 777 raft_consensus.cc:3060] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.513643 917 raft_consensus.cc:3060] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.512758 1165 raft_consensus.cc:359] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.514870 777 raft_consensus.cc:2468] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:05.514359 1165 raft_consensus.cc:385] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.515503 1174 ts_tablet_manager.cc:1916] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.515097 1165 raft_consensus.cc:740] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.520467 1165 consensus_queue.cc:260] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.521131 1165 ts_tablet_manager.cc:1434] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260503 07:53:05.521477 1165 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.524757 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0 (DEFAULT_TABLE table=default.Table_a0728a1f5a0249b89b542847e73c0396 [id=8fb1d47f638847d6950d5026aaeb87a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.525112 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0 (DEFAULT_TABLE table=default.Table_a0728a1f5a0249b89b542847e73c0396 [id=8fb1d47f638847d6950d5026aaeb87a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.525518 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.525763 891 tablet_service.cc:1511] Processing CreateTablet for tablet b381934d1db446d781b723536e33a486 (DEFAULT_TABLE table=default.Table_62c4fd77baad46ce84f266f86f23481a [id=3aa9b34a4d6e466b8802870d84736066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.526096 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b381934d1db446d781b723536e33a486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.526721 751 tablet_service.cc:1511] Processing CreateTablet for tablet b381934d1db446d781b723536e33a486 (DEFAULT_TABLE table=default.Table_62c4fd77baad46ce84f266f86f23481a [id=3aa9b34a4d6e466b8802870d84736066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.526993 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b381934d1db446d781b723536e33a486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.528779 986 leader_election.cc:304] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.529644 2269 raft_consensus.cc:2804] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:05.529760 2269 raft_consensus.cc:697] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:05.529973 2269 consensus_queue.cc:237] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.531116 1173 ts_tablet_manager.cc:1929] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:05.531215 1173 log.cc:1199] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/2d647277295e42cdb65f45a619e63960
I20260503 07:53:05.531584 1173 ts_tablet_manager.cc:1950] T 2d647277295e42cdb65f45a619e63960 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:05.531811 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b381934d1db446d781b723536e33a486 (DEFAULT_TABLE table=default.Table_62c4fd77baad46ce84f266f86f23481a [id=3aa9b34a4d6e466b8802870d84736066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.532150 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]) successfully deleted
I20260503 07:53:05.534216 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc3be27859f4342b14ed124a5230b57 (DEFAULT_TABLE table=default.Table_8f078ddc9bae42d9ad01f2a2db9aa8c2 [id=ce7f5f0ccc764d24947da9a43d1045fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.534600 891 tablet_service.cc:1511] Processing CreateTablet for tablet 28f3319e3f17410b88a85edc103695fa (DEFAULT_TABLE table=default.Table_37f986768ac642648f888ffbcb2cd7bd [id=1c525ea432c9485daaaab79daaac44f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.534884 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f3319e3f17410b88a85edc103695fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.542438 1166 tablet_bootstrap.cc:492] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.543071 1166 ts_tablet_manager.cc:1403] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.003s
I20260503 07:53:05.543979 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc3be27859f4342b14ed124a5230b57 (DEFAULT_TABLE table=default.Table_8f078ddc9bae42d9ad01f2a2db9aa8c2 [id=ce7f5f0ccc764d24947da9a43d1045fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.545095 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc3be27859f4342b14ed124a5230b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.546115 1166 raft_consensus.cc:359] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.546715 1166 raft_consensus.cc:385] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.546988 1166 raft_consensus.cc:740] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.550292 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 28f3319e3f17410b88a85edc103695fa (DEFAULT_TABLE table=default.Table_37f986768ac642648f888ffbcb2cd7bd [id=1c525ea432c9485daaaab79daaac44f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.549599 1166 consensus_queue.cc:260] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.551000 891 tablet_service.cc:1511] Processing CreateTablet for tablet 78367d83a2bb405a81ba37357752bc03 (DEFAULT_TABLE table=default.Table_e25c6ff05c264ce4905a0e07af688764 [id=23971d990cf74a6ab2f7fabb965fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.551381 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78367d83a2bb405a81ba37357752bc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.554183 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]). Expected version 3 got 0
I20260503 07:53:05.558089 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 262678b948bd46b6886277f8dd790441 (table default.Table_c081581d0e69483a9c4fdc42e9abec77 [id=6f2dee6dc12f4eb1a99cf69412d2d256]). Expected version 1 got 0
I20260503 07:53:05.559608 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ad22db3dd7be4ad6857b954e72ad22f0" } new_table_name: "default.Table_eabb4e1af013438dab101a4c7c684255" modify_external_catalogs: true
I20260503 07:53:05.562351 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 78367d83a2bb405a81ba37357752bc03 (DEFAULT_TABLE table=default.Table_e25c6ff05c264ce4905a0e07af688764 [id=23971d990cf74a6ab2f7fabb965fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.563069 1166 ts_tablet_manager.cc:1434] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260503 07:53:05.564049 886 tablet_service.cc:1511] Processing CreateTablet for tablet 87c22dfad06c407484e763a352e8be36 (DEFAULT_TABLE table=default.Table_ea935fa9bd9e4e02b107e95e4d05032e [id=da4897c856634cf99c579429f7ced315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.564251 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 87c22dfad06c407484e763a352e8be36 (DEFAULT_TABLE table=default.Table_ea935fa9bd9e4e02b107e95e4d05032e [id=da4897c856634cf99c579429f7ced315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.564587 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c22dfad06c407484e763a352e8be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.564918 1166 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.565145 892 tablet_service.cc:1511] Processing CreateTablet for tablet 94b987096aaa46d18c7c93763c70dd99 (DEFAULT_TABLE table=default.Table_36ca42c573384550909d2eb25a75785e [id=c1b6daba2b4c4112abcd1c5e85cbeee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.565727 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b987096aaa46d18c7c93763c70dd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.566085 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 94b987096aaa46d18c7c93763c70dd99 (DEFAULT_TABLE table=default.Table_36ca42c573384550909d2eb25a75785e [id=c1b6daba2b4c4112abcd1c5e85cbeee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.566567 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6e5283673660476eb689d41ef0daa2d0 (DEFAULT_TABLE table=default.Table_e453763b83b34fc5a5c811138db3a7d8 [id=ac8f484a8a9b4b028b6131a64cd5e0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.566843 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5283673660476eb689d41ef0daa2d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:05.567579 988 consensus_peers.cc:597] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.567778 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6e5283673660476eb689d41ef0daa2d0 (DEFAULT_TABLE table=default.Table_e453763b83b34fc5a5c811138db3a7d8 [id=ac8f484a8a9b4b028b6131a64cd5e0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.570866 1165 tablet_bootstrap.cc:654] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.572292 879 tablet_service.cc:1511] Processing CreateTablet for tablet d9c740466b52450480eb830cfb48a2aa (DEFAULT_TABLE table=default.Table_4f750fe160ac401c8bbbc91eaa8cf739 [id=5d51f483355b437db99515950293bfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.572652 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c740466b52450480eb830cfb48a2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.581054 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378cc6d613584f308d3c0fb68b31f26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.581214 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2ed7d2563487aa15fe917b3fcf313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.584347 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f85848e3ad467a98b34e314c4c0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.587073 1166 tablet_bootstrap.cc:654] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.588812 1175 tablet_replica.cc:333] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.589018 1175 raft_consensus.cc:2243] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.589170 1175 raft_consensus.cc:2272] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.589623 1175 ts_tablet_manager.cc:1916] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.592267 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32f72b5bfc4513a1dfbd72b0873fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.594931 2242 raft_consensus.cc:493] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.595034 759 tablet_service.cc:1511] Processing CreateTablet for tablet 94b987096aaa46d18c7c93763c70dd99 (DEFAULT_TABLE table=default.Table_36ca42c573384550909d2eb25a75785e [id=c1b6daba2b4c4112abcd1c5e85cbeee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.595394 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b987096aaa46d18c7c93763c70dd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.596356 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b381934d1db446d781b723536e33a486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.596585 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f3319e3f17410b88a85edc103695fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.597183 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.597373 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.597483 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.597739 760 tablet_service.cc:1511] Processing CreateTablet for tablet 78367d83a2bb405a81ba37357752bc03 (DEFAULT_TABLE table=default.Table_e25c6ff05c264ce4905a0e07af688764 [id=23971d990cf74a6ab2f7fabb965fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.598031 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78367d83a2bb405a81ba37357752bc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.600275 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc3be27859f4342b14ed124a5230b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.600397 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6e5283673660476eb689d41ef0daa2d0 (DEFAULT_TABLE table=default.Table_e453763b83b34fc5a5c811138db3a7d8 [id=ac8f484a8a9b4b028b6131a64cd5e0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.600704 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5283673660476eb689d41ef0daa2d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.604779 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78367d83a2bb405a81ba37357752bc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.595044 2242 raft_consensus.cc:515] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.607445 596 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:05.607721 2242 leader_election.cc:290] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:05.608412 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c22dfad06c407484e763a352e8be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.608675 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_281dfb85ec6847eabbcb68be237d659c" } new_table_name: "default.Table_a39a4fb4860242df95073cf5af334b14" modify_external_catalogs: true
I20260503 07:53:05.608842 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b987096aaa46d18c7c93763c70dd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.609879 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 05134e2081544b5fb7694d63265b047b
I20260503 07:53:05.610549 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3c54a91d67d2444a902e026221ecd8f5" } new_table_name: "default.Table_d8dfa186e5c348088d48fcf7e3351f70" modify_external_catalogs: true
I20260503 07:53:05.611632 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 314618c911b148d48e4651a100d66fae
I20260503 07:53:05.612221 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b9564d16fb3e4357babd5755073826cf" } new_table_name: "default.Table_875cb37ee7584c2b93f8898085e79147" modify_external_catalogs: true
W20260503 07:53:05.613241 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3e5be5ce78c4da2a76e819a050d56f4 consensus state has no leader
I20260503 07:53:05.613564 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bdb2f3fb02ed488fb0bc75b137b9b52d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.614013 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdb2f3fb02ed488fb0bc75b137b9b52d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.615168 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 84d1372ba462479db6cf9e865c104df4
I20260503 07:53:05.615535 599 catalog_manager.cc:6741] ReplaceTablet: tablet 84d1372ba462479db6cf9e865c104df4 deleted and replaced by tablet c101375191f941648f3a0880a4bde6b9
I20260503 07:53:05.615813 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_861f3d34a3e747718e7261ddd3bc305e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.616278 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_861f3d34a3e747718e7261ddd3bc305e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.617695 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c51fe76096684794aac4f5f65c8de1b5
I20260503 07:53:05.618254 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_00edbca8b4c84e21b4f9ed7a14848bba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.618671 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00edbca8b4c84e21b4f9ed7a14848bba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.620548 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5283673660476eb689d41ef0daa2d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.623034 751 tablet_service.cc:1511] Processing CreateTablet for tablet 28f3319e3f17410b88a85edc103695fa (DEFAULT_TABLE table=default.Table_37f986768ac642648f888ffbcb2cd7bd [id=1c525ea432c9485daaaab79daaac44f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.623392 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f3319e3f17410b88a85edc103695fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.625334 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 05134e2081544b5fb7694d63265b047b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.625681 715 consensus_peers.cc:597] T 08cfc6488f404a14af0b7aca20710101 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.627115 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d1372ba462479db6cf9e865c104df4 with delete_type TABLET_DATA_DELETED (replaced by tablet c101375191f941648f3a0880a4bde6b9) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.627277 742 tablet_service.cc:1558] Processing DeleteTablet for tablet c51fe76096684794aac4f5f65c8de1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.600397 746 tablet_service.cc:1511] Processing CreateTablet for tablet 87c22dfad06c407484e763a352e8be36 (DEFAULT_TABLE table=default.Table_ea935fa9bd9e4e02b107e95e4d05032e [id=da4897c856634cf99c579429f7ced315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.627656 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c22dfad06c407484e763a352e8be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.628494 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 314618c911b148d48e4651a100d66fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.629179 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 05134e2081544b5fb7694d63265b047b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.632279 896 tablet_service.cc:1558] Processing DeleteTablet for tablet c51fe76096684794aac4f5f65c8de1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.581066 1171 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:05.634702 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 05134e2081544b5fb7694d63265b047b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05134e2081544b5fb7694d63265b047b already in progress: creating tablet
W20260503 07:53:05.634950 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c51fe76096684794aac4f5f65c8de1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51fe76096684794aac4f5f65c8de1b5 already in progress: creating tablet
I20260503 07:53:05.634995 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d1372ba462479db6cf9e865c104df4 with delete_type TABLET_DATA_DELETED (replaced by tablet c101375191f941648f3a0880a4bde6b9) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.638511 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 45232.1us
I20260503 07:53:05.640038 1171 tablet_bootstrap.cc:654] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:05.643654 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 84d1372ba462479db6cf9e865c104df4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d1372ba462479db6cf9e865c104df4 already in progress: creating tablet
I20260503 07:53:05.645371 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 99e681a9fdf64f42a947b2cbc6b47b7b
I20260503 07:53:05.645972 592 master_service.cc:954] ReplaceTablet: received request to replace tablet ae3fcb4d83f64f6182a78a1a02da39d6 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:05.646903 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.650409 2269 consensus_queue.cc:1048] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.651549 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_08a0ebcd938740c2b493ff2654f8e854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.652146 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08a0ebcd938740c2b493ff2654f8e854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.653087 2269 consensus_queue.cc:1048] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.655874 2268 raft_consensus.cc:493] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.655995 2268 raft_consensus.cc:515] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.656445 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 05134e2081544b5fb7694d63265b047b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.657011 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 314618c911b148d48e4651a100d66fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.657195 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 3650ec1de28c4f1bafd979257dd2b778 (table default.Table_50b3d54db78b4a0fa4c0735349d51cad [id=d778245ff437405896430039f772e652]) successfully deleted
I20260503 07:53:05.657325 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d1372ba462479db6cf9e865c104df4 with delete_type TABLET_DATA_DELETED (replaced by tablet c101375191f941648f3a0880a4bde6b9) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.658039 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 314618c911b148d48e4651a100d66fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.658578 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 314618c911b148d48e4651a100d66fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314618c911b148d48e4651a100d66fae already in progress: creating tablet
I20260503 07:53:05.659127 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.659565 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.659634 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 99e681a9fdf64f42a947b2cbc6b47b7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99e681a9fdf64f42a947b2cbc6b47b7b already in progress: creating tablet
W20260503 07:53:05.660074 715 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.663280 2268 leader_election.cc:290] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:05.666074 988 consensus_peers.cc:597] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.666898 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet c51fe76096684794aac4f5f65c8de1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.667169 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e681a9fdf64f42a947b2cbc6b47b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.667120 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac435b09639484ca1ae82f3d4990d48" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:05.667872 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:05.669142 988 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.672473 1175 ts_tablet_manager.cc:1929] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.672976 1166 tablet_bootstrap.cc:492] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.674670 1166 ts_tablet_manager.cc:1403] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.000s
I20260503 07:53:05.675453 1166 raft_consensus.cc:359] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.677799 1166 raft_consensus.cc:385] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.677923 1166 raft_consensus.cc:740] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:05.677964 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dd241f8b17b412e8789b0918357bf35 consensus state has no leader
I20260503 07:53:05.678179 1166 consensus_queue.cc:260] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.678608 1166 ts_tablet_manager.cc:1434] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:53:05.680894 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ae3fcb4d83f64f6182a78a1a02da39d6
I20260503 07:53:05.681392 592 catalog_manager.cc:6741] ReplaceTablet: tablet ae3fcb4d83f64f6182a78a1a02da39d6 deleted and replaced by tablet 18b9a34f66d342fcbff7f8b8adb28b80
I20260503 07:53:05.681705 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b0fa0d992731427699a76c1870ca3cc6" } modify_external_catalogs: true
I20260503 07:53:05.681886 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b0fa0d992731427699a76c1870ca3cc6" } modify_external_catalogs: true
I20260503 07:53:05.680423 1166 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:05.682886 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 618b858f6e424845b5a6b0010cb2b602 consensus state has no leader
I20260503 07:53:05.683270 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d4d1026e4b5543358358b803c5854c5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.682017 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b9a34f66d342fcbff7f8b8adb28b80) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.682986 1175 log.cc:1199] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/596130e78eb1444a96480fc1075478cd
W20260503 07:53:05.683781 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4d1026e4b5543358358b803c5854c5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.683811 1166 tablet_bootstrap.cc:654] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.684240 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6847e950344842ee9d8a308444ab7c47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.684646 1175 ts_tablet_manager.cc:1950] T 596130e78eb1444a96480fc1075478cd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:05.684676 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6847e950344842ee9d8a308444ab7c47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:05.685065 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1c68ca20b1548d99a5956c20b194964 consensus state has no leader
I20260503 07:53:05.683290 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_143191f2475a48059309728da56ea7a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.686237 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
W20260503 07:53:05.686578 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143191f2475a48059309728da56ea7a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.686968 598 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139] alter complete (version 2)
I20260503 07:53:05.687377 1175 tablet_replica.cc:333] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.687567 1175 raft_consensus.cc:2243] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:05.687855 1175 raft_consensus.cc:2272] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:05.689515 716 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.690239 716 leader_election.cc:304] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.691056 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:05.691359 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_fd434aa643a94db8b792d842cddbede3 [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 1 got 0
I20260503 07:53:05.691417 1175 ts_tablet_manager.cc:1916] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.691540 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 596130e78eb1444a96480fc1075478cd (table default.Table_7f279670887e4606ab0d08db41d9affe [id=04182b9dfa4f41738dedf12d85d54147]) successfully deleted
I20260503 07:53:05.691772 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:05.693646 2076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Bootstrap replayed 1/1 log segments. Stats: ops{read=589 overwritten=0 applied=576 ignored=0} inserts{seen=538 ignored=0} mutations{seen=661 ignored=0} orphaned_commits=0. Pending: 13 replicates
I20260503 07:53:05.694231 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b9a34f66d342fcbff7f8b8adb28b80) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.694497 2076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: Bootstrap complete.
I20260503 07:53:05.694626 2302 raft_consensus.cc:2749] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:05.694234 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.697059 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b9a34f66d342fcbff7f8b8adb28b80) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:05.697707 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet ae3fcb4d83f64f6182a78a1a02da39d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3fcb4d83f64f6182a78a1a02da39d6 already in progress: creating tablet
I20260503 07:53:05.700560 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.701354 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.701843 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.702399 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.702425 2269 raft_consensus.cc:493] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.702539 2269 raft_consensus.cc:515] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.702979 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.703248 2269 leader_election.cc:290] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.703787 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7654a4a85b6441f9d36527ced775aa2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.704417 988 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:05.704701 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9965fee9d08749b6b39c82e99fdcfbef consensus state has no leader
I20260503 07:53:05.705026 1166 tablet_bootstrap.cc:492] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.705209 1166 ts_tablet_manager.cc:1403] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260503 07:53:05.706089 1166 raft_consensus.cc:359] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.706327 1166 raft_consensus.cc:385] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.706434 1166 raft_consensus.cc:740] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.706683 1166 consensus_queue.cc:260] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.707224 1166 ts_tablet_manager.cc:1434] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:05.711820 1166 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.713068 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:05.713670 1166 tablet_bootstrap.cc:654] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.715091 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7654a4a85b6441f9d36527ced775aa2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:05.715286 775 raft_consensus.cc:2468] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:05.725348 1166 tablet_bootstrap.cc:492] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.725581 1166 ts_tablet_manager.cc:1403] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260503 07:53:05.718622 986 leader_election.cc:304] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.726528 1166 raft_consensus.cc:359] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.726774 1166 raft_consensus.cc:385] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.726869 1166 raft_consensus.cc:740] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.727150 1166 consensus_queue.cc:260] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.727686 1166 ts_tablet_manager.cc:1434] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:05.728483 2262 raft_consensus.cc:2804] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:05.728580 2262 raft_consensus.cc:493] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:05.728641 2262 raft_consensus.cc:3060] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.728874 1166 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:05.728487 2304 log.cc:927] Time spent T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260503 07:53:05.730372 1166 tablet_bootstrap.cc:654] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.731215 2262 raft_consensus.cc:515] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.731832 2262 leader_election.cc:290] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.732672 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 399acb90cf124fcf8a75bf936e3e426f (table default.Table_00a5ff003ba74e7b93006dc720605b27 [id=4050cfa4cfd842f1aecc75f586518139]). Expected version 2 got 0
I20260503 07:53:05.731061 2076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Replica starting. Triggering 13 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:53:05.733811 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7654a4a85b6441f9d36527ced775aa2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:05.734333 988 consensus_peers.cc:597] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:05.734510 988 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.656764 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc3be27859f4342b14ed124a5230b57 (DEFAULT_TABLE table=default.Table_8f078ddc9bae42d9ad01f2a2db9aa8c2 [id=ce7f5f0ccc764d24947da9a43d1045fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.735049 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc3be27859f4342b14ed124a5230b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.737239 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7654a4a85b6441f9d36527ced775aa2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:05.737407 779 raft_consensus.cc:3060] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:05.738463 986 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:05.738883 986 leader_election.cc:304] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:05.739445 2269 raft_consensus.cc:2749] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:05.740489 986 consensus_peers.cc:597] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.748909 1175 ts_tablet_manager.cc:1929] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:05.749377 1175 log.cc:1199] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1e2546e95e0f40ad99f1ba6bc512debe
I20260503 07:53:05.750762 1175 ts_tablet_manager.cc:1950] T 1e2546e95e0f40ad99f1ba6bc512debe P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.751127 964 heartbeater.cc:344] Connected to a master server at 127.0.105.62:44841
I20260503 07:53:05.751847 1166 tablet_bootstrap.cc:492] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.752029 1166 ts_tablet_manager.cc:1403] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260503 07:53:05.752916 1166 raft_consensus.cc:359] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.753137 1166 raft_consensus.cc:385] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.753227 1166 raft_consensus.cc:740] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.753489 1166 consensus_queue.cc:260] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.753974 1166 ts_tablet_manager.cc:1434] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:05.754263 1166 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.757678 1166 tablet_bootstrap.cc:654] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.759959 1171 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:05.760123 1171 ts_tablet_manager.cc:1403] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.179s user 0.001s sys 0.011s
I20260503 07:53:05.761334 1171 raft_consensus.cc:359] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.761528 1171 raft_consensus.cc:385] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.761618 1171 raft_consensus.cc:740] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.761839 1171 consensus_queue.cc:260] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.571966 1174 ts_tablet_manager.cc:1929] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.764616 1174 log.cc:1199] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:05.765617 1166 tablet_bootstrap.cc:492] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.766222 1166 ts_tablet_manager.cc:1403] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260503 07:53:05.767189 1166 raft_consensus.cc:359] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.768252 1166 raft_consensus.cc:385] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.768527 1166 raft_consensus.cc:740] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.768896 1166 consensus_queue.cc:260] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.769958 1166 ts_tablet_manager.cc:1434] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260503 07:53:05.746713 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:05.755589 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b0bbeaab9d4e4596bca0fc88135f1a98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.770831 1166 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:05.771394 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0bbeaab9d4e4596bca0fc88135f1a98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.769586 2302 raft_consensus.cc:493] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.771656 2302 raft_consensus.cc:515] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.772356 2302 leader_election.cc:290] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:05.772993 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:05.772986 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.773451 715 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.770007 751 tablet_service.cc:1511] Processing CreateTablet for tablet d9c740466b52450480eb830cfb48a2aa (DEFAULT_TABLE table=default.Table_4f750fe160ac401c8bbbc91eaa8cf739 [id=5d51f483355b437db99515950293bfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.775213 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c740466b52450480eb830cfb48a2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.774108 593 catalog_manager.cc:5671] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:05.771515 1165 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.777842 1165 ts_tablet_manager.cc:1403] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.256s user 0.004s sys 0.004s
I20260503 07:53:05.778728 1165 raft_consensus.cc:359] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.778892 1165 raft_consensus.cc:385] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.778954 1165 raft_consensus.cc:740] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.779148 1165 consensus_queue.cc:260] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.779498 779 raft_consensus.cc:2468] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:05.779625 1165 ts_tablet_manager.cc:1434] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:05.779904 1165 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:05.780946 1166 tablet_bootstrap.cc:654] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.781512 1165 tablet_bootstrap.cc:654] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.765010 1174 ts_tablet_manager.cc:1950] T 5a178957514e4f77afe8a1879b57a96b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:05.782779 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5a178957514e4f77afe8a1879b57a96b (table default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]) successfully deleted
I20260503 07:53:05.785548 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]) successfully deleted
W20260503 07:53:05.785820 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8160807f463042e7bd65ba846a726922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8160807f463042e7bd65ba846a726922 already in progress: creating tablet
W20260503 07:53:05.786060 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6c6d0c557fe34e588e5baddc3a30774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c6d0c557fe34e588e5baddc3a30774e already in progress: creating tablet
I20260503 07:53:05.788071 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c19ad357f7845fc8389cb5b923bc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.788146 1166 tablet_bootstrap.cc:492] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.788288 1166 ts_tablet_manager.cc:1403] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.001s
I20260503 07:53:05.788344 1173 tablet_replica.cc:333] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:05.788527 1173 raft_consensus.cc:2243] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.788678 1173 raft_consensus.cc:2272] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.789476 1173 ts_tablet_manager.cc:1916] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.789861 2082 raft_consensus.cc:493] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.789996 2082 raft_consensus.cc:515] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.790649 2082 leader_election.cc:290] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.792920 1166 raft_consensus.cc:359] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.793157 1166 raft_consensus.cc:385] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.793267 1166 raft_consensus.cc:740] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.793543 1166 consensus_queue.cc:260] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.794163 1174 tablet_replica.cc:333] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:05.794349 1174 raft_consensus.cc:2243] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.794512 1174 raft_consensus.cc:2272] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.795653 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e2546e95e0f40ad99f1ba6bc512debe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:04 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.795660 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cb8e3c37b65a4f3b8fb3d6357af50325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8e3c37b65a4f3b8fb3d6357af50325 already in progress: creating tablet
I20260503 07:53:05.795919 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:05.796069 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 34fa92517beb4622bdfa3fd824e78648 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fa92517beb4622bdfa3fd824e78648 already in progress: creating tablet
W20260503 07:53:05.796487 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8160807f463042e7bd65ba846a726922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8160807f463042e7bd65ba846a726922 already in progress: creating tablet
I20260503 07:53:05.796679 1166 ts_tablet_manager.cc:1434] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
W20260503 07:53:05.796842 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6c6d0c557fe34e588e5baddc3a30774e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c6d0c557fe34e588e5baddc3a30774e already in progress: creating tablet
I20260503 07:53:05.798296 1166 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.800137 1166 tablet_bootstrap.cc:654] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.810410 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:05.810606 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_fd434aa643a94db8b792d842cddbede3 [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 1 got 0
I20260503 07:53:05.810896 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:05.811072 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:05.812966 759 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec3a091cf4423bd7834c492bc192c (DEFAULT_TABLE table=default.Table_39fbb94c49ba4745b175e809b6cea52e [id=a03ba293fe9442b2b7d39e823984e704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.813397 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec3a091cf4423bd7834c492bc192c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.816426 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 579b36bfb4794a34907720b8b75ebf5c
I20260503 07:53:05.806070 885 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec3a091cf4423bd7834c492bc192c (DEFAULT_TABLE table=default.Table_39fbb94c49ba4745b175e809b6cea52e [id=a03ba293fe9442b2b7d39e823984e704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.820938 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec3a091cf4423bd7834c492bc192c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.821022 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 (DEFAULT_TABLE table=default.Table_d83ff5edb21b430faaf244a27b9283eb [id=fd0f2dda837f44e280eac233c5aa998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.821426 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b18c4ecb2ca453ea69772cd68244394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.821548 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 579b36bfb4794a34907720b8b75ebf5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.823768 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:05.823942 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:05.824129 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:05.808755 879 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04763bb23b4c0f91df21eb0073095f (DEFAULT_TABLE table=default.Table_ff1d642f7a1246b0854a16320e21497c [id=b29b25334a80402eb6687ab2e2ed99ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.824656 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04763bb23b4c0f91df21eb0073095f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.817497 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 579b36bfb4794a34907720b8b75ebf5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.834443 746 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.835888 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_25a7649dbedf42b78ea9fcb629b4daf3" } modify_external_catalogs: true
I20260503 07:53:05.836104 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2692c0bf0e5d44998c33f5f0d213500c" } modify_external_catalogs: true
I20260503 07:53:05.836148 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_25a7649dbedf42b78ea9fcb629b4daf3" } modify_external_catalogs: true
I20260503 07:53:05.836300 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2692c0bf0e5d44998c33f5f0d213500c" } modify_external_catalogs: true
I20260503 07:53:05.836782 1173 ts_tablet_manager.cc:1929] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.836871 1173 log.cc:1199] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9c19ad357f7845fc8389cb5b923bc253
I20260503 07:53:05.836813 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0b4b1c5a7d594917adaffff902630bd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.837173 1173 ts_tablet_manager.cc:1950] T 9c19ad357f7845fc8389cb5b923bc253 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:53:05.837322 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b4b1c5a7d594917adaffff902630bd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.838227 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9c19ad357f7845fc8389cb5b923bc253 (table default.Table_41955bf1ee7940bbba5877433307da3c [id=9a70727cc675434d98a017fd25f78f37]) successfully deleted
I20260503 07:53:05.838549 1173 tablet_replica.cc:333] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:05.838754 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bf1f9987b1fd4d8faa7ba3073334730d" } new_table_name: "default.Table_33a075e3f2664a048bf69ad17c31d26f" modify_external_catalogs: true
I20260503 07:53:05.838795 1173 raft_consensus.cc:2243] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.839046 1173 raft_consensus.cc:2272] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.839946 1173 ts_tablet_manager.cc:1916] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.840067 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a2aede41512c49438f7515bc1fabed2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.840550 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2aede41512c49438f7515bc1fabed2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.840668 917 raft_consensus.cc:3060] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.844892 915 raft_consensus.cc:3060] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.847574 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b688bb298df944f798eb63e70f407f61" } modify_external_catalogs: true
I20260503 07:53:05.847743 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b688bb298df944f798eb63e70f407f61" } modify_external_catalogs: true
I20260503 07:53:05.849642 1166 tablet_bootstrap.cc:492] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.849797 1166 ts_tablet_manager.cc:1403] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.004s
I20260503 07:53:05.850636 1166 raft_consensus.cc:359] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.850826 1166 raft_consensus.cc:385] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.850910 1166 raft_consensus.cc:740] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.852331 1166 consensus_queue.cc:260] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.853083 1166 ts_tablet_manager.cc:1434] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260503 07:53:05.853381 1166 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.855072 1166 tablet_bootstrap.cc:654] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.856501 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7cca44c2622e4f9493d71e59fc3056ae
I20260503 07:53:05.856501 1174 ts_tablet_manager.cc:1916] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.857553 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.857896 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.773062 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:05.858783 716 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.858937 716 leader_election.cc:304] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.859193 2298 raft_consensus.cc:2749] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:05.779928 986 leader_election.cc:304] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.785004 1175 tablet_replica.cc:333] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.859647 1173 ts_tablet_manager.cc:1929] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.859630 1952 raft_consensus.cc:2804] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:05.859730 1173 log.cc:1199] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/1e2546e95e0f40ad99f1ba6bc512debe
I20260503 07:53:05.859752 1952 raft_consensus.cc:697] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:05.859807 1175 raft_consensus.cc:2243] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.859982 1175 raft_consensus.cc:2272] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.860028 1173 ts_tablet_manager.cc:1950] T 1e2546e95e0f40ad99f1ba6bc512debe P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:05.860019 1952 consensus_queue.cc:237] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.860507 1175 ts_tablet_manager.cc:1916] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.860927 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]) successfully deleted
W20260503 07:53:05.863363 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 579b36bfb4794a34907720b8b75ebf5c because the tablet was not found. No further retry: Not found: Tablet not found: 579b36bfb4794a34907720b8b75ebf5c
W20260503 07:53:05.863826 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd492fb40d4944e0bb1e1e7019570778 consensus state has no leader
I20260503 07:53:05.808919 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec3a091cf4423bd7834c492bc192c (DEFAULT_TABLE table=default.Table_39fbb94c49ba4745b175e809b6cea52e [id=a03ba293fe9442b2b7d39e823984e704]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:05.864121 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 7cca44c2622e4f9493d71e59fc3056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cca44c2622e4f9493d71e59fc3056ae already in progress: creating tablet
I20260503 07:53:05.864485 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec3a091cf4423bd7834c492bc192c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.865114 2298 raft_consensus.cc:493] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.865254 2298 raft_consensus.cc:515] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.865988 2298 leader_election.cc:290] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:05.866524 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3fda3bba9234622b2c391a31c55dc3a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.867075 715 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.867599 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3fda3bba9234622b2c391a31c55dc3a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:05.867758 1052 raft_consensus.cc:2468] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:05.868132 716 leader_election.cc:304] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.868359 1166 tablet_bootstrap.cc:492] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.868467 1166 ts_tablet_manager.cc:1403] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260503 07:53:05.868551 2298 raft_consensus.cc:2804] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:05.868623 2298 raft_consensus.cc:493] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:05.868681 2298 raft_consensus.cc:3060] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.869338 1166 raft_consensus.cc:359] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.869495 1166 raft_consensus.cc:385] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.869553 1166 raft_consensus.cc:740] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.869758 1166 consensus_queue.cc:260] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.870267 1166 ts_tablet_manager.cc:1434] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:05.870527 1166 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:05.871176 2298 raft_consensus.cc:515] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.871245 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8310072bf9824acdb7236d1153b75434" } modify_external_catalogs: true
I20260503 07:53:05.871412 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8310072bf9824acdb7236d1153b75434" } modify_external_catalogs: true
I20260503 07:53:05.872306 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3fda3bba9234622b2c391a31c55dc3a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:05.872763 715 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.873131 1166 tablet_bootstrap.cc:654] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.873765 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3fda3bba9234622b2c391a31c55dc3a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:05.873934 1052 raft_consensus.cc:3060] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.876497 2298 leader_election.cc:290] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:05.809144 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 (DEFAULT_TABLE table=default.Table_d83ff5edb21b430faaf244a27b9283eb [id=fd0f2dda837f44e280eac233c5aa998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.809773 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.809883 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.809963 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.817253 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 579b36bfb4794a34907720b8b75ebf5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.876977 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b18c4ecb2ca453ea69772cd68244394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.818558 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d9c740466b52450480eb830cfb48a2aa (DEFAULT_TABLE table=default.Table_4f750fe160ac401c8bbbc91eaa8cf739 [id=5d51f483355b437db99515950293bfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.877400 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c740466b52450480eb830cfb48a2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.877854 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bfb51a2a01aa4806aedc3a2b76908477
I20260503 07:53:05.878463 885 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:05.878988 587 catalog_manager.cc:4969] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet bfb51a2a01aa4806aedc3a2b76908477 because the tablet was not found. No further retry: Not found: Tablet not found: bfb51a2a01aa4806aedc3a2b76908477
W20260503 07:53:05.851667 988 consensus_peers.cc:597] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.880769 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.880873 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7eea345022f4468c978d09942e1140f2" } new_table_name: "default.Table_cfb780593d00408c95ded7e5b545f97c" modify_external_catalogs: true
I20260503 07:53:05.880987 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cca44c2622e4f9493d71e59fc3056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.881425 746 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.882313 1052 raft_consensus.cc:2468] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:05.882758 716 leader_election.cc:304] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.884673 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d8dfa186e5c348088d48fcf7e3351f70" } new_table_name: "default.Table_7962d29839a24f099242e1ca51bcb7b1" modify_external_catalogs: true
I20260503 07:53:05.885906 2298 raft_consensus.cc:2804] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:05.885939 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_321ac527100e4b3b82f32fa3f9ad059b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.886058 2298 raft_consensus.cc:697] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:05.886284 2298 consensus_queue.cc:237] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:05.886440 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_321ac527100e4b3b82f32fa3f9ad059b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.886835 1175 ts_tablet_manager.cc:1929] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.887290 1175 log.cc:1199] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:05.888108 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3a454390260a4bd3a83bf082ce3c43b6" } new_table_name: "default.Table_50bfa1d81ea94efeac3e4c3680bd4406" modify_external_catalogs: true
I20260503 07:53:05.888286 1175 ts_tablet_manager.cc:1950] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.889084 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_fd434aa643a94db8b792d842cddbede3 [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 1 got 0
I20260503 07:53:05.889315 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:05.889510 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:05.889671 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:05.889876 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (table default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]) successfully deleted
I20260503 07:53:05.890425 1175 tablet_replica.cc:333] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:05.891291 1175 raft_consensus.cc:2243] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.891337 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4ad45235559c41a89c55250d5bf4577b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.891819 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ad45235559c41a89c55250d5bf4577b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.892110 1175 raft_consensus.cc:2272] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.894393 886 tablet_service.cc:1511] Processing CreateTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 (DEFAULT_TABLE table=default.Table_d83ff5edb21b430faaf244a27b9283eb [id=fd0f2dda837f44e280eac233c5aa998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.894892 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b18c4ecb2ca453ea69772cd68244394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.895025 1175 ts_tablet_manager.cc:1916] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.896818 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a0893d7a732040d8bb226caa8eec28d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:05.897330 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0893d7a732040d8bb226caa8eec28d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.902191 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9833d3b3bf174720b5da54e19ae8e015
I20260503 07:53:05.902278 2113 raft_consensus.cc:493] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.902405 2113 raft_consensus.cc:515] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.902962 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.903055 2113 leader_election.cc:290] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.903321 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.903518 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.903597 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9833d3b3bf174720b5da54e19ae8e015 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9833d3b3bf174720b5da54e19ae8e015 already in progress: creating tablet
W20260503 07:53:05.904089 988 leader_election.cc:343] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.904228 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 9833d3b3bf174720b5da54e19ae8e015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:05.904984 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 125079us
I20260503 07:53:05.906266 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfbfc18284c4d7385c7d0e9ea1a42f2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:05.906661 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:05.906855 779 raft_consensus.cc:2468] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:05.908456 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5776840523f54e6bb18d674815d3b447
I20260503 07:53:05.909126 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 5776840523f54e6bb18d674815d3b447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.909350 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b5c9caa8c56c466198de2174b1fd90a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:05.909458 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8d334082884d4c59a4de7279df62be83" } new_table_name: "default.Table_05ab2ff744764108ad29bbbba0578895" modify_external_catalogs: true
W20260503 07:53:05.909735 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5776840523f54e6bb18d674815d3b447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5776840523f54e6bb18d674815d3b447 already in progress: creating tablet
W20260503 07:53:05.910030 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5c9caa8c56c466198de2174b1fd90a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:05.911051 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5776840523f54e6bb18d674815d3b447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:05.913486 2330 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:05.913506 2076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65adddd546eb49779519c7f7378d0e60, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.915162 986 leader_election.cc:304] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.915444 2113 raft_consensus.cc:2804] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:05.915541 2113 raft_consensus.cc:493] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:05.915656 2113 raft_consensus.cc:3060] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.918167 2113 raft_consensus.cc:515] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.919358 2113 leader_election.cc:290] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.919396 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:05.920217 988 leader_election.cc:343] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.922426 854 leader_election.cc:304] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:05.923728 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31025296f77e431da6238360724fd60a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:05.923981 775 raft_consensus.cc:3060] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.922740 2076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 576, Last appended: 1.589, Last appended by leader: 589, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } }
I20260503 07:53:05.925899 1171 ts_tablet_manager.cc:1434] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.166s user 0.000s sys 0.002s
I20260503 07:53:05.926435 1171 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:05.926759 775 raft_consensus.cc:2468] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:05.927484 2281 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:05.928305 1171 tablet_bootstrap.cc:654] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:05.929348 986 leader_election.cc:304] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.929890 2269 raft_consensus.cc:2804] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:05.930006 2269 raft_consensus.cc:697] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:05.930202 2269 consensus_queue.cc:237] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.932965 2262 raft_consensus.cc:493] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.933069 2262 raft_consensus.cc:515] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.933584 2262 leader_election.cc:290] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.934058 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.934645 988 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:05.936210 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1c68ca20b1548d99a5956c20b194964 consensus state has no leader
I20260503 07:53:05.940023 1165 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:05.943394 1165 ts_tablet_manager.cc:1403] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.164s user 0.003s sys 0.000s
W20260503 07:53:05.947386 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 consensus state has no leader
I20260503 07:53:05.942705 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:05.956336 775 raft_consensus.cc:2468] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:05.940570 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 5776840523f54e6bb18d674815d3b447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:05.956524 2113 consensus_queue.cc:1048] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:05.952180 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:05.957532 1173 tablet_replica.cc:333] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:05.957741 1173 raft_consensus.cc:2243] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:05.957911 1173 raft_consensus.cc:2272] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:05.958762 1173 ts_tablet_manager.cc:1916] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:05.960924 986 leader_election.cc:304] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:05.961177 2262 raft_consensus.cc:2804] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:05.961247 2262 raft_consensus.cc:493] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:05.961313 2262 raft_consensus.cc:3060] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.963761 2262 raft_consensus.cc:515] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.966382 2262 leader_election.cc:290] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.967033 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:05.967600 988 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:05.967856 1173 ts_tablet_manager.cc:1929] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.967998 1173 log.cc:1199] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/75419ed8fabc4c36ae2d2b128ec4f5b5
I20260503 07:53:05.968355 1173 ts_tablet_manager.cc:1950] T 75419ed8fabc4c36ae2d2b128ec4f5b5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:05.969640 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 75419ed8fabc4c36ae2d2b128ec4f5b5 (table default.Table_49aeb9af1f3e46548302416f0651e300 [id=2cb11e87b3194f899d2c6eace9d25074]) successfully deleted
I20260503 07:53:05.969646 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04763bb23b4c0f91df21eb0073095f (DEFAULT_TABLE table=default.Table_ff1d642f7a1246b0854a16320e21497c [id=b29b25334a80402eb6687ab2e2ed99ee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:05.973145 988 consensus_peers.cc:597] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:05.975291 1166 tablet_bootstrap.cc:492] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:05.975540 1166 ts_tablet_manager.cc:1403] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.105s user 0.045s sys 0.029s
I20260503 07:53:05.976609 2331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:53:05.976930 2331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:53:05.977605 1166 raft_consensus.cc:359] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.977923 1166 raft_consensus.cc:385] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:05.978050 1166 raft_consensus.cc:740] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:05.978407 1166 consensus_queue.cc:260] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:05.979048 2076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:53:05.979914 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04763bb23b4c0f91df21eb0073095f (DEFAULT_TABLE table=default.Table_ff1d642f7a1246b0854a16320e21497c [id=b29b25334a80402eb6687ab2e2ed99ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.980787 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04763bb23b4c0f91df21eb0073095f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:05.982496 891 tablet_service.cc:1511] Processing CreateTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 (DEFAULT_TABLE table=default.Table_b688bb298df944f798eb63e70f407f61 [id=9b5522ae378e43d69d011a65b37891d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:05.983403 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb51a2a01aa4806aedc3a2b76908477. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:05.986575 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 431525b4f9154154890a026a4ce3755b consensus state has no leader
I20260503 07:53:05.989778 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a0272fdc34044af78ba21b6ca31bc" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:05.990022 779 raft_consensus.cc:3060] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:05.990017 1175 ts_tablet_manager.cc:1929] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:05.990144 1175 log.cc:1199] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ebec2b05025444ccaf0bf0bb4ab62dae
I20260503 07:53:05.991012 2281 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:05.991757 1175 ts_tablet_manager.cc:1950] T ebec2b05025444ccaf0bf0bb4ab62dae P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:05.991259 2338 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:05.993896 779 raft_consensus.cc:2468] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:05.996428 2113 raft_consensus.cc:493] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:05.996565 2113 raft_consensus.cc:515] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:05.997925 2113 leader_election.cc:290] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:05.998144 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd6a702c59445882a81ca2e3a0f3f6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:05.998588 988 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.001185 2339 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.001996 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ebec2b05025444ccaf0bf0bb4ab62dae (table default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]) successfully deleted
I20260503 07:53:06.002425 1175 tablet_replica.cc:333] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.002732 1175 raft_consensus.cc:2243] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.002956 1175 raft_consensus.cc:2272] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.003585 1175 ts_tablet_manager.cc:1916] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.008951 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7ecf8a10ab1b4df49f3f7909c8474734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.017231 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ecf8a10ab1b4df49f3f7909c8474734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.009548 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7d632b4e26a645269d8c554f5dd9f8ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.018563 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
W20260503 07:53:06.018779 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d632b4e26a645269d8c554f5dd9f8ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.030491 600 catalog_manager.cc:5671] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:06.031047 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:06.032709 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_6d5297af28e8453cae39dae2ca4b7584 [id=ff32cf0130ba49fbbe5d93a0507bdc80] alter complete (version 1)
I20260503 07:53:06.034375 1175 ts_tablet_manager.cc:1929] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.035081 1166 ts_tablet_manager.cc:1434] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.059s user 0.003s sys 0.012s
I20260503 07:53:06.035501 1166 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.037710 1166 tablet_bootstrap.cc:654] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.038481 1175 log.cc:1199] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:06.043668 1175 ts_tablet_manager.cc:1950] T ecc39d127c71412ea867a0b3cad10452 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.044375 916 raft_consensus.cc:3060] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:06.050976 988 consensus_peers.cc:597] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:06.051895 1166 tablet_bootstrap.cc:492] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.052073 1166 ts_tablet_manager.cc:1403] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20260503 07:53:06.053119 1166 raft_consensus.cc:359] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.053366 1166 raft_consensus.cc:385] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.053459 1166 raft_consensus.cc:740] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.053719 1166 consensus_queue.cc:260] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.054260 1166 ts_tablet_manager.cc:1434] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:06.054538 1166 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.056398 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_cfb780593d00408c95ded7e5b545f97c [id=c9513d6e491a4250894ed7225db630fe] alter complete (version 2)
I20260503 07:53:06.056478 1166 tablet_bootstrap.cc:654] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.057781 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.065100 750 tablet_service.cc:1511] Processing CreateTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 (DEFAULT_TABLE table=default.Table_b688bb298df944f798eb63e70f407f61 [id=9b5522ae378e43d69d011a65b37891d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.065708 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bfb51a2a01aa4806aedc3a2b76908477 (DEFAULT_TABLE table=default.Table_b688bb298df944f798eb63e70f407f61 [id=9b5522ae378e43d69d011a65b37891d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.066111 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb51a2a01aa4806aedc3a2b76908477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.071131 1166 tablet_bootstrap.cc:492] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.071298 1166 ts_tablet_manager.cc:1403] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260503 07:53:06.071952 1166 raft_consensus.cc:359] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.072160 1166 raft_consensus.cc:385] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.072268 1166 raft_consensus.cc:740] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.072516 1166 consensus_queue.cc:260] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.073040 1166 ts_tablet_manager.cc:1434] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:06.073313 1166 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.074944 1166 tablet_bootstrap.cc:654] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.075351 1165 raft_consensus.cc:359] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.075524 1165 raft_consensus.cc:385] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.075600 1165 raft_consensus.cc:740] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.075829 1165 consensus_queue.cc:260] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.076094 2302 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.076218 2302 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.076363 1165 ts_tablet_manager.cc:1434] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.124s user 0.017s sys 0.009s
I20260503 07:53:06.076795 2302 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.079294 2302 raft_consensus.cc:493] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.079403 2302 raft_consensus.cc:515] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.079525 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:06.079916 2302 leader_election.cc:290] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.080626 1165 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:06.080561 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:06.081082 716 leader_election.cc:343] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:06.081454 715 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.081665 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:06.081700 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:06.082065 1165 tablet_bootstrap.cc:654] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:06.082084 715 leader_election.cc:343] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.082175 715 leader_election.cc:304] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:06.082176 716 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.082580 716 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.082891 2241 raft_consensus.cc:2749] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.083017 2241 raft_consensus.cc:2749] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.089766 1165 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:06.089891 1165 ts_tablet_manager.cc:1403] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260503 07:53:06.090514 1165 raft_consensus.cc:359] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.090656 1165 raft_consensus.cc:385] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.090709 1165 raft_consensus.cc:740] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.090898 1165 consensus_queue.cc:260] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.091310 1165 ts_tablet_manager.cc:1434] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260503 07:53:06.091355 1166 tablet_bootstrap.cc:492] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.091511 1166 ts_tablet_manager.cc:1403] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260503 07:53:06.092152 1166 raft_consensus.cc:359] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.092356 1166 raft_consensus.cc:385] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.092437 1166 raft_consensus.cc:740] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.092669 1166 consensus_queue.cc:260] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.093125 1166 ts_tablet_manager.cc:1434] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:06.093381 1166 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.093411 1165 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:06.094689 1165 tablet_bootstrap.cc:654] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.095521 1166 tablet_bootstrap.cc:654] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.107616 2302 raft_consensus.cc:493] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.107750 2302 raft_consensus.cc:515] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.108480 2302 leader_election.cc:290] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.109171 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.109670 715 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.110140 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:06.110620 716 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.110706 716 leader_election.cc:304] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.111076 2302 raft_consensus.cc:2749] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:06.122246 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 52389.5us
I20260503 07:53:06.122524 986 leader_election.cc:304] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.122763 2113 raft_consensus.cc:2804] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:06.122956 2113 raft_consensus.cc:697] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:06.123035 1171 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.123147 1171 ts_tablet_manager.cc:1403] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.197s user 0.000s sys 0.002s
I20260503 07:53:06.123208 2113 consensus_queue.cc:237] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.123842 1171 raft_consensus.cc:359] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.123986 1171 raft_consensus.cc:385] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.124045 1171 raft_consensus.cc:740] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.124679 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04763bb23b4c0f91df21eb0073095f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.125208 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb51a2a01aa4806aedc3a2b76908477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.127439 2340 raft_consensus.cc:493] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.127573 2340 raft_consensus.cc:515] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.128422 2340 leader_election.cc:290] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:06.130200 851 leader_election.cc:343] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d79067c0c8594d50aa458d47b31d99af
I20260503 07:53:06.142957 1171 consensus_queue.cc:260] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.143421 917 raft_consensus.cc:3060] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:06.143553 1171 ts_tablet_manager.cc:1434] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260503 07:53:06.143818 1171 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.147584 2018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 0) took 4358 ms. Trace:
I20260503 07:53:06.148593 2331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac6a9a921d4741bacf707b8f217874. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:53:06.148841 2331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60 [sys.catalog]: This master's current role is: FOLLOWER
I20260503 07:53:06.150645 886 tablet_service.cc:1511] Processing CreateTablet for tablet 3b10183f49464684acfa54e7d10ccee2 (DEFAULT_TABLE table=default.Table_5d7d792752374a91978feb4f24d63027 [id=87e557beffa241db9faee2a997b86a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.151117 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b10183f49464684acfa54e7d10ccee2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:06.151250 986 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:06.151348 986 leader_election.cc:304] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:06.152314 2113 consensus_queue.cc:1048] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:06.152626 2113 raft_consensus.cc:2749] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.152756 2298 raft_consensus.cc:493] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.152869 2298 raft_consensus.cc:515] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.153344 2298 leader_election.cc:290] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.155977 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:06.156721 2339 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:06.160724 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:06.162750 2082 raft_consensus.cc:2749] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:06.163122 716 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:06.163389 715 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.163487 715 leader_election.cc:304] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.163944 2302 raft_consensus.cc:2749] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.164805 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a5d74281a14f40f09642704e2bf9042a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.165639 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a589c6a2ec3d420c8f18b89e4d67ab25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.166661 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_06bac08106464609a451d7c139e2675c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.168464 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c089f502b5c44a8683680c392d35a8f3" } modify_external_catalogs: true
I20260503 07:53:06.168641 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c089f502b5c44a8683680c392d35a8f3" } modify_external_catalogs: true
I20260503 07:53:06.169975 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_883e0f47ba5442029ef477aeebfecd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.170615 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_38ec270c366e4af089360207052b918a" } modify_external_catalogs: true
I20260503 07:53:06.170784 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_38ec270c366e4af089360207052b918a" } modify_external_catalogs: true
I20260503 07:53:06.171626 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 832) took 1054 ms. Trace:
I20260503 07:53:06.171701 1175 rpcz_store.cc:276] 0503 07:53:05.117198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.120085 (+ 2887us) service_pool.cc:224] Handling call
0503 07:53:06.002368 (+882283us) ts_tablet_manager.cc:1151] Deleting tablet ecc39d127c71412ea867a0b3cad10452
0503 07:53:06.002381 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.023463 (+ 21082us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.034307 (+ 10844us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.171607 (+137300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":861195}
I20260503 07:53:06.171940 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_899ab16c8fbf4137b5e1a2b331af4feb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.172030 1175 tablet_replica.cc:333] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.172240 1175 raft_consensus.cc:2243] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.172518 1175 raft_consensus.cc:2272] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.173000 1175 ts_tablet_manager.cc:1916] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.178736 2365 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260503 07:53:06.178844 1175 ts_tablet_manager.cc:1929] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:06.178992 1175 log.cc:1199] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/2d647277295e42cdb65f45a619e63960
I20260503 07:53:06.179659 1175 ts_tablet_manager.cc:1950] T 2d647277295e42cdb65f45a619e63960 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.147781 2018 rpcz_store.cc:276] 0503 07:53:01.788769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:01.788850 (+ 81us) service_pool.cc:224] Handling call
0503 07:53:05.979303 (+4190453us) raft_consensus.cc:1471] Updating replica for 246 ops
0503 07:53:05.984490 (+ 5187us) raft_consensus.cc:1534] Early marking committed up to index 589
0503 07:53:06.028063 (+ 43573us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:06.028070 (+ 7us) write_op.cc:454] Released schema lock
0503 07:53:06.040300 (+ 12230us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:06.040306 (+ 6us) write_op.cc:454] Released schema lock
0503 07:53:06.044094 (+ 3788us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:06.044100 (+ 6us) write_op.cc:454] Released schema lock
0503 07:53:06.044458 (+ 358us) raft_consensus.cc:1539] Triggering prepare for 246 ops
0503 07:53:06.044781 (+ 323us) write_op.cc:270] Start()
0503 07:53:06.044820 (+ 39us) write_op.cc:276] Timestamp: P: 1777794776704433 usec, L: 0
0503 07:53:06.045054 (+ 234us) write_op.cc:270] Start()
0503 07:53:06.045072 (+ 18us) write_op.cc:276] Timestamp: P: 1777794776727543 usec, L: 0
0503 07:53:06.045190 (+ 118us) write_op.cc:270] Start()
0503 07:53:06.045204 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776735415 usec, L: 0
0503 07:53:06.045319 (+ 115us) write_op.cc:270] Start()
0503 07:53:06.045334 (+ 15us) write_op.cc:276] Timestamp: P: 1777794776781823 usec, L: 0
0503 07:53:06.045456 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.045471 (+ 15us) write_op.cc:276] Timestamp: P: 1777794776786823 usec, L: 0
0503 07:53:06.045601 (+ 130us) write_op.cc:270] Start()
0503 07:53:06.045617 (+ 16us) write_op.cc:276] Timestamp: P: 1777794776795302 usec, L: 0
0503 07:53:06.045728 (+ 111us) write_op.cc:270] Start()
0503 07:53:06.045742 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776796367 usec, L: 0
0503 07:53:06.045844 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.045858 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776798781 usec, L: 0
0503 07:53:06.045967 (+ 109us) write_op.cc:270] Start()
0503 07:53:06.045982 (+ 15us) write_op.cc:276] Timestamp: P: 1777794776814207 usec, L: 0
0503 07:53:06.046073 (+ 91us) write_op.cc:270] Start()
0503 07:53:06.046093 (+ 20us) write_op.cc:276] Timestamp: P: 1777794776820491 usec, L: 0
0503 07:53:06.046203 (+ 110us) write_op.cc:270] Start()
0503 07:53:06.046218 (+ 15us) write_op.cc:276] Timestamp: P: 1777794776822132 usec, L: 0
0503 07:53:06.046313 (+ 95us) write_op.cc:270] Start()
0503 07:53:06.046327 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776823243 usec, L: 0
0503 07:53:06.046412 (+ 85us) write_op.cc:270] Start()
0503 07:53:06.046426 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776824252 usec, L: 0
0503 07:53:06.046531 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.046546 (+ 15us) write_op.cc:276] Timestamp: P: 1777794776949682 usec, L: 0
0503 07:53:06.046645 (+ 99us) write_op.cc:270] Start()
0503 07:53:06.046659 (+ 14us) write_op.cc:276] Timestamp: P: 1777794776950293 usec, L: 0
0503 07:53:06.046745 (+ 86us) write_op.cc:270] Start()
0503 07:53:06.046758 (+ 13us) write_op.cc:276] Timestamp: P: 1777794777023100 usec, L: 0
0503 07:53:06.046855 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.046879 (+ 24us) write_op.cc:276] Timestamp: P: 1777794777023811 usec, L: 0
0503 07:53:06.046981 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.046998 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777024381 usec, L: 0
0503 07:53:06.047110 (+ 112us) write_op.cc:270] Start()
0503 07:53:06.047126 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777032440 usec, L: 0
0503 07:53:06.047225 (+ 99us) write_op.cc:270] Start()
0503 07:53:06.047240 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777047211 usec, L: 0
0503 07:53:06.047334 (+ 94us) write_op.cc:270] Start()
0503 07:53:06.047382 (+ 48us) write_op.cc:276] Timestamp: P: 1777794777058396 usec, L: 0
0503 07:53:06.047498 (+ 116us) write_op.cc:270] Start()
0503 07:53:06.047513 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777083164 usec, L: 0
0503 07:53:06.047620 (+ 107us) write_op.cc:270] Start()
0503 07:53:06.047637 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777083763 usec, L: 0
0503 07:53:06.047739 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.047754 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777119709 usec, L: 0
0503 07:53:06.047955 (+ 201us) write_op.cc:270] Start()
0503 07:53:06.047980 (+ 25us) write_op.cc:276] Timestamp: P: 1777794777120417 usec, L: 0
0503 07:53:06.048109 (+ 129us) write_op.cc:270] Start()
0503 07:53:06.048125 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777121025 usec, L: 0
0503 07:53:06.048248 (+ 123us) write_op.cc:270] Start()
0503 07:53:06.048266 (+ 18us) write_op.cc:276] Timestamp: P: 1777794777121600 usec, L: 0
0503 07:53:06.048386 (+ 120us) write_op.cc:270] Start()
0503 07:53:06.048403 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777123100 usec, L: 0
0503 07:53:06.048506 (+ 103us) write_op.cc:270] Start()
0503 07:53:06.048522 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777125852 usec, L: 0
0503 07:53:06.048614 (+ 92us) write_op.cc:270] Start()
0503 07:53:06.048637 (+ 23us) write_op.cc:276] Timestamp: P: 1777794777133855 usec, L: 0
0503 07:53:06.048760 (+ 123us) write_op.cc:270] Start()
0503 07:53:06.048776 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777219809 usec, L: 0
0503 07:53:06.048905 (+ 129us) write_op.cc:270] Start()
0503 07:53:06.048922 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777222291 usec, L: 0
0503 07:53:06.049073 (+ 151us) write_op.cc:270] Start()
0503 07:53:06.049093 (+ 20us) write_op.cc:276] Timestamp: P: 1777794777231613 usec, L: 0
0503 07:53:06.049246 (+ 153us) write_op.cc:270] Start()
0503 07:53:06.049263 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777232673 usec, L: 0
0503 07:53:06.049376 (+ 113us) write_op.cc:270] Start()
0503 07:53:06.049393 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777258214 usec, L: 0
0503 07:53:06.049502 (+ 109us) write_op.cc:270] Start()
0503 07:53:06.049517 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777260869 usec, L: 0
0503 07:53:06.049661 (+ 144us) write_op.cc:270] Start()
0503 07:53:06.049678 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777266096 usec, L: 0
0503 07:53:06.049857 (+ 179us) write_op.cc:270] Start()
0503 07:53:06.056587 (+ 6730us) write_op.cc:276] Timestamp: P: 1777794777383860 usec, L: 0
0503 07:53:06.056763 (+ 176us) write_op.cc:270] Start()
0503 07:53:06.056780 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777439733 usec, L: 0
0503 07:53:06.056886 (+ 106us) write_op.cc:270] Start()
0503 07:53:06.056900 (+ 14us) write_op.cc:276] Timestamp: P: 1777794777513689 usec, L: 0
0503 07:53:06.056997 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.057011 (+ 14us) write_op.cc:276] Timestamp: P: 1777794777554549 usec, L: 0
0503 07:53:06.057116 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.057133 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777588463 usec, L: 0
0503 07:53:06.057237 (+ 104us) write_op.cc:270] Start()
0503 07:53:06.057252 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777657269 usec, L: 0
0503 07:53:06.057359 (+ 107us) write_op.cc:270] Start()
0503 07:53:06.057376 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777678416 usec, L: 0
0503 07:53:06.057475 (+ 99us) write_op.cc:270] Start()
0503 07:53:06.057490 (+ 15us) write_op.cc:276] Timestamp: P: 1777794777693485 usec, L: 0
0503 07:53:06.057594 (+ 104us) write_op.cc:270] Start()
0503 07:53:06.057610 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777709031 usec, L: 0
0503 07:53:06.060482 (+ 2872us) write_op.cc:270] Start()
0503 07:53:06.060504 (+ 22us) write_op.cc:276] Timestamp: P: 1777794777738330 usec, L: 0
0503 07:53:06.060623 (+ 119us) write_op.cc:270] Start()
0503 07:53:06.060639 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777811978 usec, L: 0
0503 07:53:06.060754 (+ 115us) write_op.cc:270] Start()
0503 07:53:06.060771 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777836054 usec, L: 0
0503 07:53:06.060911 (+ 140us) write_op.cc:270] Start()
0503 07:53:06.060934 (+ 23us) write_op.cc:276] Timestamp: P: 1777794777844918 usec, L: 0
0503 07:53:06.061042 (+ 108us) write_op.cc:270] Start()
0503 07:53:06.061059 (+ 17us) write_op.cc:276] Timestamp: P: 1777794777851793 usec, L: 0
0503 07:53:06.061173 (+ 114us) write_op.cc:270] Start()
0503 07:53:06.061191 (+ 18us) write_op.cc:276] Timestamp: P: 1777794777857485 usec, L: 0
0503 07:53:06.061301 (+ 110us) write_op.cc:270] Start()
0503 07:53:06.061317 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777861653 usec, L: 0
0503 07:53:06.061416 (+ 99us) write_op.cc:270] Start()
0503 07:53:06.061432 (+ 16us) write_op.cc:276] Timestamp: P: 1777794777879255 usec, L: 0
0503 07:53:06.061559 (+ 127us) write_op.cc:270] Start()
0503 07:53:06.061577 (+ 18us) write_op.cc:276] Timestamp: P: 1777794778123338 usec, L: 0
0503 07:53:06.061690 (+ 113us) write_op.cc:270] Start()
0503 07:53:06.061706 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778125103 usec, L: 0
0503 07:53:06.061860 (+ 154us) write_op.cc:270] Start()
0503 07:53:06.061888 (+ 28us) write_op.cc:276] Timestamp: P: 1777794778129894 usec, L: 0
0503 07:53:06.061999 (+ 111us) write_op.cc:270] Start()
0503 07:53:06.062015 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778138619 usec, L: 0
0503 07:53:06.062109 (+ 94us) write_op.cc:270] Start()
0503 07:53:06.062125 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778149078 usec, L: 0
0503 07:53:06.062236 (+ 111us) write_op.cc:270] Start()
0503 07:53:06.062252 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778202825 usec, L: 0
0503 07:53:06.062349 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.062363 (+ 14us) write_op.cc:276] Timestamp: P: 1777794778224674 usec, L: 0
0503 07:53:06.062781 (+ 418us) write_op.cc:270] Start()
0503 07:53:06.062811 (+ 30us) write_op.cc:276] Timestamp: P: 1777794778235491 usec, L: 0
0503 07:53:06.062966 (+ 155us) write_op.cc:270] Start()
0503 07:53:06.062984 (+ 18us) write_op.cc:276] Timestamp: P: 1777794778270329 usec, L: 0
0503 07:53:06.063105 (+ 121us) write_op.cc:270] Start()
0503 07:53:06.063124 (+ 19us) write_op.cc:276] Timestamp: P: 1777794778270957 usec, L: 0
0503 07:53:06.063345 (+ 221us) write_op.cc:270] Start()
0503 07:53:06.063364 (+ 19us) write_op.cc:276] Timestamp: P: 1777794778328898 usec, L: 0
0503 07:53:06.063486 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.063501 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778342914 usec, L: 0
0503 07:53:06.063592 (+ 91us) write_op.cc:270] Start()
0503 07:53:06.063606 (+ 14us) write_op.cc:276] Timestamp: P: 1777794778344024 usec, L: 0
0503 07:53:06.063709 (+ 103us) write_op.cc:270] Start()
0503 07:53:06.063725 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778376032 usec, L: 0
0503 07:53:06.063835 (+ 110us) write_op.cc:270] Start()
0503 07:53:06.063850 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778380689 usec, L: 0
0503 07:53:06.063984 (+ 134us) write_op.cc:270] Start()
0503 07:53:06.064001 (+ 17us) write_op.cc:276] Timestamp: P: 1777794778399781 usec, L: 0
0503 07:53:06.064112 (+ 111us) write_op.cc:270] Start()
0503 07:53:06.064127 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778402669 usec, L: 0
0503 07:53:06.064248 (+ 121us) write_op.cc:270] Start()
0503 07:53:06.064264 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778454812 usec, L: 0
0503 07:53:06.064386 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.064420 (+ 34us) write_op.cc:276] Timestamp: P: 1777794778466143 usec, L: 0
0503 07:53:06.064569 (+ 149us) write_op.cc:270] Start()
0503 07:53:06.064591 (+ 22us) write_op.cc:276] Timestamp: P: 1777794778476330 usec, L: 0
0503 07:53:06.065426 (+ 835us) write_op.cc:270] Start()
0503 07:53:06.065446 (+ 20us) write_op.cc:276] Timestamp: P: 1777794778485556 usec, L: 0
0503 07:53:06.065579 (+ 133us) write_op.cc:270] Start()
0503 07:53:06.065594 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778495131 usec, L: 0
0503 07:53:06.065687 (+ 93us) write_op.cc:270] Start()
0503 07:53:06.065701 (+ 14us) write_op.cc:276] Timestamp: P: 1777794778502981 usec, L: 0
0503 07:53:06.065792 (+ 91us) write_op.cc:270] Start()
0503 07:53:06.065805 (+ 13us) write_op.cc:276] Timestamp: P: 1777794778522739 usec, L: 0
0503 07:53:06.065911 (+ 106us) write_op.cc:270] Start()
0503 07:53:06.065926 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778538137 usec, L: 0
0503 07:53:06.066020 (+ 94us) write_op.cc:270] Start()
0503 07:53:06.066036 (+ 16us) write_op.cc:276] Timestamp: P: 1777794778565621 usec, L: 0
0503 07:53:06.066184 (+ 148us) write_op.cc:270] Start()
0503 07:53:06.066201 (+ 17us) write_op.cc:276] Timestamp: P: 1777794778581059 usec, L: 0
0503 07:53:06.066313 (+ 112us) write_op.cc:270] Start()
0503 07:53:06.066328 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778779594 usec, L: 0
0503 07:53:06.066422 (+ 94us) write_op.cc:270] Start()
0503 07:53:06.066436 (+ 14us) write_op.cc:276] Timestamp: P: 1777794778788010 usec, L: 0
0503 07:53:06.066542 (+ 106us) write_op.cc:270] Start()
0503 07:53:06.066562 (+ 20us) write_op.cc:276] Timestamp: P: 1777794778790456 usec, L: 0
0503 07:53:06.066687 (+ 125us) write_op.cc:270] Start()
0503 07:53:06.066702 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778902769 usec, L: 0
0503 07:53:06.066800 (+ 98us) write_op.cc:270] Start()
0503 07:53:06.066814 (+ 14us) write_op.cc:276] Timestamp: P: 1777794778925248 usec, L: 0
0503 07:53:06.066925 (+ 111us) write_op.cc:270] Start()
0503 07:53:06.066940 (+ 15us) write_op.cc:276] Timestamp: P: 1777794778953400 usec, L: 0
0503 07:53:06.067040 (+ 100us) write_op.cc:270] Start()
0503 07:53:06.067053 (+ 13us) write_op.cc:276] Timestamp: P: 1777794779021561 usec, L: 0
0503 07:53:06.067154 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.067168 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779046095 usec, L: 0
0503 07:53:06.067266 (+ 98us) write_op.cc:270] Start()
0503 07:53:06.067281 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779097838 usec, L: 0
0503 07:53:06.067398 (+ 117us) write_op.cc:270] Start()
0503 07:53:06.067413 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779114007 usec, L: 0
0503 07:53:06.067515 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.067550 (+ 35us) write_op.cc:276] Timestamp: P: 1777794779136421 usec, L: 0
0503 07:53:06.067672 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.067689 (+ 17us) write_op.cc:276] Timestamp: P: 1777794779155393 usec, L: 0
0503 07:53:06.067794 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.067810 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779166443 usec, L: 0
0503 07:53:06.067949 (+ 139us) write_op.cc:270] Start()
0503 07:53:06.067968 (+ 19us) write_op.cc:276] Timestamp: P: 1777794779189657 usec, L: 0
0503 07:53:06.068081 (+ 113us) write_op.cc:270] Start()
0503 07:53:06.068097 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779209379 usec, L: 0
0503 07:53:06.075121 (+ 7024us) write_op.cc:270] Start()
0503 07:53:06.075154 (+ 33us) write_op.cc:276] Timestamp: P: 1777794779234676 usec, L: 0
0503 07:53:06.075373 (+ 219us) write_op.cc:270] Start()
0503 07:53:06.075393 (+ 20us) write_op.cc:276] Timestamp: P: 1777794779286024 usec, L: 0
0503 07:53:06.076586 (+ 1193us) write_op.cc:270] Start()
0503 07:53:06.076612 (+ 26us) write_op.cc:276] Timestamp: P: 1777794779308488 usec, L: 0
0503 07:53:06.076763 (+ 151us) write_op.cc:270] Start()
0503 07:53:06.076781 (+ 18us) write_op.cc:276] Timestamp: P: 1777794779315705 usec, L: 0
0503 07:53:06.076930 (+ 149us) write_op.cc:270] Start()
0503 07:53:06.076948 (+ 18us) write_op.cc:276] Timestamp: P: 1777794779324418 usec, L: 0
0503 07:53:06.077053 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.077069 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779338380 usec, L: 0
0503 07:53:06.077182 (+ 113us) write_op.cc:270] Start()
0503 07:53:06.077198 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779351534 usec, L: 0
0503 07:53:06.077295 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.077310 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779355334 usec, L: 0
0503 07:53:06.077445 (+ 135us) write_op.cc:270] Start()
0503 07:53:06.077460 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779377715 usec, L: 0
0503 07:53:06.077566 (+ 106us) write_op.cc:270] Start()
0503 07:53:06.077583 (+ 17us) write_op.cc:276] Timestamp: P: 1777794779391090 usec, L: 0
0503 07:53:06.077685 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.077700 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779418198 usec, L: 0
0503 07:53:06.077828 (+ 128us) write_op.cc:270] Start()
0503 07:53:06.077846 (+ 18us) write_op.cc:276] Timestamp: P: 1777794779425626 usec, L: 0
0503 07:53:06.077983 (+ 137us) write_op.cc:270] Start()
0503 07:53:06.078002 (+ 19us) write_op.cc:276] Timestamp: P: 1777794779439789 usec, L: 0
0503 07:53:06.078103 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.078117 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779447326 usec, L: 0
0503 07:53:06.078218 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.078232 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779462833 usec, L: 0
0503 07:53:06.078330 (+ 98us) write_op.cc:270] Start()
0503 07:53:06.078344 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779529101 usec, L: 0
0503 07:53:06.078445 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.078459 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779540768 usec, L: 0
0503 07:53:06.078560 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.078574 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779573192 usec, L: 0
0503 07:53:06.078737 (+ 163us) write_op.cc:270] Start()
0503 07:53:06.078752 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779588724 usec, L: 0
0503 07:53:06.078855 (+ 103us) write_op.cc:270] Start()
0503 07:53:06.078881 (+ 26us) write_op.cc:276] Timestamp: P: 1777794779603737 usec, L: 0
0503 07:53:06.079014 (+ 133us) write_op.cc:270] Start()
0503 07:53:06.079029 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779622609 usec, L: 0
0503 07:53:06.079137 (+ 108us) write_op.cc:270] Start()
0503 07:53:06.079172 (+ 35us) write_op.cc:276] Timestamp: P: 1777794779644067 usec, L: 0
0503 07:53:06.080320 (+ 1148us) write_op.cc:270] Start()
0503 07:53:06.080346 (+ 26us) write_op.cc:276] Timestamp: P: 1777794779659687 usec, L: 0
0503 07:53:06.080471 (+ 125us) write_op.cc:270] Start()
0503 07:53:06.080488 (+ 17us) write_op.cc:276] Timestamp: P: 1777794779683092 usec, L: 0
0503 07:53:06.080595 (+ 107us) write_op.cc:270] Start()
0503 07:53:06.080610 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779696958 usec, L: 0
0503 07:53:06.080715 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.080729 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779705288 usec, L: 0
0503 07:53:06.080819 (+ 90us) write_op.cc:270] Start()
0503 07:53:06.080833 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779729337 usec, L: 0
0503 07:53:06.081202 (+ 369us) write_op.cc:270] Start()
0503 07:53:06.081290 (+ 88us) write_op.cc:276] Timestamp: P: 1777794779738949 usec, L: 0
0503 07:53:06.083452 (+ 2162us) write_op.cc:270] Start()
0503 07:53:06.083475 (+ 23us) write_op.cc:276] Timestamp: P: 1777794779749239 usec, L: 0
0503 07:53:06.083623 (+ 148us) write_op.cc:270] Start()
0503 07:53:06.083643 (+ 20us) write_op.cc:276] Timestamp: P: 1777794779755324 usec, L: 0
0503 07:53:06.083790 (+ 147us) write_op.cc:270] Start()
0503 07:53:06.083806 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779772922 usec, L: 0
0503 07:53:06.084055 (+ 249us) write_op.cc:270] Start()
0503 07:53:06.084072 (+ 17us) write_op.cc:276] Timestamp: P: 1777794779803434 usec, L: 0
0503 07:53:06.084299 (+ 227us) write_op.cc:270] Start()
0503 07:53:06.084318 (+ 19us) write_op.cc:276] Timestamp: P: 1777794779815861 usec, L: 0
0503 07:53:06.084468 (+ 150us) write_op.cc:270] Start()
0503 07:53:06.084485 (+ 17us) write_op.cc:276] Timestamp: P: 1777794779819448 usec, L: 0
0503 07:53:06.084586 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.084601 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779835825 usec, L: 0
0503 07:53:06.084703 (+ 102us) write_op.cc:270] Start()
0503 07:53:06.084717 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779850611 usec, L: 0
0503 07:53:06.084810 (+ 93us) write_op.cc:270] Start()
0503 07:53:06.084824 (+ 14us) write_op.cc:276] Timestamp: P: 1777794779858585 usec, L: 0
0503 07:53:06.084945 (+ 121us) write_op.cc:270] Start()
0503 07:53:06.084961 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779866306 usec, L: 0
0503 07:53:06.085087 (+ 126us) write_op.cc:270] Start()
0503 07:53:06.085102 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779867820 usec, L: 0
0503 07:53:06.085217 (+ 115us) write_op.cc:270] Start()
0503 07:53:06.085233 (+ 16us) write_op.cc:276] Timestamp: P: 1777794779868716 usec, L: 0
0503 07:53:06.085321 (+ 88us) write_op.cc:270] Start()
0503 07:53:06.085334 (+ 13us) write_op.cc:276] Timestamp: P: 1777794779901808 usec, L: 0
0503 07:53:06.085422 (+ 88us) write_op.cc:270] Start()
0503 07:53:06.085435 (+ 13us) write_op.cc:276] Timestamp: P: 1777794779954960 usec, L: 0
0503 07:53:06.085539 (+ 104us) write_op.cc:270] Start()
0503 07:53:06.085554 (+ 15us) write_op.cc:276] Timestamp: P: 1777794779955608 usec, L: 0
0503 07:53:06.085638 (+ 84us) write_op.cc:270] Start()
0503 07:53:06.085651 (+ 13us) write_op.cc:276] Timestamp: P: 1777794779956230 usec, L: 0
0503 07:53:06.085746 (+ 95us) write_op.cc:270] Start()
0503 07:53:06.085759 (+ 13us) write_op.cc:276] Timestamp: P: 1777794779956795 usec, L: 0
0503 07:53:06.085840 (+ 81us) write_op.cc:270] Start()
0503 07:53:06.085855 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780016554 usec, L: 0
0503 07:53:06.085959 (+ 104us) write_op.cc:270] Start()
0503 07:53:06.085973 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780017832 usec, L: 0
0503 07:53:06.086065 (+ 92us) write_op.cc:270] Start()
0503 07:53:06.086079 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780019935 usec, L: 0
0503 07:53:06.086164 (+ 85us) write_op.cc:270] Start()
0503 07:53:06.086178 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780020781 usec, L: 0
0503 07:53:06.086279 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.086292 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780021552 usec, L: 0
0503 07:53:06.086389 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.086404 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780023104 usec, L: 0
0503 07:53:06.086494 (+ 90us) write_op.cc:270] Start()
0503 07:53:06.086507 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780030360 usec, L: 0
0503 07:53:06.086620 (+ 113us) write_op.cc:270] Start()
0503 07:53:06.086634 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780031223 usec, L: 0
0503 07:53:06.086722 (+ 88us) write_op.cc:270] Start()
0503 07:53:06.086736 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780032019 usec, L: 0
0503 07:53:06.086879 (+ 143us) write_op.cc:270] Start()
0503 07:53:06.086897 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780032842 usec, L: 0
0503 07:53:06.087018 (+ 121us) write_op.cc:270] Start()
0503 07:53:06.087033 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780060314 usec, L: 0
0503 07:53:06.087147 (+ 114us) write_op.cc:270] Start()
0503 07:53:06.087172 (+ 25us) write_op.cc:276] Timestamp: P: 1777794780067456 usec, L: 0
0503 07:53:06.087269 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.087284 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780068482 usec, L: 0
0503 07:53:06.087373 (+ 89us) write_op.cc:270] Start()
0503 07:53:06.087387 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780069430 usec, L: 0
0503 07:53:06.087472 (+ 85us) write_op.cc:270] Start()
0503 07:53:06.087485 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780203944 usec, L: 0
0503 07:53:06.087572 (+ 87us) write_op.cc:270] Start()
0503 07:53:06.087586 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780205510 usec, L: 0
0503 07:53:06.094113 (+ 6527us) write_op.cc:270] Start()
0503 07:53:06.094142 (+ 29us) write_op.cc:276] Timestamp: P: 1777794780206048 usec, L: 0
0503 07:53:06.094306 (+ 164us) write_op.cc:270] Start()
0503 07:53:06.094331 (+ 25us) write_op.cc:276] Timestamp: P: 1777794780206513 usec, L: 0
0503 07:53:06.094466 (+ 135us) write_op.cc:270] Start()
0503 07:53:06.094484 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780208457 usec, L: 0
0503 07:53:06.094606 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.094688 (+ 82us) write_op.cc:276] Timestamp: P: 1777794780212632 usec, L: 0
0503 07:53:06.094986 (+ 298us) write_op.cc:270] Start()
0503 07:53:06.095008 (+ 22us) write_op.cc:276] Timestamp: P: 1777794780225460 usec, L: 0
0503 07:53:06.095146 (+ 138us) write_op.cc:270] Start()
0503 07:53:06.095217 (+ 71us) write_op.cc:276] Timestamp: P: 1777794780309244 usec, L: 0
0503 07:53:06.095342 (+ 125us) write_op.cc:270] Start()
0503 07:53:06.095360 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780310884 usec, L: 0
0503 07:53:06.095523 (+ 163us) write_op.cc:270] Start()
0503 07:53:06.095550 (+ 27us) write_op.cc:276] Timestamp: P: 1777794780336396 usec, L: 0
0503 07:53:06.095793 (+ 243us) write_op.cc:270] Start()
0503 07:53:06.095821 (+ 28us) write_op.cc:276] Timestamp: P: 1777794780352297 usec, L: 0
0503 07:53:06.095982 (+ 161us) write_op.cc:270] Start()
0503 07:53:06.096007 (+ 25us) write_op.cc:276] Timestamp: P: 1777794780364241 usec, L: 0
0503 07:53:06.096136 (+ 129us) write_op.cc:270] Start()
0503 07:53:06.096152 (+ 16us) write_op.cc:276] Timestamp: P: 1777794780409710 usec, L: 0
0503 07:53:06.096291 (+ 139us) write_op.cc:270] Start()
0503 07:53:06.096311 (+ 20us) write_op.cc:276] Timestamp: P: 1777794780421173 usec, L: 0
0503 07:53:06.096456 (+ 145us) write_op.cc:270] Start()
0503 07:53:06.096473 (+ 17us) write_op.cc:276] Timestamp: P: 1777794780427249 usec, L: 0
0503 07:53:06.096595 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.096611 (+ 16us) write_op.cc:276] Timestamp: P: 1777794780427977 usec, L: 0
0503 07:53:06.096698 (+ 87us) write_op.cc:270] Start()
0503 07:53:06.096711 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780428744 usec, L: 0
0503 07:53:06.096808 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.096822 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780440977 usec, L: 0
0503 07:53:06.096928 (+ 106us) write_op.cc:270] Start()
0503 07:53:06.096942 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780484166 usec, L: 0
0503 07:53:06.097037 (+ 95us) write_op.cc:270] Start()
0503 07:53:06.097050 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780486268 usec, L: 0
0503 07:53:06.097155 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.097169 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780490587 usec, L: 0
0503 07:53:06.097274 (+ 105us) write_op.cc:270] Start()
0503 07:53:06.097294 (+ 20us) write_op.cc:276] Timestamp: P: 1777794780491450 usec, L: 0
0503 07:53:06.097408 (+ 114us) write_op.cc:270] Start()
0503 07:53:06.097426 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780496962 usec, L: 0
0503 07:53:06.097524 (+ 98us) write_op.cc:270] Start()
0503 07:53:06.097538 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780524164 usec, L: 0
0503 07:53:06.097630 (+ 92us) write_op.cc:270] Start()
0503 07:53:06.097644 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780524750 usec, L: 0
0503 07:53:06.097736 (+ 92us) write_op.cc:270] Start()
0503 07:53:06.097750 (+ 14us) write_op.cc:276] Timestamp: P: 1777794780525316 usec, L: 0
0503 07:53:06.097850 (+ 100us) write_op.cc:270] Start()
0503 07:53:06.097871 (+ 21us) write_op.cc:276] Timestamp: P: 1777794780533587 usec, L: 0
0503 07:53:06.097964 (+ 93us) write_op.cc:270] Start()
0503 07:53:06.097977 (+ 13us) write_op.cc:276] Timestamp: P: 1777794780534123 usec, L: 0
0503 07:53:06.098067 (+ 90us) write_op.cc:270] Start()
0503 07:53:06.098083 (+ 16us) write_op.cc:276] Timestamp: P: 1777794780534622 usec, L: 0
0503 07:53:06.098206 (+ 123us) write_op.cc:270] Start()
0503 07:53:06.098221 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780552199 usec, L: 0
0503 07:53:06.098318 (+ 97us) write_op.cc:270] Start()
0503 07:53:06.098334 (+ 16us) write_op.cc:276] Timestamp: P: 1777794780552822 usec, L: 0
0503 07:53:06.098435 (+ 101us) write_op.cc:270] Start()
0503 07:53:06.098450 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780556605 usec, L: 0
0503 07:53:06.098568 (+ 118us) write_op.cc:270] Start()
0503 07:53:06.098583 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780559623 usec, L: 0
0503 07:53:06.098682 (+ 99us) write_op.cc:270] Start()
0503 07:53:06.098697 (+ 15us) write_op.cc:276] Timestamp: P: 1777794780602242 usec, L: 0
0503 07:53:06.098800 (+ 103us) write_op.cc:270] Start()
0503 07:53:06.098818 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780605307 usec, L: 0
0503 07:53:06.098969 (+ 151us) write_op.cc:270] Start()
0503 07:53:06.098986 (+ 17us) write_op.cc:276] Timestamp: P: 1777794780622297 usec, L: 0
0503 07:53:06.099114 (+ 128us) write_op.cc:270] Start()
0503 07:53:06.099131 (+ 17us) write_op.cc:276] Timestamp: P: 1777794780637534 usec, L: 0
0503 07:53:06.099250 (+ 119us) write_op.cc:270] Start()
0503 07:53:06.099268 (+ 18us) write_op.cc:276] Timestamp: P: 1777794780648970 usec, L: 0
0503 07:53:06.099390 (+ 122us) write_op.cc:270] Start()
0503 07:53:06.099407 (+ 17u
W20260503 07:53:06.181874 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06bac08106464609a451d7c139e2675c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.174268 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ecc39d127c71412ea867a0b3cad10452 (table default.Table_63d40973d4274e249dabcfbeb69433aa [id=9290461419df4394a2c203b5ca8992eb]) successfully deleted
I20260503 07:53:06.183269 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]) successfully deleted
W20260503 07:53:06.183516 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 05134e2081544b5fb7694d63265b047b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05134e2081544b5fb7694d63265b047b already in progress: creating tablet
W20260503 07:53:06.183679 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 314618c911b148d48e4651a100d66fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314618c911b148d48e4651a100d66fae already in progress: creating tablet
W20260503 07:53:06.183876 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 84d1372ba462479db6cf9e865c104df4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d1372ba462479db6cf9e865c104df4 already in progress: creating tablet
W20260503 07:53:06.184062 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c51fe76096684794aac4f5f65c8de1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51fe76096684794aac4f5f65c8de1b5 already in progress: creating tablet
W20260503 07:53:06.184324 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_899ab16c8fbf4137b5e1a2b331af4feb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:06.184450 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 99e681a9fdf64f42a947b2cbc6b47b7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99e681a9fdf64f42a947b2cbc6b47b7b already in progress: creating tablet
I20260503 07:53:06.184580 1175 tablet_replica.cc:333] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:53:06.184711 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ae3fcb4d83f64f6182a78a1a02da39d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3fcb4d83f64f6182a78a1a02da39d6 already in progress: creating tablet
I20260503 07:53:06.184824 1175 raft_consensus.cc:2243] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.185107 1175 pending_rounds.cc:70] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:06.185154 1175 pending_rounds.cc:77] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847439163318272 op_type: NO_OP noop_request { }
I20260503 07:53:06.185256 1175 raft_consensus.cc:2889] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.185355 1175 raft_consensus.cc:2272] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.185557 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
W20260503 07:53:06.185665 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a589c6a2ec3d420c8f18b89e4d67ab25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.186003 1175 ts_tablet_manager.cc:1916] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:06.186698 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_883e0f47ba5442029ef477aeebfecd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.186826 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_faabda34589444c8bb45450d25e35376" } modify_external_catalogs: true
I20260503 07:53:06.187043 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_faabda34589444c8bb45450d25e35376" } modify_external_catalogs: true
W20260503 07:53:06.187786 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5d74281a14f40f09642704e2bf9042a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.190004 886 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24841bbd374cdbb8ca4ea671f712bf (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.190372 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24841bbd374cdbb8ca4ea671f712bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.192500 1175 ts_tablet_manager.cc:1929] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.192602 1175 log.cc:1199] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:06.193044 1175 ts_tablet_manager.cc:1950] T 296541e4c2fc4bc193d6f4cee8e65da0 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.194205 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 296541e4c2fc4bc193d6f4cee8e65da0 (table default.Table_08672a5853854c39b2aae8d52960f924 [id=8b97a76fa5184501849d21b058e53609]) successfully deleted
W20260503 07:53:06.197130 854 leader_election.cc:343] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d79067c0c8594d50aa458d47b31d99af
I20260503 07:53:06.197255 854 leader_election.cc:304] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:06.197590 2082 raft_consensus.cc:2749] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.199159 1175 tablet_replica.cc:333] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.199426 1175 raft_consensus.cc:2243] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.199630 1175 raft_consensus.cc:2272] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.201402 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8c25addae8c94554a83344f07a11362f
I20260503 07:53:06.201524 1175 ts_tablet_manager.cc:1916] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.203554 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 79d43ae066e6411896c490f7c0b11180 (table default.Table_66b153f206f74219a6cd3b0b8ecfa6be [id=02296eaf13b0418ea0c47dfc4eeeb22c]). Expected version 2 got 0
I20260503 07:53:06.204864 1174 ts_tablet_manager.cc:1929] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:06.204903 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c25addae8c94554a83344f07a11362f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.204974 1174 log.cc:1199] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1e2546e95e0f40ad99f1ba6bc512debe
I20260503 07:53:06.205245 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24841bbd374cdbb8ca4ea671f712bf (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.205622 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24841bbd374cdbb8ca4ea671f712bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.205701 885 tablet_service.cc:1511] Processing CreateTablet for tablet c5381f4bb30249caa1d949d2ea9373a5 (DEFAULT_TABLE table=default.Table_aae3fb5443b64b1da5ca0c0d69dc2b7b [id=8501c1d537514929bfc9369364693f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.206065 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5381f4bb30249caa1d949d2ea9373a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.208030 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c4f85848e3ad467a98b34e314c4c0ac9
I20260503 07:53:06.210906 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.211243 879 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.212316 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f85848e3ad467a98b34e314c4c0ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.212504 746 tablet_service.cc:1511] Processing CreateTablet for tablet c5381f4bb30249caa1d949d2ea9373a5 (DEFAULT_TABLE table=default.Table_aae3fb5443b64b1da5ca0c0d69dc2b7b [id=8501c1d537514929bfc9369364693f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.212882 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5381f4bb30249caa1d949d2ea9373a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.212522 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c25addae8c94554a83344f07a11362f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:06.216912 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c4f85848e3ad467a98b34e314c4c0ac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4f85848e3ad467a98b34e314c4c0ac9 already in progress: creating tablet
I20260503 07:53:06.217497 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.217499 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.219151 1175 ts_tablet_manager.cc:1929] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.220307 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50bfa1d81ea94efeac3e4c3680bd4406" } new_table_name: "default.Table_c5fdbeaed33b49deb1ec020c18ae97b8" modify_external_catalogs: true
I20260503 07:53:06.221856 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d" } modify_external_catalogs: true
I20260503 07:53:06.222038 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_147ac7ed7ee64dbeabd0c6f4cdd4905d" } modify_external_catalogs: true
I20260503 07:53:06.222225 1175 log.cc:1199] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/057b62a991b74c859045a74df7dc716f
I20260503 07:53:06.222476 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c25addae8c94554a83344f07a11362f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.222625 1175 ts_tablet_manager.cc:1950] T 057b62a991b74c859045a74df7dc716f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:06.223016 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8c25addae8c94554a83344f07a11362f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c25addae8c94554a83344f07a11362f already in progress: creating tablet
I20260503 07:53:06.223333 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4137d4cf080d4f6ab4ae2d20453ccb5d" } modify_external_catalogs: true
I20260503 07:53:06.223500 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4137d4cf080d4f6ab4ae2d20453ccb5d" } modify_external_catalogs: true
I20260503 07:53:06.223754 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 057b62a991b74c859045a74df7dc716f (table default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81 [id=cab292402d754907b98a0e395457ce95]) successfully deleted
I20260503 07:53:06.225520 1175 tablet_replica.cc:333] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.225979 1175 raft_consensus.cc:2243] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.226824 1175 pending_rounds.cc:70] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:06.227069 1175 pending_rounds.cc:77] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847439176626176 op_type: NO_OP noop_request { }
I20260503 07:53:06.227356 1175 raft_consensus.cc:2889] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.227586 1175 raft_consensus.cc:2272] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.227741 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3b10183f49464684acfa54e7d10ccee2 (DEFAULT_TABLE table=default.Table_5d7d792752374a91978feb4f24d63027 [id=87e557beffa241db9faee2a997b86a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.228253 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b10183f49464684acfa54e7d10ccee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.228312 1175 ts_tablet_manager.cc:1916] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.232650 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24841bbd374cdbb8ca4ea671f712bf (DEFAULT_TABLE table=default.Table_7a18e996eff14728ba6aeb72590c4f6c [id=bb5ca85199f447d8b6fe3e64b52d3d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.233017 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24841bbd374cdbb8ca4ea671f712bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.233006 2339 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.237047 1175 ts_tablet_manager.cc:1929] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.243265 1175 log.cc:1199] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5a178957514e4f77afe8a1879b57a96b
W20260503 07:53:06.244206 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 057b62a991b74c859045a74df7dc716f (table default.Table_4fa6cbd604e74daab5b3eccbbdf5cb81 [id=cab292402d754907b98a0e395457ce95], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 057b62a991b74c859045a74df7dc716f consensus state has no leader
I20260503 07:53:06.244808 1175 ts_tablet_manager.cc:1950] T 5a178957514e4f77afe8a1879b57a96b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.246165 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5a178957514e4f77afe8a1879b57a96b (table default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]) successfully deleted
I20260503 07:53:06.246830 1952 raft_consensus.cc:493] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.247031 1952 raft_consensus.cc:515] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.247329 1175 tablet_replica.cc:333] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.247790 1175 raft_consensus.cc:2243] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.248134 1952 leader_election.cc:290] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.248260 1175 raft_consensus.cc:2272] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.248893 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.249372 988 leader_election.cc:343] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.249902 1175 ts_tablet_manager.cc:1916] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.252669 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:06.252848 775 raft_consensus.cc:2468] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:06.255378 1174 ts_tablet_manager.cc:1950] T 1e2546e95e0f40ad99f1ba6bc512debe P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.255651 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 805) took 1143 ms. Trace:
I20260503 07:53:06.255726 1174 rpcz_store.cc:276] 0503 07:53:05.112472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.112521 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:05.794126 (+681605us) ts_tablet_manager.cc:1151] Deleting tablet 1e2546e95e0f40ad99f1ba6bc512debe
0503 07:53:05.794132 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:05.946020 (+151888us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.204785 (+258765us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.255637 (+ 50852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":681378}
I20260503 07:53:06.256129 1174 tablet_replica.cc:333] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:06.256271 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1e2546e95e0f40ad99f1ba6bc512debe (table default.Table_42152ea98fcc4c7197cbc65c60e0a583 [id=86c390e37de0437eb62b1643d194d66a]) successfully deleted
I20260503 07:53:06.256317 1174 raft_consensus.cc:2243] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.256443 1174 raft_consensus.cc:2272] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.257026 1174 ts_tablet_manager.cc:1916] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.254977 986 leader_election.cc:304] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.228504 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3b10183f49464684acfa54e7d10ccee2 (DEFAULT_TABLE table=default.Table_5d7d792752374a91978feb4f24d63027 [id=87e557beffa241db9faee2a997b86a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.259353 1952 raft_consensus.cc:2804] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:06.259518 1952 raft_consensus.cc:493] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:06.259667 1952 raft_consensus.cc:3060] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:06.259416 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b10183f49464684acfa54e7d10ccee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.262892 1952 raft_consensus.cc:515] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.241096 1970 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" instance_seqno: 1777794766364633) as {username='slave'} at 127.0.105.2:51389; Asking this server to re-register.
I20260503 07:53:06.269109 1018 tablet_service.cc:1511] Processing CreateTablet for tablet c5381f4bb30249caa1d949d2ea9373a5 (DEFAULT_TABLE table=default.Table_aae3fb5443b64b1da5ca0c0d69dc2b7b [id=8501c1d537514929bfc9369364693f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.269522 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5381f4bb30249caa1d949d2ea9373a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.269759 886 tablet_service.cc:1511] Processing CreateTablet for tablet 29947cfc9c2846618a638e6eaffec4db (DEFAULT_TABLE table=default.Table_6b0bee23865249f0bc429e16e7d35228 [id=a4ed1b517b73415aae40445662c0140b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.270205 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29947cfc9c2846618a638e6eaffec4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.292752 2370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:53:06.293128 2370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:53:06.293577 964 heartbeater.cc:461] Registering TS with master...
I20260503 07:53:06.296844 747 tablet_service.cc:1511] Processing CreateTablet for tablet 29947cfc9c2846618a638e6eaffec4db (DEFAULT_TABLE table=default.Table_6b0bee23865249f0bc429e16e7d35228 [id=a4ed1b517b73415aae40445662c0140b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.297246 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29947cfc9c2846618a638e6eaffec4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.297674 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 29947cfc9c2846618a638e6eaffec4db (DEFAULT_TABLE table=default.Table_6b0bee23865249f0bc429e16e7d35228 [id=a4ed1b517b73415aae40445662c0140b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.298120 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29947cfc9c2846618a638e6eaffec4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.299515 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c8e1c96c4955484c99afd98d2644b37a (DEFAULT_TABLE table=default.Table_e7ee98eb4e1c43d6b75dffac36f9c655 [id=fe4909e624004f2689342df4759b7cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.299855 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e1c96c4955484c99afd98d2644b37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.300608 746 tablet_service.cc:1511] Processing CreateTablet for tablet 5539e279bb1446a5b3ee8d46b2dd2fff (DEFAULT_TABLE table=default.Table_5611ce645f574985a095ac13de58a29c [id=fd75dc8bff114b16a60bed03042debdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.300572 750 tablet_service.cc:1511] Processing CreateTablet for tablet c8e1c96c4955484c99afd98d2644b37a (DEFAULT_TABLE table=default.Table_e7ee98eb4e1c43d6b75dffac36f9c655 [id=fe4909e624004f2689342df4759b7cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.300853 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 5539e279bb1446a5b3ee8d46b2dd2fff (DEFAULT_TABLE table=default.Table_5611ce645f574985a095ac13de58a29c [id=fd75dc8bff114b16a60bed03042debdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.301091 885 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2d4290d3c4cf7accb98c5a7b37c61 (DEFAULT_TABLE table=default.Table_50b786a031ce462fae095812adaa3bd2 [id=0154d95d181b40ef89acf585cced2baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.301239 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5539e279bb1446a5b3ee8d46b2dd2fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.302006 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2d4290d3c4cf7accb98c5a7b37c61. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:06.304078 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 consensus state has no leader
I20260503 07:53:06.305204 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_76d0c5a78ae24f419d73eabf93174885" } new_table_name: "default.Table_a6a85043cd814a5d8d17300cc43be157" modify_external_catalogs: true
I20260503 07:53:06.306056 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 46dd100e06ff41be960b265b52d1c607
I20260503 07:53:06.307108 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dd100e06ff41be960b265b52d1c607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.308113 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f53a37806e414f16aa69294c0abad10a
I20260503 07:53:06.308408 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2b1eb7f4d0314a60ae7e6344e834bc9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.309687 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e1c96c4955484c99afd98d2644b37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.310283 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5539e279bb1446a5b3ee8d46b2dd2fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.321174 886 tablet_service.cc:1511] Processing CreateTablet for tablet 5539e279bb1446a5b3ee8d46b2dd2fff (DEFAULT_TABLE table=default.Table_5611ce645f574985a095ac13de58a29c [id=fd75dc8bff114b16a60bed03042debdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.321384 1952 leader_election.cc:290] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.324550 891 tablet_service.cc:1511] Processing CreateTablet for tablet c8e1c96c4955484c99afd98d2644b37a (DEFAULT_TABLE table=default.Table_e7ee98eb4e1c43d6b75dffac36f9c655 [id=fe4909e624004f2689342df4759b7cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.324906 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e1c96c4955484c99afd98d2644b37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.325943 1175 ts_tablet_manager.cc:1929] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.326108 1175 log.cc:1199] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:06.326447 1175 ts_tablet_manager.cc:1950] T cac435b09639484ca1ae82f3d4990d48 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.327467 1175 tablet_replica.cc:333] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.327701 1175 raft_consensus.cc:2243] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.329515 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:06.329679 779 raft_consensus.cc:3060] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:06.330706 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 46dd100e06ff41be960b265b52d1c607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dd100e06ff41be960b265b52d1c607 already in progress: creating tablet
I20260503 07:53:06.332086 779 raft_consensus.cc:2468] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:06.340592 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:06.342908 2298 raft_consensus.cc:493] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.343034 2298 raft_consensus.cc:515] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.343617 2298 leader_election.cc:290] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.344551 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.345005 715 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.346752 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dd100e06ff41be960b265b52d1c607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:06.347325 988 leader_election.cc:343] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.347353 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:06.347949 986 leader_election.cc:304] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:06.347882 716 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.348224 716 leader_election.cc:304] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.348547 1952 raft_consensus.cc:2804] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:06.348568 2298 raft_consensus.cc:2749] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.348686 1952 raft_consensus.cc:697] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:06.347276 747 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2d4290d3c4cf7accb98c5a7b37c61 (DEFAULT_TABLE table=default.Table_50b786a031ce462fae095812adaa3bd2 [id=0154d95d181b40ef89acf585cced2baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.348989 1952 consensus_queue.cc:237] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.349310 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2d4290d3c4cf7accb98c5a7b37c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.350862 2298 raft_consensus.cc:493] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.351001 2298 raft_consensus.cc:515] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.351673 2298 leader_election.cc:290] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.352054 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:06.352296 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.352502 716 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:06.353358 715 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.353468 715 leader_election.cc:304] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.354256 2298 raft_consensus.cc:2749] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.356470 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_01422e8139cf4d4581613f562e50fef7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.356722 1175 pending_rounds.cc:70] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:06.356786 1175 pending_rounds.cc:77] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847443962798080 op_type: NO_OP noop_request { }
I20260503 07:53:06.356901 1175 raft_consensus.cc:2889] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.356997 1175 raft_consensus.cc:2272] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.358430 598 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:06.360021 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_259dfd3e0f54418c84a01d011786ebdb" } new_table_name: "default.Table_0699c531f06940a28824fa3f5a425d6f" modify_external_catalogs: true
I20260503 07:53:06.361253 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_861f3d34a3e747718e7261ddd3bc305e" } new_table_name: "default.Table_61bc32391d74447fa02d4f0cbc148296" modify_external_catalogs: true
I20260503 07:53:06.361379 750 tablet_service.cc:1511] Processing CreateTablet for tablet 618b2435a77741cd8bb18c4b703ce147 (DEFAULT_TABLE table=default.Table_e6b7a14031ca41a7ace939e8001d3ba1 [id=219bab0f545b47aa9de368736b948449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.361729 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b2435a77741cd8bb18c4b703ce147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.362504 759 tablet_service.cc:1511] Processing CreateTablet for tablet c7dcf2ca392e43528c164c5372cf4c78 (DEFAULT_TABLE table=default.Table_ded7810841684e97ba79192f06d51bff [id=228e38336d7c4c1c9dd92ec4aa775bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.362836 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dcf2ca392e43528c164c5372cf4c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.363009 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1905c11361bb445bb54ef394b76bbefe (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.363301 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1905c11361bb445bb54ef394b76bbefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.364251 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet cac435b09639484ca1ae82f3d4990d48 (table default.Table_ea3cc36f50214961844fbc9f28877922 [id=cda676ee3d634f52aeefda3c2680f941]) successfully deleted
W20260503 07:53:06.364384 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ae4a39d4e3a42db816e592123a6a2e7 consensus state has no leader
I20260503 07:53:06.365214 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_99757e618a1549339090f9e61d587367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.365309 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c7dcf2ca392e43528c164c5372cf4c78 (DEFAULT_TABLE table=default.Table_ded7810841684e97ba79192f06d51bff [id=228e38336d7c4c1c9dd92ec4aa775bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.365656 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dcf2ca392e43528c164c5372cf4c78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:06.365707 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99757e618a1549339090f9e61d587367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.367894 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6d5297af28e8453cae39dae2ca4b7584" } new_table_name: "default.Table_f481b7a1d80f4d70b7f976e55e0c3c83" modify_external_catalogs: true
I20260503 07:53:06.368974 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dd100e06ff41be960b265b52d1c607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.369277 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 5cfbfc18284c4d7385c7d0e9ea1a42f2 (table default.Table_7b98fead8af7440bb08aa42b8af00167 [id=2eaba4e8d05245a6bc3e02fad14314d9]). Expected version 3 got 0
I20260503 07:53:06.370019 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cc5cbe88c43e4ca292006ad1c3a8559b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.370183 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c25b29188224fbe98ee8c6f6b7b956b consensus state has no leader
I20260503 07:53:06.370322 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 618b2435a77741cd8bb18c4b703ce147 (DEFAULT_TABLE table=default.Table_e6b7a14031ca41a7ace939e8001d3ba1 [id=219bab0f545b47aa9de368736b948449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.371023 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b2435a77741cd8bb18c4b703ce147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.373247 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2d4290d3c4cf7accb98c5a7b37c61 (DEFAULT_TABLE table=default.Table_50b786a031ce462fae095812adaa3bd2 [id=0154d95d181b40ef89acf585cced2baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.373947 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2d4290d3c4cf7accb98c5a7b37c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.378556 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet f53a37806e414f16aa69294c0abad10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.379848 1175 ts_tablet_manager.cc:1916] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:06.384310 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc5cbe88c43e4ca292006ad1c3a8559b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.385865 1171 tablet_bootstrap.cc:654] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.388410 746 tablet_service.cc:1558] Processing DeleteTablet for tablet f53a37806e414f16aa69294c0abad10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.388463 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c63f9158079846f0870332b154d4ec1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.389225 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c63f9158079846f0870332b154d4ec1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:06.391762 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b07f68090a746a685b088c54c84d5f8 has no consensus state
I20260503 07:53:06.391844 1166 tablet_bootstrap.cc:492] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.391971 1166 ts_tablet_manager.cc:1403] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.299s user 0.046s sys 0.058s
I20260503 07:53:06.392724 1166 raft_consensus.cc:359] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.392894 1166 raft_consensus.cc:385] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.392949 1166 raft_consensus.cc:740] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.393113 1166 consensus_queue.cc:260] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.395942 600 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 104e0ef4b72047608d32809af4720e25
I20260503 07:53:06.400723 2330 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.401084 2281 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.404497 1174 ts_tablet_manager.cc:1929] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.404631 1174 log.cc:1199] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:06.404937 1174 ts_tablet_manager.cc:1950] T cc7a0272fdc34044af78ba21b6ca31bc P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.405354 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 1905c11361bb445bb54ef394b76bbefe (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.405723 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1905c11361bb445bb54ef394b76bbefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.407052 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 1bf42130a55744429d2c64ed55671507 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:06.407091 1166 ts_tablet_manager.cc:1434] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260503 07:53:06.407357 1166 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.408792 1166 tablet_bootstrap.cc:654] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.409049 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 807) took 1295 ms. Trace:
I20260503 07:53:06.409123 1174 rpcz_store.cc:276] 0503 07:53:05.113410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.113454 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:06.256088 (+1142634us) ts_tablet_manager.cc:1151] Deleting tablet cc7a0272fdc34044af78ba21b6ca31bc
0503 07:53:06.256096 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.333867 (+ 77771us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.398216 (+ 64349us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.409031 (+ 10815us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1142423}
I20260503 07:53:06.409412 1174 tablet_replica.cc:333] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:06.409577 1174 raft_consensus.cc:2243] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.409699 1174 pending_rounds.cc:70] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:06.409737 1174 pending_rounds.cc:77] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847439163318272 op_type: NO_OP noop_request { }
I20260503 07:53:06.409814 1174 raft_consensus.cc:2889] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.409909 1174 raft_consensus.cc:2272] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.410521 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:06.417066 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet cc7a0272fdc34044af78ba21b6ca31bc (table default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]) successfully deleted
W20260503 07:53:06.417694 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01422e8139cf4d4581613f562e50fef7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.418078 1174 ts_tablet_manager.cc:1916] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.421396 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ff1d642f7a1246b0854a16320e21497c" } modify_external_catalogs: true
W20260503 07:53:06.421636 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b1eb7f4d0314a60ae7e6344e834bc9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.421918 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ff1d642f7a1246b0854a16320e21497c" } modify_external_catalogs: true
I20260503 07:53:06.427320 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6c6fb8982f384ff7ac013f3de178378a" } modify_external_catalogs: true
I20260503 07:53:06.427474 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6c6fb8982f384ff7ac013f3de178378a" } modify_external_catalogs: true
I20260503 07:53:06.430253 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9c04763bb23b4c0f91df21eb0073095f
I20260503 07:53:06.431424 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c04763bb23b4c0f91df21eb0073095f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.431537 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_f481b7a1d80f4d70b7f976e55e0c3c83 [id=ff32cf0130ba49fbbe5d93a0507bdc80] alter complete (version 2)
I20260503 07:53:06.435673 750 tablet_service.cc:1511] Processing CreateTablet for tablet e406696afe614172a95fd7bab7b326f5 (DEFAULT_TABLE table=default.Table_3e37bc65d9d14a65a78bde18730ebace [id=f03d3593979340df9bc15b39af0441d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.436203 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e406696afe614172a95fd7bab7b326f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.437842 1165 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:06.437989 1165 ts_tablet_manager.cc:1403] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.345s user 0.011s sys 0.037s
I20260503 07:53:06.438622 1165 raft_consensus.cc:359] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.438797 1165 raft_consensus.cc:385] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.438881 1165 raft_consensus.cc:740] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.439095 1165 consensus_queue.cc:260] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.439438 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 36b6147bab7a44b19b4a22addf68961f
I20260503 07:53:06.439590 1165 ts_tablet_manager.cc:1434] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:06.439924 1165 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:06.441224 1166 tablet_bootstrap.cc:492] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.441568 885 tablet_service.cc:1511] Processing CreateTablet for tablet 618b2435a77741cd8bb18c4b703ce147 (DEFAULT_TABLE table=default.Table_e6b7a14031ca41a7ace939e8001d3ba1 [id=219bab0f545b47aa9de368736b948449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.441743 879 tablet_service.cc:1511] Processing CreateTablet for tablet c7dcf2ca392e43528c164c5372cf4c78 (DEFAULT_TABLE table=default.Table_ded7810841684e97ba79192f06d51bff [id=228e38336d7c4c1c9dd92ec4aa775bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.441920 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618b2435a77741cd8bb18c4b703ce147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.442077 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dcf2ca392e43528c164c5372cf4c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.444300 1174 ts_tablet_manager.cc:1929] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.444438 1174 log.cc:1199] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:06.444907 1174 ts_tablet_manager.cc:1950] T 296541e4c2fc4bc193d6f4cee8e65da0 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.445779 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 808) took 1332 ms. Trace:
I20260503 07:53:06.445906 1174 rpcz_store.cc:276] 0503 07:53:05.113652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.115633 (+ 1981us) service_pool.cc:224] Handling call
0503 07:53:06.409371 (+1293738us) ts_tablet_manager.cc:1151] Deleting tablet 296541e4c2fc4bc193d6f4cee8e65da0
0503 07:53:06.409380 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.441525 (+ 32145us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.444258 (+ 2733us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.445763 (+ 1505us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293493}
I20260503 07:53:06.446467 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 296541e4c2fc4bc193d6f4cee8e65da0 (table default.Table_08672a5853854c39b2aae8d52960f924 [id=8b97a76fa5184501849d21b058e53609]) successfully deleted
I20260503 07:53:06.447837 891 tablet_service.cc:1558] Processing DeleteTablet for tablet f53a37806e414f16aa69294c0abad10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.446383 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b6147bab7a44b19b4a22addf68961f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.449167 879 tablet_service.cc:1558] Processing DeleteTablet for tablet d79067c0c8594d50aa458d47b31d99af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.449415 1173 tablet_replica.cc:333] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.449590 1173 raft_consensus.cc:2243] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.449723 1173 raft_consensus.cc:2272] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.450206 1173 ts_tablet_manager.cc:1916] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.446810 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 806) took 1333 ms. Trace:
I20260503 07:53:06.456105 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.455156 1174 rpcz_store.cc:276] 0503 07:53:05.113136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.130997 (+ 17861us) service_pool.cc:224] Handling call
0503 07:53:06.446728 (+1315731us) ts_tablet_manager.cc:1151] Deleting tablet ecc39d127c71412ea867a0b3cad10452
0503 07:53:06.446737 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.446796 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1315568}
W20260503 07:53:06.457327 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ecc39d127c71412ea867a0b3cad10452 because the tablet was not found. No further retry: Not found: Tablet not found: ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:06.457386 2330 tablet.cc:1724] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:06.457646 1174 tablet_replica.cc:333] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:06.457856 1174 raft_consensus.cc:2243] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.458067 1174 raft_consensus.cc:2272] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.458676 2281 tablet.cc:1724] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:06.459103 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c04763bb23b4c0f91df21eb0073095f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.459642 916 raft_consensus.cc:3060] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:06.459908 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4d8b20f6d9467ba283f80f77e113a1 (DEFAULT_TABLE table=default.Table_af4a886426b247b7ae33063090adeea5 [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.459120 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b6147bab7a44b19b4a22addf68961f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.460948 1173 ts_tablet_manager.cc:1929] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.461053 1173 log.cc:1199] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d79067c0c8594d50aa458d47b31d99af
I20260503 07:53:06.461380 1173 ts_tablet_manager.cc:1950] T d79067c0c8594d50aa458d47b31d99af P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:06.462255 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4d8b20f6d9467ba283f80f77e113a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.462265 885 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b0329a61dd4476bc0a65e90404efb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.462571 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1905c11361bb445bb54ef394b76bbefe (DEFAULT_TABLE table=default.Table_081556a5987448feab60316c1b536d0d [id=8d68c6f60c7a49449e800fbd5797cbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.462889 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1905c11361bb445bb54ef394b76bbefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.463462 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e406696afe614172a95fd7bab7b326f5 (DEFAULT_TABLE table=default.Table_3e37bc65d9d14a65a78bde18730ebace [id=f03d3593979340df9bc15b39af0441d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.463874 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e406696afe614172a95fd7bab7b326f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.465598 1173 tablet_replica.cc:333] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.465891 1173 raft_consensus.cc:2243] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.466300 1173 raft_consensus.cc:2272] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.466954 1173 ts_tablet_manager.cc:1916] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.467890 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ea29e3b4a84735bb3723dd11449ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.468207 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 568ccdf187eb4cae9688ff4929f3e95e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.468935 879 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeda1a5d6d436292cd1688f8a4d467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.469161 885 tablet_service.cc:1558] Processing DeleteTablet for tablet f5896bb71c674358957c87a347b8fb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.469887 879 tablet_service.cc:1558] Processing DeleteTablet for tablet feb88812c6b0459d86bd441926f57ecf with delete_type TABLET_DATA_DELETED (replaced by tablet b269ee59036d4c2f866b6b2bf45c35cf) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.470080 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c04763bb23b4c0f91df21eb0073095f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.470842 879 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4d8b20f6d9467ba283f80f77e113a1 (DEFAULT_TABLE table=default.Table_af4a886426b247b7ae33063090adeea5 [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.471539 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4d8b20f6d9467ba283f80f77e113a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.473408 599 catalog_manager.cc:5671] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:06.474031 599 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 79d43ae066e6411896c490f7c0b11180 (table default.Table_66b153f206f74219a6cd3b0b8ecfa6be [id=02296eaf13b0418ea0c47dfc4eeeb22c]). Expected version 2 got 0
I20260503 07:53:06.482477 885 tablet_service.cc:1511] Processing CreateTablet for tablet e406696afe614172a95fd7bab7b326f5 (DEFAULT_TABLE table=default.Table_3e37bc65d9d14a65a78bde18730ebace [id=f03d3593979340df9bc15b39af0441d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.482916 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e406696afe614172a95fd7bab7b326f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.483196 1166 ts_tablet_manager.cc:1403] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.000s
I20260503 07:53:06.483553 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 5a178957514e4f77afe8a1879b57a96b from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:06.484056 1166 raft_consensus.cc:359] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.484314 1166 raft_consensus.cc:385] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.484416 1166 raft_consensus.cc:740] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.484649 1166 consensus_queue.cc:260] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.485185 1166 ts_tablet_manager.cc:1434] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:06.487123 1165 tablet_bootstrap.cc:654] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.486943 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_548c6c8421cb445fa919d72e2514e4e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.487650 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_548c6c8421cb445fa919d72e2514e4e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.487907 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15] alter complete (version 1)
I20260503 07:53:06.488629 2298 raft_consensus.cc:493] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.488759 2298 raft_consensus.cc:515] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.489316 2298 leader_election.cc:290] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.490550 1174 ts_tablet_manager.cc:1916] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.490515 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:06.490952 716 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.494098 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_071e6d899050485585a4e2b80ae7980b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.494577 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_071e6d899050485585a4e2b80ae7980b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.496958 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_962194a1f83f4a40bd8f6a53b4eee740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.497416 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_962194a1f83f4a40bd8f6a53b4eee740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.499032 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2e8ccefd6fc44c6f8cad31baa38d52fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.499477 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e8ccefd6fc44c6f8cad31baa38d52fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.500443 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bf0c0baea6dc4c2c8012c0138ef29207"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.500839 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf0c0baea6dc4c2c8012c0138ef29207 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.503497 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b6147bab7a44b19b4a22addf68961f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:06.504010 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f53a37806e414f16aa69294c0abad10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53a37806e414f16aa69294c0abad10a already in progress: creating tablet
I20260503 07:53:06.504258 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d79067c0c8594d50aa458d47b31d99af (table default.Table_42857f9398f347ba8fb99ad7feb1cb50 [id=c370d1273bc1478989728c4b01e5070b]) successfully deleted
I20260503 07:53:06.505147 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.505705 715 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.505813 715 leader_election.cc:304] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.506182 2298 raft_consensus.cc:2749] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.507280 746 tablet_service.cc:1511] Processing CreateTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.511307 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_05ab2ff744764108ad29bbbba0578895" } new_table_name: "default.Table_7edc82193a6f4ff3bff6a8360b75c138" modify_external_catalogs: true
I20260503 07:53:06.511559 1166 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.521806 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.522224 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b9a724c6354a9eb17cc024c8f84669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.522909 750 tablet_service.cc:1511] Processing CreateTablet for tablet 579b36bfb4794a34907720b8b75ebf5c (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.524847 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b9a724c6354a9eb17cc024c8f84669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.528458 2113 consensus_queue.cc:1048] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:06.528616 896 tablet_service.cc:1511] Processing CreateTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.528961 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b9a724c6354a9eb17cc024c8f84669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.533058 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d15e70ec4856a15ed7c6175cd334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.536542 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b36bfb4794a34907720b8b75ebf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.537725 1173 ts_tablet_manager.cc:1929] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.537825 1173 log.cc:1199] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d8b0329a61dd4476bc0a65e90404efb4
I20260503 07:53:06.538110 1173 ts_tablet_manager.cc:1950] T d8b0329a61dd4476bc0a65e90404efb4 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:06.542539 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4d8b20f6d9467ba283f80f77e113a1 (DEFAULT_TABLE table=default.Table_af4a886426b247b7ae33063090adeea5 [id=3fb3c0ecf0204981854c6a492a3b36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.542950 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4d8b20f6d9467ba283f80f77e113a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:06.545684 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 431525b4f9154154890a026a4ce3755b consensus state has no leader
I20260503 07:53:06.545815 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4e725c831ebf41f09d1bfa49fa3570be" } modify_external_catalogs: true
I20260503 07:53:06.546032 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4e725c831ebf41f09d1bfa49fa3570be" } modify_external_catalogs: true
I20260503 07:53:06.551918 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6a2a1079ce0e4e6da9779ccd401e98f9
I20260503 07:53:06.553279 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b0bbeaab9d4e4596bca0fc88135f1a98" } modify_external_catalogs: true
I20260503 07:53:06.553452 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b0bbeaab9d4e4596bca0fc88135f1a98" } modify_external_catalogs: true
I20260503 07:53:06.553504 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.556347 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.558285 600 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 96680ab838f8446496c58a39736e9eca
I20260503 07:53:06.560702 1166 tablet_bootstrap.cc:654] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.560801 892 tablet_service.cc:1511] Processing CreateTablet for tablet 579b36bfb4794a34907720b8b75ebf5c (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.561184 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b36bfb4794a34907720b8b75ebf5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:06.561264 2376 log.cc:927] Time spent T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260503 07:53:06.561975 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5539e279bb1446a5b3ee8d46b2dd2fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.562134 1175 ts_tablet_manager.cc:1929] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.562245 1175 log.cc:1199] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:06.562551 1171 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.562680 1171 ts_tablet_manager.cc:1403] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.419s user 0.005s sys 0.008s
I20260503 07:53:06.563122 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d8b0329a61dd4476bc0a65e90404efb4 (table default.Table_44421a5083b5445b90c4daedbcd54e3a [id=b876b1254af945eaa381b59f931ae351]) successfully deleted
I20260503 07:53:06.563444 1171 raft_consensus.cc:359] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.563594 1171 raft_consensus.cc:385] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.563659 1171 raft_consensus.cc:740] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.563825 1171 consensus_queue.cc:260] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.564270 1171 ts_tablet_manager.cc:1434] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:06.564426 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2a1079ce0e4e6da9779ccd401e98f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.564545 1171 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.566578 1173 tablet_replica.cc:333] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.566738 1173 raft_consensus.cc:2243] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.566879 1173 raft_consensus.cc:2272] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.567359 1173 ts_tablet_manager.cc:1916] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.570194 1175 ts_tablet_manager.cc:1950] T cc7a0272fdc34044af78ba21b6ca31bc P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.571543 1174 ts_tablet_manager.cc:1929] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.571707 1174 log.cc:1199] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:06.572041 1174 ts_tablet_manager.cc:1950] T f7654a4a85b6441f9d36527ced775aa2 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.572790 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 809) took 1437 ms. Trace:
I20260503 07:53:06.572923 1174 rpcz_store.cc:276] 0503 07:53:05.135395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.140971 (+ 5576us) service_pool.cc:224] Handling call
0503 07:53:06.457603 (+1316632us) ts_tablet_manager.cc:1151] Deleting tablet f7654a4a85b6441f9d36527ced775aa2
0503 07:53:06.457613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.566284 (+108671us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.571491 (+ 5207us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.572770 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1316456}
I20260503 07:53:06.573493 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet f7654a4a85b6441f9d36527ced775aa2 (table default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]) successfully deleted
I20260503 07:53:06.574288 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_66b153f206f74219a6cd3b0b8ecfa6be" } new_table_name: "default.Table_66f8737118b343c1b4f1043b9e59c504" modify_external_catalogs: true
I20260503 07:53:06.570245 1171 tablet_bootstrap.cc:654] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.571205 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 579b36bfb4794a34907720b8b75ebf5c (DEFAULT_TABLE table=default.Table_b0fa0d992731427699a76c1870ca3cc6 [id=32374cbb15a34a4a8e33b7244520bf68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.575765 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b36bfb4794a34907720b8b75ebf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.575724 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.576411 1174 tablet_replica.cc:333] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:06.576627 1174 raft_consensus.cc:2243] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.576877 1174 pending_rounds.cc:70] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:06.576974 1174 pending_rounds.cc:77] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847443012902912 op_type: NO_OP noop_request { }
I20260503 07:53:06.577248 1174 raft_consensus.cc:2889] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.577395 1174 raft_consensus.cc:2272] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.580590 1174 ts_tablet_manager.cc:1916] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.583976 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet cc7a0272fdc34044af78ba21b6ca31bc (table default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]) successfully deleted
I20260503 07:53:06.584257 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_096b6f6990bb4089a2fb69c42199ecad" } new_table_name: "default.Table_8532361d74204ac08795dd35d212bec2" modify_external_catalogs: true
I20260503 07:53:06.585784 1165 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:06.586068 1165 ts_tablet_manager.cc:1403] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.146s user 0.006s sys 0.002s
I20260503 07:53:06.586733 1174 ts_tablet_manager.cc:1929] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.586848 1174 log.cc:1199] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:06.587172 1174 ts_tablet_manager.cc:1950] T d3fda3bba9234622b2c391a31c55dc3a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.587621 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7b4231da0fcb4e90b1e573fd7aef5f40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.588202 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b4231da0fcb4e90b1e573fd7aef5f40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.593835 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fd434aa643a94db8b792d842cddbede3" } new_table_name: "default.Table_20bbc89839134833b8f8a1091842a6e1" modify_external_catalogs: true
I20260503 07:53:06.589686 1165 raft_consensus.cc:359] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.594192 1165 raft_consensus.cc:385] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.594328 1165 raft_consensus.cc:740] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.594753 1165 consensus_queue.cc:260] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.596227 1165 ts_tablet_manager.cc:1434] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260503 07:53:06.596405 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5d7d792752374a91978feb4f24d63027" } new_table_name: "default.Table_9a1a0cf081834482a41254eb49003a57" modify_external_catalogs: true
I20260503 07:53:06.597186 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2b1eb7f4d0314a60ae7e6344e834bc9d" } modify_external_catalogs: true
I20260503 07:53:06.597381 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2b1eb7f4d0314a60ae7e6344e834bc9d" } modify_external_catalogs: true
I20260503 07:53:06.606986 1165 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:06.609107 1165 tablet_bootstrap.cc:654] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.613142 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_539ec4ae80b54267ad6dc4a0d02e0d08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.613642 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_539ec4ae80b54267ad6dc4a0d02e0d08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.615041 2082 raft_consensus.cc:493] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.615186 2082 raft_consensus.cc:515] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.615756 2082 leader_election.cc:290] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.616359 593 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet fd1de1df876543dd9e50ba9ef729ba6a
I20260503 07:53:06.618695 1970 ts_manager.cc:194] Registered new tserver with Master: 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:06.621044 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b10183f49464684acfa54e7d10ccee2 consensus state has no leader
I20260503 07:53:06.621779 1944 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" instance_seqno: 1777794766844864) as {username='slave'} at 127.0.105.3:48203; Asking this server to re-register.
I20260503 07:53:06.622403 1956 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" instance_seqno: 1777794765898916) as {username='slave'} at 127.0.105.1:58167; Asking this server to re-register.
I20260503 07:53:06.623548 1099 heartbeater.cc:461] Registering TS with master...
I20260503 07:53:06.624205 827 heartbeater.cc:461] Registering TS with master...
W20260503 07:53:06.625566 851 leader_election.cc:343] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:06.627694 1944 ts_manager.cc:194] Registered new tserver with Master: 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.628966 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1cdb8a63a92742578347537d6b4434f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.629561 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cdb8a63a92742578347537d6b4434f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.631284 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1f6a4395bc1544f0b36f4f37f01aeedd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.631845 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f6a4395bc1544f0b36f4f37f01aeedd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.635703 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b79b96b9ab1542e48bd33c363698ae1f" } modify_external_catalogs: true
I20260503 07:53:06.635870 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b79b96b9ab1542e48bd33c363698ae1f" } modify_external_catalogs: true
I20260503 07:53:06.642261 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cffd6579b5f4480c83276fca296d5483"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.642760 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cffd6579b5f4480c83276fca296d5483 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.643910 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f5167cd18ea4da7a967e8637f5f3c59" } modify_external_catalogs: true
I20260503 07:53:06.644049 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f5167cd18ea4da7a967e8637f5f3c59" } modify_external_catalogs: true
I20260503 07:53:06.644382 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 810) took 1447 ms. Trace:
I20260503 07:53:06.644462 1174 rpcz_store.cc:276] 0503 07:53:05.196901 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.197007 (+ 106us) service_pool.cc:224] Handling call
0503 07:53:06.573945 (+1376938us) ts_tablet_manager.cc:1151] Deleting tablet d3fda3bba9234622b2c391a31c55dc3a
0503 07:53:06.576356 (+ 2411us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.584093 (+ 7737us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.586671 (+ 2578us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.644361 (+ 57690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1374769}
I20260503 07:53:06.644860 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d3fda3bba9234622b2c391a31c55dc3a (table default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]) successfully deleted
W20260503 07:53:06.647404 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ab0752eb4fa49a48cf521f9a072689a consensus state has no leader
I20260503 07:53:06.656805 1175 tablet_replica.cc:333] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.659096 1175 raft_consensus.cc:2243] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.661966 1175 raft_consensus.cc:2272] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.664769 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 30c917e1bc514bcbb859340f9ef99f3b
I20260503 07:53:06.665140 1175 ts_tablet_manager.cc:1916] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.665285 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 437d8b148ade443790f5c42c7d955f48
I20260503 07:53:06.667766 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 437d8b148ade443790f5c42c7d955f48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.668736 1166 tablet_bootstrap.cc:492] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.669077 1166 ts_tablet_manager.cc:1403] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.158s user 0.010s sys 0.000s
I20260503 07:53:06.669245 1174 tablet_replica.cc:333] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:06.668929 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 437d8b148ade443790f5c42c7d955f48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.670365 1174 raft_consensus.cc:2243] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.670780 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:06.670953 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.671591 1166 raft_consensus.cc:359] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.671813 1166 raft_consensus.cc:385] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.671916 1166 raft_consensus.cc:740] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.672222 1174 raft_consensus.cc:2272] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.672190 1166 consensus_queue.cc:260] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:06.672426 854 leader_election.cc:343] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:06.672520 854 leader_election.cc:304] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:06.672699 1166 ts_tablet_manager.cc:1434] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:06.674431 2082 raft_consensus.cc:2749] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.676860 1166 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.676997 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ecc39d127c71412ea867a0b3cad10452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.678385 1166 tablet_bootstrap.cc:654] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:06.681118 988 consensus_peers.cc:597] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:06.682132 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 437d8b148ade443790f5c42c7d955f48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.682399 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:06.683250 988 consensus_peers.cc:597] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:06.694361 1171 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.694540 1171 ts_tablet_manager.cc:1403] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.130s user 0.005s sys 0.004s
I20260503 07:53:06.695825 1171 raft_consensus.cc:359] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.696157 1171 raft_consensus.cc:385] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.696310 1171 raft_consensus.cc:740] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.696573 1171 consensus_queue.cc:260] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.697255 1171 ts_tablet_manager.cc:1434] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:06.698637 1970 ts_manager.cc:194] Registered new tserver with Master: 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.703971 1171 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.705283 1171 tablet_bootstrap.cc:654] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.706118 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cee9ef7a6b20439db5b24767d3b857c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.706688 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cee9ef7a6b20439db5b24767d3b857c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.683596 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c917e1bc514bcbb859340f9ef99f3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:06.683933 775 raft_consensus.cc:1275] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:53:06.716702 1174 ts_tablet_manager.cc:1916] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.716995 1952 consensus_queue.cc:1048] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:06.683439 1173 ts_tablet_manager.cc:1929] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.726549 1173 log.cc:1199] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/16ea29e3b4a84735bb3723dd11449ec3
I20260503 07:53:06.726907 1173 ts_tablet_manager.cc:1950] T 16ea29e3b4a84735bb3723dd11449ec3 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:06.727743 1173 tablet_replica.cc:333] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.727939 1173 raft_consensus.cc:2243] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.728083 1173 raft_consensus.cc:2272] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.728579 1173 ts_tablet_manager.cc:1916] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.730242 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 16ea29e3b4a84735bb3723dd11449ec3 (table default.Table_174f327e0a86469a89537e4b094329ef [id=5840b6cd89a643d2bd407fcc0893c662]) successfully deleted
I20260503 07:53:06.737020 1173 ts_tablet_manager.cc:1929] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.737237 1173 log.cc:1199] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/568ccdf187eb4cae9688ff4929f3e95e
I20260503 07:53:06.737572 1173 ts_tablet_manager.cc:1950] T 568ccdf187eb4cae9688ff4929f3e95e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:06.737823 2330 tablet.cc:1724] T 79d43ae066e6411896c490f7c0b11180 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:06.738752 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 568ccdf187eb4cae9688ff4929f3e95e (table default.Table_4b4c47d9f77147ee8df6ed83f184ea80 [id=ec9d5560ea8e4f8885deb1586bf9d455]) successfully deleted
I20260503 07:53:06.739141 1173 tablet_replica.cc:333] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.739493 1173 raft_consensus.cc:2243] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.739667 1173 raft_consensus.cc:2272] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.740185 1173 ts_tablet_manager.cc:1916] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.743212 2281 tablet.cc:1724] T 79d43ae066e6411896c490f7c0b11180 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:06.744928 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_00a265bded494e629c023c1199bdb23a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.745551 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a265bded494e629c023c1199bdb23a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.748436 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3c016ed3b391460c8b2f27f84115dc5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.748957 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c016ed3b391460c8b2f27f84115dc5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.751470 1171 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.751943 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f8b6c30a13a249b7a848733abbc1fe9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.752460 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b6c30a13a249b7a848733abbc1fe9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.753273 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f60b0b7f6e141eaa0b5da8a061d09a2" } new_table_name: "default.Table_32773c065bd240f0932f0f5e52f2bdd8" modify_external_catalogs: true
I20260503 07:53:06.754496 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2cc0c5fabbbd49bd83c20def809b855d" } modify_external_catalogs: true
I20260503 07:53:06.754657 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_39ab2778dd8b40f199440137c1897c4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.754731 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2cc0c5fabbbd49bd83c20def809b855d" } modify_external_catalogs: true
W20260503 07:53:06.755136 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39ab2778dd8b40f199440137c1897c4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:06.757891 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 85465.2us
I20260503 07:53:06.759161 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 637462b45502433796daa7a9cd8586d3 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:06.759759 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cb6a510fb25541a98a4439a381cde649" } modify_external_catalogs: true
I20260503 07:53:06.759922 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cb6a510fb25541a98a4439a381cde649" } modify_external_catalogs: true
I20260503 07:53:06.761679 1171 ts_tablet_manager.cc:1403] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.006s
I20260503 07:53:06.763481 1171 raft_consensus.cc:359] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.763722 1171 raft_consensus.cc:385] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.763815 1171 raft_consensus.cc:740] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.764091 1171 consensus_queue.cc:260] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.764770 1166 tablet_bootstrap.cc:492] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.764789 1171 ts_tablet_manager.cc:1434] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:06.764963 1166 ts_tablet_manager.cc:1403] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.000s
I20260503 07:53:06.765851 1166 raft_consensus.cc:359] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.766064 1166 raft_consensus.cc:385] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.766176 1166 raft_consensus.cc:740] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.766443 1166 consensus_queue.cc:260] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.766934 1166 ts_tablet_manager.cc:1434] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260503 07:53:06.768031 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1d0e93ae66c46749c4f7e9e495ae60a consensus state has no leader
I20260503 07:53:06.768854 1166 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.765028 1171 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.771893 1171 tablet_bootstrap.cc:654] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.772996 885 tablet_service.cc:1558] Processing DeleteTablet for tablet b028017b7cc74ef6a199d6b9e0ba6e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:01 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:06.774231 988 consensus_peers.cc:597] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:06.778903 1174 ts_tablet_manager.cc:1929] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:06.781270 2386 raft_consensus.cc:493] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.781428 2386 raft_consensus.cc:515] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.782011 2386 leader_election.cc:290] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:06.782745 851 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: feb88812c6b0459d86bd441926f57ecf
W20260503 07:53:06.786134 854 leader_election.cc:343] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: feb88812c6b0459d86bd441926f57ecf
I20260503 07:53:06.787216 598 master_service.cc:954] ReplaceTablet: received request to replace tablet ecc39d127c71412ea867a0b3cad10452 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:06.787326 2330 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.799711 1175 ts_tablet_manager.cc:1929] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.786608 854 leader_election.cc:304] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:06.800441 2386 raft_consensus.cc:2749] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.800719 1175 log.cc:1199] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:06.800928 1171 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.801064 1171 ts_tablet_manager.cc:1403] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260503 07:53:06.801136 1175 ts_tablet_manager.cc:1950] T d3fda3bba9234622b2c391a31c55dc3a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.801806 1171 raft_consensus.cc:359] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.801965 1171 raft_consensus.cc:385] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.802014 1171 raft_consensus.cc:740] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.802196 1171 consensus_queue.cc:260] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.802958 1171 ts_tablet_manager.cc:1434] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:06.803339 1171 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.813169 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bdb2f3fb02ed488fb0bc75b137b9b52d" } new_table_name: "default.Table_6bfd9bf351fb41e4bd497d54a607e041" modify_external_catalogs: true
I20260503 07:53:06.820798 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_17357aa2dbaf445da87cced040fdbc82" } modify_external_catalogs: true
I20260503 07:53:06.821018 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_17357aa2dbaf445da87cced040fdbc82" } modify_external_catalogs: true
I20260503 07:53:06.821779 1171 tablet_bootstrap.cc:654] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.824678 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0319d0a5b2814beebb4b59f9c664b588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.824819 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f758e269b4d74a1a93e7c2e458442f35" } new_table_name: "default.Table_63fdff7963d7448389a83100d398dd64" modify_external_catalogs: true
W20260503 07:53:06.825313 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0319d0a5b2814beebb4b59f9c664b588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.826732 1174 log.cc:1199] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/2d647277295e42cdb65f45a619e63960
I20260503 07:53:06.781940 1165 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:06.806521 2281 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:06.827690 1174 ts_tablet_manager.cc:1950] T 2d647277295e42cdb65f45a619e63960 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:06.828498 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 811) took 1404 ms. Trace:
I20260503 07:53:06.827701 1165 ts_tablet_manager.cc:1403] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.220s user 0.000s sys 0.006s
I20260503 07:53:06.829042 2386 raft_consensus.cc:493] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.829173 2386 raft_consensus.cc:515] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.829417 1165 raft_consensus.cc:359] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.829581 1165 raft_consensus.cc:385] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.829653 1165 raft_consensus.cc:740] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.829874 1165 consensus_queue.cc:260] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.829949 2386 leader_election.cc:290] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.830401 1165 ts_tablet_manager.cc:1434] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:53:06.832029 1173 ts_tablet_manager.cc:1929] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.832422 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d148d37a79a1439b98b2caa0f672c96f" } new_table_name: "default.Table_00b964f3be7c43408761127739aee42e" modify_external_catalogs: true
I20260503 07:53:06.826563 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 878) took 1016 ms. Trace:
I20260503 07:53:06.833623 1175 rpcz_store.cc:276] 0503 07:53:05.809602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.809862 (+ 260us) service_pool.cc:224] Handling call
0503 07:53:06.583789 (+773927us) ts_tablet_manager.cc:1151] Deleting tablet d3fda3bba9234622b2c391a31c55dc3a
0503 07:53:06.606740 (+ 22951us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.750914 (+144174us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.799651 (+ 48737us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.826544 (+ 26893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24646,"tablet-delete.queue_time_us":706926}
I20260503 07:53:06.833976 1175 tablet_replica.cc:333] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.834174 1175 raft_consensus.cc:2243] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:06.834447 1175 pending_rounds.cc:70] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:06.834208 1173 log.cc:1199] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/aaaeda1a5d6d436292cd1688f8a4d467
I20260503 07:53:06.834511 1175 pending_rounds.cc:77] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847442885066752 op_type: NO_OP noop_request { }
W20260503 07:53:06.833809 854 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: f5896bb71c674358957c87a347b8fb79
I20260503 07:53:06.834604 1175 raft_consensus.cc:2889] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:06.834689 1175 raft_consensus.cc:2272] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.832322 1166 tablet_bootstrap.cc:654] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.835402 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d3fda3bba9234622b2c391a31c55dc3a (table default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]) successfully deleted
I20260503 07:53:06.835806 1173 ts_tablet_manager.cc:1950] T aaaeda1a5d6d436292cd1688f8a4d467 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:06.839550 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2946eabdeefd44cb8de4aefc235cc906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.840078 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2946eabdeefd44cb8de4aefc235cc906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.840477 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet aaaeda1a5d6d436292cd1688f8a4d467 (table default.Table_1c2a2d55f40f4d7c8113b8708d9a6d75 [id=15d8e732ba2c44e58051b5a1a3852980]) successfully deleted
I20260503 07:53:06.840816 1173 tablet_replica.cc:333] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:06.841041 1173 raft_consensus.cc:2243] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.841259 1173 raft_consensus.cc:2272] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:06.842202 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2bff2e711dc43a7b8757df95f3173b3 has no consensus state
I20260503 07:53:06.842566 1173 ts_tablet_manager.cc:1916] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.844149 1175 ts_tablet_manager.cc:1916] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:06.845122 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f9036a95f9a4a3db7de4551da5e93c8 consensus state has no leader
W20260503 07:53:06.845942 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75872effe17740b0b322a621cb9ceb17 consensus state has no leader
I20260503 07:53:06.850373 1165 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:06.852437 1165 tablet_bootstrap.cc:654] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:06.856439 851 leader_election.cc:343] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f5896bb71c674358957c87a347b8fb79
I20260503 07:53:06.856561 851 leader_election.cc:304] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:06.856715 851 raft_consensus.cc:2686] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:53:06.858963 2298 raft_consensus.cc:493] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.859091 2298 raft_consensus.cc:515] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.859647 2298 leader_election.cc:290] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:06.859778 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1314de5d64d948419afb1b3588747142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.860357 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1314de5d64d948419afb1b3588747142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.861541 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3a68ed42a6bb4aeaa03637864422abae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:06.861696 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:06.862003 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a68ed42a6bb4aeaa03637864422abae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:06.862200 716 leader_election.cc:343] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.863339 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9646530ccdda41a5a44559346f8868a0" } new_table_name: "default.Table_d662d59ef6944b91b72d753be0a69396" modify_external_catalogs: true
I20260503 07:53:06.864948 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:06.865873 715 leader_election.cc:343] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.866019 715 leader_election.cc:304] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:06.866449 2298 raft_consensus.cc:2749] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:06.871027 1166 tablet_bootstrap.cc:492] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.871171 1166 ts_tablet_manager.cc:1403] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.001s
I20260503 07:53:06.871570 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b4b1c5a7d594917adaffff902630bd1" } modify_external_catalogs: true
I20260503 07:53:06.871733 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0b4b1c5a7d594917adaffff902630bd1" } modify_external_catalogs: true
I20260503 07:53:06.871904 1166 raft_consensus.cc:359] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.872051 1166 raft_consensus.cc:385] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.872114 1166 raft_consensus.cc:740] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.872355 1166 consensus_queue.cc:260] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.872808 1166 ts_tablet_manager.cc:1434] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:06.873764 1166 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.878273 1171 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:06.880198 1171 ts_tablet_manager.cc:1403] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.006s
I20260503 07:53:06.884090 1175 ts_tablet_manager.cc:1929] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:06.890861 1166 tablet_bootstrap.cc:654] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.899216 1175 log.cc:1199] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:06.894748 1171 raft_consensus.cc:359] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.899506 1171 raft_consensus.cc:385] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.899622 1171 raft_consensus.cc:740] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.899722 1175 ts_tablet_manager.cc:1950] T f7654a4a85b6441f9d36527ced775aa2 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.901082 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_43d39570e97b440c823a2857ed6d3740" } modify_external_catalogs: true
I20260503 07:53:06.901325 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_43d39570e97b440c823a2857ed6d3740" } modify_external_catalogs: true
I20260503 07:53:06.903954 1173 ts_tablet_manager.cc:1929] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.899931 1171 consensus_queue.cc:260] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.905258 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 879) took 1095 ms. Trace:
I20260503 07:53:06.905366 1175 rpcz_store.cc:276] 0503 07:53:05.809693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.809943 (+ 250us) service_pool.cc:224] Handling call
0503 07:53:06.833927 (+1023984us) ts_tablet_manager.cc:1151] Deleting tablet f7654a4a85b6441f9d36527ced775aa2
0503 07:53:06.833937 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.881117 (+ 47180us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.884042 (+ 2925us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.905240 (+ 21198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4,"tablet-delete.queue_time_us":957018}
I20260503 07:53:06.906992 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_650313d3ed9447df8706aad925ff5b5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.907541 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_650313d3ed9447df8706aad925ff5b5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.908622 1171 ts_tablet_manager.cc:1434] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260503 07:53:06.908922 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 880) took 1091 ms. Trace:
I20260503 07:53:06.909224 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f7654a4a85b6441f9d36527ced775aa2 (table default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]) successfully deleted
I20260503 07:53:06.909368 1175 rpcz_store.cc:276] 0503 07:53:05.817162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.817211 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:06.905650 (+1088439us) ts_tablet_manager.cc:1151] Deleting tablet 579b36bfb4794a34907720b8b75ebf5c
0503 07:53:06.908762 (+ 3112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.908903 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1028687}
I20260503 07:53:06.909307 1171 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:06.909898 601 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]). Expected version 3 got 0
I20260503 07:53:06.910562 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 801e48526d634222875678f56ce00cfe from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:06.911634 1171 tablet_bootstrap.cc:654] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.911978 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 882) took 1031 ms. Trace:
I20260503 07:53:06.912091 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
W20260503 07:53:06.912161 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 579b36bfb4794a34907720b8b75ebf5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 579b36bfb4794a34907720b8b75ebf5c already in progress: creating tablet
I20260503 07:53:06.912333 1175 rpcz_store.cc:276] 0503 07:53:05.880617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.880709 (+ 92us) service_pool.cc:224] Handling call
0503 07:53:06.911843 (+1031134us) ts_tablet_manager.cc:1151] Deleting tablet bfb51a2a01aa4806aedc3a2b76908477
0503 07:53:06.911854 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.911963 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1030927}
W20260503 07:53:06.912875 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bfb51a2a01aa4806aedc3a2b76908477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfb51a2a01aa4806aedc3a2b76908477 already in progress: creating tablet
I20260503 07:53:06.913455 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 881) took 1032 ms. Trace:
I20260503 07:53:06.914394 1175 rpcz_store.cc:276] 0503 07:53:05.880518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.880951 (+ 433us) service_pool.cc:224] Handling call
0503 07:53:06.913335 (+1032384us) ts_tablet_manager.cc:1151] Deleting tablet 7cca44c2622e4f9493d71e59fc3056ae
0503 07:53:06.913347 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.913431 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1032218}
W20260503 07:53:06.914886 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7cca44c2622e4f9493d71e59fc3056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cca44c2622e4f9493d71e59fc3056ae already in progress: creating tablet
I20260503 07:53:06.915266 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 883) took 1012 ms. Trace:
I20260503 07:53:06.915376 1175 rpcz_store.cc:276] 0503 07:53:05.903232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.904158 (+ 926us) service_pool.cc:224] Handling call
0503 07:53:06.915171 (+1011013us) ts_tablet_manager.cc:1151] Deleting tablet 9833d3b3bf174720b5da54e19ae8e015
0503 07:53:06.915179 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.915251 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010785}
W20260503 07:53:06.915805 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9833d3b3bf174720b5da54e19ae8e015 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9833d3b3bf174720b5da54e19ae8e015 already in progress: creating tablet
I20260503 07:53:06.917330 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f8c37663d2a64a7f8a8f88d4a86e5280"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.917817 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8c37663d2a64a7f8a8f88d4a86e5280 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.920258 747 tablet_service.cc:1511] Processing CreateTablet for tablet d2c9ef28716c4bc09bf0de6c96da0a33 (DEFAULT_TABLE table=default.Table_071e6d899050485585a4e2b80ae7980b [id=41f02ac139f64e648312f9c2313e720d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.920636 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c9ef28716c4bc09bf0de6c96da0a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.924499 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d2c9ef28716c4bc09bf0de6c96da0a33 (DEFAULT_TABLE table=default.Table_071e6d899050485585a4e2b80ae7980b [id=41f02ac139f64e648312f9c2313e720d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.924990 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c9ef28716c4bc09bf0de6c96da0a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.926040 2113 raft_consensus.cc:493] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:06.926151 2113 raft_consensus.cc:515] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.926702 2113 leader_election.cc:290] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.927188 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:06.927386 772 raft_consensus.cc:2468] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:06.927821 986 leader_election.cc:304] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:06.928584 1030 tablet_service.cc:1511] Processing CreateTablet for tablet a5e540b4e5a046e78af3e61858e1fc42 (DEFAULT_TABLE table=default.Table_962194a1f83f4a40bd8f6a53b4eee740 [id=50f6137119d448c4a3ecd5b97b79cd9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.928722 2113 raft_consensus.cc:2804] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:06.928786 2113 raft_consensus.cc:493] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:06.928835 2113 raft_consensus.cc:3060] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:06.928917 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e540b4e5a046e78af3e61858e1fc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.929587 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_ba4ac916a85e49c793f64e171c13382a [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 1 got 0
I20260503 07:53:06.931602 2113 raft_consensus.cc:515] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.932458 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:06.932628 772 raft_consensus.cc:3060] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:06.935000 772 raft_consensus.cc:2468] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:06.935786 986 leader_election.cc:304] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:06.936059 2269 raft_consensus.cc:2804] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:06.936184 2269 raft_consensus.cc:697] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:06.936412 2269 consensus_queue.cc:237] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:06.937697 750 tablet_service.cc:1511] Processing CreateTablet for tablet 16941894d18b490894c0b0a2dda2b24d (DEFAULT_TABLE table=default.Table_548c6c8421cb445fa919d72e2514e4e3 [id=b7ac9acb335b431dbc5e68eb536131b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.937808 746 tablet_service.cc:1511] Processing CreateTablet for tablet 75dcc0df64d442f09a2eb3b18132e856 (DEFAULT_TABLE table=default.Table_cc5cbe88c43e4ca292006ad1c3a8559b [id=f7779c8664344c859bdcbc7eaf6dfa9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.938081 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16941894d18b490894c0b0a2dda2b24d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.938534 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 16941894d18b490894c0b0a2dda2b24d (DEFAULT_TABLE table=default.Table_548c6c8421cb445fa919d72e2514e4e3 [id=b7ac9acb335b431dbc5e68eb536131b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.938534 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 75dcc0df64d442f09a2eb3b18132e856 (DEFAULT_TABLE table=default.Table_cc5cbe88c43e4ca292006ad1c3a8559b [id=f7779c8664344c859bdcbc7eaf6dfa9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.938660 747 tablet_service.cc:1511] Processing CreateTablet for tablet a5e540b4e5a046e78af3e61858e1fc42 (DEFAULT_TABLE table=default.Table_962194a1f83f4a40bd8f6a53b4eee740 [id=50f6137119d448c4a3ecd5b97b79cd9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.938869 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16941894d18b490894c0b0a2dda2b24d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.939018 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dcc0df64d442f09a2eb3b18132e856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.943742 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6649b63c3d6242dabd3f431f0286e85e (DEFAULT_TABLE table=default.Table_c63f9158079846f0870332b154d4ec1b [id=ea21612b0b6644c58fb09c3fb1472035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.944023 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6649b63c3d6242dabd3f431f0286e85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.944041 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dcc0df64d442f09a2eb3b18132e856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.947261 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 884) took 1038 ms. Trace:
I20260503 07:53:06.947392 1175 rpcz_store.cc:276] 0503 07:53:05.909156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.911004 (+ 1848us) service_pool.cc:224] Handling call
0503 07:53:06.916058 (+1005054us) ts_tablet_manager.cc:1151] Deleting tablet 5776840523f54e6bb18d674815d3b447
0503 07:53:06.924732 (+ 8674us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.947247 (+ 22515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1004848}
I20260503 07:53:06.947742 1175 tablet_replica.cc:333] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.948122 1175 raft_consensus.cc:2243] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.948386 1175 raft_consensus.cc:2272] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:06.948818 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5776840523f54e6bb18d674815d3b447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5776840523f54e6bb18d674815d3b447 already in progress: creating tablet
I20260503 07:53:06.948973 1175 ts_tablet_manager.cc:1916] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.949611 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e540b4e5a046e78af3e61858e1fc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.953338 2113 leader_election.cc:290] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:06.961043 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6ae4a8f39d67459dbb80c72947ae7005
I20260503 07:53:06.963022 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:06.965482 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f158ee50be904cee95383a3808f148f2 consensus state has no leader
I20260503 07:53:06.970058 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1250f3ea00054f5c9b0ad7cf079892d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:06.970759 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1250f3ea00054f5c9b0ad7cf079892d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:06.907822 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1709a2a49475daaa2372360610b1e with delete_type TABLET_DATA_DELETED (replaced by tablet b16bc543b2e84e8ca7df6c00f1acc0f7) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.974635 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]). Expected version 3 got 0
I20260503 07:53:06.973587 1173 log.cc:1199] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f5896bb71c674358957c87a347b8fb79
I20260503 07:53:06.974928 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0f45941fd2c94161b5438fe65f858b95 (table default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588]). Expected version 1 got 0
I20260503 07:53:06.917704 1166 tablet_bootstrap.cc:492] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:06.919000 886 tablet_service.cc:1511] Processing CreateTablet for tablet d2c9ef28716c4bc09bf0de6c96da0a33 (DEFAULT_TABLE table=default.Table_071e6d899050485585a4e2b80ae7980b [id=41f02ac139f64e648312f9c2313e720d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.925849 891 tablet_service.cc:1511] Processing CreateTablet for tablet a5e540b4e5a046e78af3e61858e1fc42 (DEFAULT_TABLE table=default.Table_962194a1f83f4a40bd8f6a53b4eee740 [id=50f6137119d448c4a3ecd5b97b79cd9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.928542 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:06.934566 892 tablet_service.cc:1511] Processing CreateTablet for tablet 16941894d18b490894c0b0a2dda2b24d (DEFAULT_TABLE table=default.Table_548c6c8421cb445fa919d72e2514e4e3 [id=b7ac9acb335b431dbc5e68eb536131b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.936488 896 tablet_service.cc:1511] Processing CreateTablet for tablet 75dcc0df64d442f09a2eb3b18132e856 (DEFAULT_TABLE table=default.Table_cc5cbe88c43e4ca292006ad1c3a8559b [id=f7779c8664344c859bdcbc7eaf6dfa9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.940307 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e9889ca584931ac1d91a9af2c0689" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:06.975373 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:06.975587 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c9ef28716c4bc09bf0de6c96da0a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.975813 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16941894d18b490894c0b0a2dda2b24d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.941220 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6649b63c3d6242dabd3f431f0286e85e (DEFAULT_TABLE table=default.Table_c63f9158079846f0870332b154d4ec1b [id=ea21612b0b6644c58fb09c3fb1472035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.975975 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dcc0df64d442f09a2eb3b18132e856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.976197 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e540b4e5a046e78af3e61858e1fc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.976599 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6649b63c3d6242dabd3f431f0286e85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:06.978374 1175 ts_tablet_manager.cc:1929] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:06.978477 1175 log.cc:1199] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:06.978732 1175 ts_tablet_manager.cc:1950] T 94cd6a702c59445882a81ca2e3a0f3f6 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:06.979732 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 94cd6a702c59445882a81ca2e3a0f3f6 (table default.Table_51fb3eec8b874340a588a54ee74d00cf [id=4b72deda123e4973bb5bad7303ca2fbd]) successfully deleted
I20260503 07:53:06.965019 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:06.980360 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:06.981384 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:06.982635 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1f4446badf064ecabc01b330f3babde2 (table default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e]). Expected version 3 got 0
I20260503 07:53:06.984947 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae4a8f39d67459dbb80c72947ae7005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:06.985291 1175 tablet_replica.cc:333] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:06.985646 1175 raft_consensus.cc:2243] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:06.975399 1166 ts_tablet_manager.cc:1403] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.002s
I20260503 07:53:06.986182 1175 raft_consensus.cc:2272] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:06.986407 1166 raft_consensus.cc:359] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.986536 1166 raft_consensus.cc:385] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:06.986574 1166 raft_consensus.cc:740] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:06.986732 1166 consensus_queue.cc:260] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:06.987214 1166 ts_tablet_manager.cc:1434] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260503 07:53:06.988513 988 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:06.988804 988 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:06.989560 1166 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:06.990123 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:06.993530 1175 ts_tablet_manager.cc:1916] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:06.996537 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6649b63c3d6242dabd3f431f0286e85e (DEFAULT_TABLE table=default.Table_c63f9158079846f0870332b154d4ec1b [id=ea21612b0b6644c58fb09c3fb1472035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:06.996997 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6649b63c3d6242dabd3f431f0286e85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.001154 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:07.002974 1173 ts_tablet_manager.cc:1950] T f5896bb71c674358957c87a347b8fb79 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.002923 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c (DEFAULT_TABLE table=default.Table_99757e618a1549339090f9e61d587367 [id=7f09eaddc9f545519ed8e352c1dad8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.003373 1173 tablet_replica.cc:333] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.003489 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f5896bb71c674358957c87a347b8fb79 (table default.Table_8e054473f51a46658409679b60b4f097 [id=4d435b963bd742c0b3d6da1c384015e6]) successfully deleted
I20260503 07:53:07.003541 1173 raft_consensus.cc:2243] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.003657 1173 raft_consensus.cc:2272] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.004119 1173 ts_tablet_manager.cc:1916] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.005990 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.012432 1166 tablet_bootstrap.cc:654] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.013572 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet cec0b36fdcf64042bc87446977b9dcca
I20260503 07:53:07.014340 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet cec0b36fdcf64042bc87446977b9dcca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.015305 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cec0b36fdcf64042bc87446977b9dcca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.016489 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0a269a12729549469f86e184e2ed7e86
I20260503 07:53:07.017944 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a269a12729549469f86e184e2ed7e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.018169 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a269a12729549469f86e184e2ed7e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.018529 747 tablet_service.cc:1558] Processing DeleteTablet for tablet cec0b36fdcf64042bc87446977b9dcca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.018579 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d58deacb99c643d89a6641ef09b026ba with delete_type TABLET_DATA_DELETED (replaced by tablet 423d4178b5c040d5b12f0f225d112449) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.018759 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3b1841a8266d43b9819c5598c0b8fac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.019277 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b1841a8266d43b9819c5598c0b8fac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.019774 1171 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:07.019977 1171 ts_tablet_manager.cc:1403] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.111s user 0.004s sys 0.010s
I20260503 07:53:07.020253 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a269a12729549469f86e184e2ed7e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.020521 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2c686fe8f22a4e96854cc93365235b14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:07.020802 1171 raft_consensus.cc:359] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.020964 1171 raft_consensus.cc:385] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:53:07.021026 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c686fe8f22a4e96854cc93365235b14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.021037 1171 raft_consensus.cc:740] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.021227 1171 consensus_queue.cc:260] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.024353 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c (DEFAULT_TABLE table=default.Table_99757e618a1549339090f9e61d587367 [id=7f09eaddc9f545519ed8e352c1dad8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.024698 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.026785 1171 ts_tablet_manager.cc:1434] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260503 07:53:07.028975 1171 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:07.041379 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0e47796d8f924117bcc5dcc5cf958874
I20260503 07:53:07.042038 1173 ts_tablet_manager.cc:1929] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.043715 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b5f948770f824e1987b35e0fdc9057cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:07.044076 1173 log.cc:1199] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/feb88812c6b0459d86bd441926f57ecf
I20260503 07:53:07.044489 1173 ts_tablet_manager.cc:1950] T feb88812c6b0459d86bd441926f57ecf P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.045346 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:07.046433 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5f948770f824e1987b35e0fdc9057cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.047653 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.049013 892 tablet_service.cc:1511] Processing CreateTablet for tablet 9158409f18204903b0a2203e6bb8b924 (DEFAULT_TABLE table=default.Table_7d632b4e26a645269d8c554f5dd9f8ab [id=7970e9393c374ca1b80b9bdb232f3af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.049401 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9158409f18204903b0a2203e6bb8b924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.049600 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.051625 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 9158409f18204903b0a2203e6bb8b924 (DEFAULT_TABLE table=default.Table_7d632b4e26a645269d8c554f5dd9f8ab [id=7970e9393c374ca1b80b9bdb232f3af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.051998 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9158409f18204903b0a2203e6bb8b924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.052836 1171 tablet_bootstrap.cc:654] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:06.828588 1174 rpcz_store.cc:276] 0503 07:53:05.424068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.424118 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:06.669189 (+1245071us) ts_tablet_manager.cc:1151] Deleting tablet 2d647277295e42cdb65f45a619e63960
0503 07:53:06.669201 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:06.719770 (+ 50569us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.778829 (+ 59059us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:06.828453 (+ 49624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244897}
I20260503 07:53:07.057317 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 2d647277295e42cdb65f45a619e63960 (table default.Table_380ccf69fa8943d6ac4c87a883a25068 [id=31dc0c51d9e540f4b93214d2a7e1ee2d]) successfully deleted
I20260503 07:53:07.058300 1174 tablet_replica.cc:333] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:07.059137 1175 ts_tablet_manager.cc:1929] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:07.060505 750 tablet_service.cc:1511] Processing CreateTablet for tablet 9158409f18204903b0a2203e6bb8b924 (DEFAULT_TABLE table=default.Table_7d632b4e26a645269d8c554f5dd9f8ab [id=7970e9393c374ca1b80b9bdb232f3af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.060585 1174 raft_consensus.cc:2243] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.060776 1174 raft_consensus.cc:2272] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.060983 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9158409f18204903b0a2203e6bb8b924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.061327 1174 ts_tablet_manager.cc:1916] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.061724 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet feb88812c6b0459d86bd441926f57ecf (table default.Table_63fdff7963d7448389a83100d398dd64 [id=07bab04461974a1088917f8c34d18388]) successfully deleted
I20260503 07:53:07.060519 1952 raft_consensus.cc:493] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.062193 1952 raft_consensus.cc:515] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.062760 1952 leader_election.cc:290] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.063405 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bf46b34b1043e2ab6c9f8b2c871227" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:07.063557 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b1ec616bf21d4d85944761290df4239f (DEFAULT_TABLE table=default.Table_7ecf8a10ab1b4df49f3f7909c8474734 [id=5fe0e8a16c3048bca5934569b0fc946c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.063805 746 tablet_service.cc:1511] Processing CreateTablet for tablet b1ec616bf21d4d85944761290df4239f (DEFAULT_TABLE table=default.Table_7ecf8a10ab1b4df49f3f7909c8474734 [id=5fe0e8a16c3048bca5934569b0fc946c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.063887 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ec616bf21d4d85944761290df4239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.063874 892 tablet_service.cc:1511] Processing CreateTablet for tablet b1ec616bf21d4d85944761290df4239f (DEFAULT_TABLE table=default.Table_7ecf8a10ab1b4df49f3f7909c8474734 [id=5fe0e8a16c3048bca5934569b0fc946c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.064205 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ec616bf21d4d85944761290df4239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.064145 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ec616bf21d4d85944761290df4239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.064384 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6708ef5e63fc4f91aa1e35b6560b3295 (DEFAULT_TABLE table=default.Table_b5c9caa8c56c466198de2174b1fd90a0 [id=1db699d5c99c4cafb7b28c0613f2f60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.064677 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708ef5e63fc4f91aa1e35b6560b3295. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:07.068594 988 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:07.068876 986 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:07.068997 986 leader_election.cc:304] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.069377 1952 raft_consensus.cc:2749] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:07.070119 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9c04763bb23b4c0f91df21eb0073095f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c04763bb23b4c0f91df21eb0073095f already in progress: creating tablet
I20260503 07:53:07.070380 1175 log.cc:1199] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8c25addae8c94554a83344f07a11362f
I20260503 07:53:07.070472 1173 tablet_replica.cc:333] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.070698 1173 raft_consensus.cc:2243] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.070917 1175 ts_tablet_manager.cc:1950] T 8c25addae8c94554a83344f07a11362f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:07.070912 1173 raft_consensus.cc:2272] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.071467 1173 ts_tablet_manager.cc:1916] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.072924 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8c25addae8c94554a83344f07a11362f (table default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]) successfully deleted
I20260503 07:53:07.073268 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c (DEFAULT_TABLE table=default.Table_99757e618a1549339090f9e61d587367 [id=7f09eaddc9f545519ed8e352c1dad8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.073717 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eedd92cf4f340aeb5472ee9c4c9b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.073956 1165 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:07.074116 1165 ts_tablet_manager.cc:1403] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.224s user 0.005s sys 0.001s
I20260503 07:53:07.074911 1165 raft_consensus.cc:359] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:07.075212 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c4f85848e3ad467a98b34e314c4c0ac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4f85848e3ad467a98b34e314c4c0ac9 already in progress: creating tablet
I20260503 07:53:07.075322 1165 raft_consensus.cc:385] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.076804 1952 consensus_queue.cc:1048] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:07.077832 1165 raft_consensus.cc:740] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.078161 1165 consensus_queue.cc:260] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.078716 1165 ts_tablet_manager.cc:1434] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260503 07:53:07.078771 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 46dd100e06ff41be960b265b52d1c607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dd100e06ff41be960b265b52d1c607 already in progress: creating tablet
I20260503 07:53:07.079123 1165 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:07.079319 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f53a37806e414f16aa69294c0abad10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53a37806e414f16aa69294c0abad10a already in progress: creating tablet
I20260503 07:53:07.080960 1165 tablet_bootstrap.cc:654] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:07.080953 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9c04763bb23b4c0f91df21eb0073095f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c04763bb23b4c0f91df21eb0073095f already in progress: creating tablet
I20260503 07:53:07.081228 1175 tablet_replica.cc:333] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:07.081447 1175 raft_consensus.cc:2243] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:07.081777 1175 raft_consensus.cc:2272] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.083525 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aa3c00ec689d4fac865d16978a0ecc58" } new_table_name: "default.Table_6e09b789a20347d88774fe43031bfa7b" modify_external_catalogs: true
I20260503 07:53:07.085704 1171 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:07.085942 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 801e48526d634222875678f56ce00cfe
I20260503 07:53:07.086373 601 catalog_manager.cc:6741] ReplaceTablet: tablet 801e48526d634222875678f56ce00cfe deleted and replaced by tablet dad4408db9eb47c9bb925fb66b7d8b8b
I20260503 07:53:07.087221 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_417eac5b97e84183ba5bd85c32593d95" } new_table_name: "default.Table_999649b0095b4f6398aec84b22845edf" modify_external_catalogs: true
I20260503 07:53:07.088269 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 801e48526d634222875678f56ce00cfe with delete_type TABLET_DATA_DELETED (replaced by tablet dad4408db9eb47c9bb925fb66b7d8b8b) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.088725 1171 ts_tablet_manager.cc:1403] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20260503 07:53:07.088761 1166 tablet_bootstrap.cc:492] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.088888 1166 ts_tablet_manager.cc:1403] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.099s user 0.001s sys 0.004s
I20260503 07:53:07.089562 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 801e48526d634222875678f56ce00cfe with delete_type TABLET_DATA_DELETED (replaced by tablet dad4408db9eb47c9bb925fb66b7d8b8b) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.089624 1171 raft_consensus.cc:359] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.089635 1166 raft_consensus.cc:359] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.089794 1166 raft_consensus.cc:385] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.089825 1171 raft_consensus.cc:385] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.089859 1166 raft_consensus.cc:740] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.089946 1171 raft_consensus.cc:740] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.090107 1166 consensus_queue.cc:260] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.090152 1171 consensus_queue.cc:260] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.090616 1166 ts_tablet_manager.cc:1434] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260503 07:53:07.091429 1171 ts_tablet_manager.cc:1434] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:07.092072 1166 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.093693 1166 tablet_bootstrap.cc:654] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.095084 1171 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:07.103998 1171 tablet_bootstrap.cc:654] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.108309 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 801e48526d634222875678f56ce00cfe with delete_type TABLET_DATA_DELETED (replaced by tablet dad4408db9eb47c9bb925fb66b7d8b8b) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.109437 1166 tablet_bootstrap.cc:492] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.109560 1166 ts_tablet_manager.cc:1403] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:53:07.109925 886 tablet_service.cc:1511] Processing CreateTablet for tablet 5e692dcee9ae474cb9efb81011998fde (DEFAULT_TABLE table=default.Table_a0893d7a732040d8bb226caa8eec28d9 [id=e261749ab90a44ecb1978318166140eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.110244 1166 raft_consensus.cc:359] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.110401 1166 raft_consensus.cc:385] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.110456 1166 raft_consensus.cc:740] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.110743 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e692dcee9ae474cb9efb81011998fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.110872 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6708ef5e63fc4f91aa1e35b6560b3295 (DEFAULT_TABLE table=default.Table_b5c9caa8c56c466198de2174b1fd90a0 [id=1db699d5c99c4cafb7b28c0613f2f60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.111270 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708ef5e63fc4f91aa1e35b6560b3295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.113538 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5e692dcee9ae474cb9efb81011998fde (DEFAULT_TABLE table=default.Table_a0893d7a732040d8bb226caa8eec28d9 [id=e261749ab90a44ecb1978318166140eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.113912 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e692dcee9ae474cb9efb81011998fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.116150 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc95f4438e5416bb00c060786dac5c4 (DEFAULT_TABLE table=default.Table_a2aede41512c49438f7515bc1fabed2a [id=1356f30dac6d4a918ab7fbfdb113b594]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.116083 746 tablet_service.cc:1511] Processing CreateTablet for tablet 5e692dcee9ae474cb9efb81011998fde (DEFAULT_TABLE table=default.Table_a0893d7a732040d8bb226caa8eec28d9 [id=e261749ab90a44ecb1978318166140eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.117331 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e692dcee9ae474cb9efb81011998fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.118840 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc95f4438e5416bb00c060786dac5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.119133 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6708ef5e63fc4f91aa1e35b6560b3295 (DEFAULT_TABLE table=default.Table_b5c9caa8c56c466198de2174b1fd90a0 [id=1db699d5c99c4cafb7b28c0613f2f60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.119451 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6708ef5e63fc4f91aa1e35b6560b3295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.123663 1166 consensus_queue.cc:260] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.124367 1166 ts_tablet_manager.cc:1434] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260503 07:53:07.126299 2298 raft_consensus.cc:493] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.126432 2298 raft_consensus.cc:515] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.127008 2298 leader_election.cc:290] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:07.127071 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0a67c4565c4c4c35bb54cd047258be07
I20260503 07:53:07.127504 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.128118 715 leader_election.cc:343] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.128520 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:07.129081 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.129257 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:07.129360 716 leader_election.cc:343] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.129468 716 leader_election.cc:304] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.129635 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.130163 2298 raft_consensus.cc:2749] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.130573 1166 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.131479 1165 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:07.131623 1165 ts_tablet_manager.cc:1403] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260503 07:53:07.132411 1165 raft_consensus.cc:359] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.132566 1165 raft_consensus.cc:385] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.132642 1165 raft_consensus.cc:740] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.132867 1165 consensus_queue.cc:260] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.133122 1166 tablet_bootstrap.cc:654] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.135017 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc95f4438e5416bb00c060786dac5c4 (DEFAULT_TABLE table=default.Table_a2aede41512c49438f7515bc1fabed2a [id=1356f30dac6d4a918ab7fbfdb113b594]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.135392 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc95f4438e5416bb00c060786dac5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.135655 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc95f4438e5416bb00c060786dac5c4 (DEFAULT_TABLE table=default.Table_a2aede41512c49438f7515bc1fabed2a [id=1356f30dac6d4a918ab7fbfdb113b594]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.136008 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc95f4438e5416bb00c060786dac5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.136091 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 (DEFAULT_TABLE table=default.Table_0b4b1c5a7d594917adaffff902630bd1 [id=74ca5b1ee43e41ca83f9d8aa15bc2c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.137496 1165 ts_tablet_manager.cc:1434] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:53:07.137658 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 (DEFAULT_TABLE table=default.Table_0b4b1c5a7d594917adaffff902630bd1 [id=74ca5b1ee43e41ca83f9d8aa15bc2c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.137792 1165 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:07.138026 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a67c4565c4c4c35bb54cd047258be07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.139468 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08e403756a4d99867263d0941d2120 (DEFAULT_TABLE table=default.Table_6847e950344842ee9d8a308444ab7c47 [id=7c43da8936c340928a1035ff777af338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.139796 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08e403756a4d99867263d0941d2120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.140470 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0a67c4565c4c4c35bb54cd047258be07 (DEFAULT_TABLE table=default.Table_0b4b1c5a7d594917adaffff902630bd1 [id=74ca5b1ee43e41ca83f9d8aa15bc2c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.140808 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a67c4565c4c4c35bb54cd047258be07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.146076 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08e403756a4d99867263d0941d2120 (DEFAULT_TABLE table=default.Table_6847e950344842ee9d8a308444ab7c47 [id=7c43da8936c340928a1035ff777af338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.148344 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_66f8737118b343c1b4f1043b9e59c504 [id=02296eaf13b0418ea0c47dfc4eeeb22c] alter complete (version 3)
I20260503 07:53:07.149166 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_db0e35ee49fb4e15a61f954954cd12bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.151597 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db0e35ee49fb4e15a61f954954cd12bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.152030 1173 ts_tablet_manager.cc:1929] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:07.152143 1173 log.cc:1199] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/36b6147bab7a44b19b4a22addf68961f
I20260503 07:53:07.153508 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_61bc32391d74447fa02d4f0cbc148296" } new_table_name: "default.Table_5382b8d2201a4c1d9ca76cb0726f6540" modify_external_catalogs: true
I20260503 07:53:07.156358 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_875cb37ee7584c2b93f8898085e79147" } new_table_name: "default.Table_af96e04d0c2247e98c042b21657848cf" modify_external_catalogs: true
I20260503 07:53:07.157635 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2be3105c43184a0a8ce206bd0e75f4b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.158075 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2be3105c43184a0a8ce206bd0e75f4b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.159171 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d0d1656b9284e67887fb317e86e7309 consensus state has no leader
I20260503 07:53:07.159409 593 master_service.cc:954] ReplaceTablet: received request to replace tablet f53a37806e414f16aa69294c0abad10a from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:07.159953 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e181e483c82548999378acd80b172bfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.160429 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e181e483c82548999378acd80b172bfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.161501 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e210e9e635b6449e9d48f3520120ac97 consensus state has no leader
I20260503 07:53:07.161798 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9316e2bb7ef54175aa2916cea992d039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.162247 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9316e2bb7ef54175aa2916cea992d039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.155308 882 tablet_service.cc:1558] Processing DeleteTablet for tablet fb821b329d284643a889b07f9a4f287e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.166558 1173 ts_tablet_manager.cc:1950] T 36b6147bab7a44b19b4a22addf68961f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.168231 2386 raft_consensus.cc:493] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.168351 2386 raft_consensus.cc:515] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.168886 2386 leader_election.cc:290] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.169137 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08e403756a4d99867263d0941d2120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.169740 1173 tablet_replica.cc:333] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.169915 1173 raft_consensus.cc:2243] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.170053 1173 raft_consensus.cc:2272] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.170631 1173 ts_tablet_manager.cc:1916] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.170686 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9674018b68e444bea48fcba2fbc2616b" } modify_external_catalogs: true
I20260503 07:53:07.170871 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9674018b68e444bea48fcba2fbc2616b" } modify_external_catalogs: true
W20260503 07:53:07.173179 854 leader_election.cc:343] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:07.175187 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c25addae8c94554a83344f07a11362f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.175619 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]) successfully deleted
W20260503 07:53:07.176528 851 leader_election.cc:343] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:07.176644 851 leader_election.cc:304] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.177007 2386 raft_consensus.cc:2749] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.177619 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_af4a886426b247b7ae33063090adeea5" } new_table_name: "default.Table_1f30722997cf4c729f7fd893d4b07d4a" modify_external_catalogs: true
W20260503 07:53:07.178161 988 consensus_peers.cc:597] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:07.180552 1175 ts_tablet_manager.cc:1916] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.188934 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a67c4565c4c4c35bb54cd047258be07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.196753 1173 ts_tablet_manager.cc:1929] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.196964 2386 raft_consensus.cc:493] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.198105 2386 raft_consensus.cc:515] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.198506 1166 tablet_bootstrap.cc:492] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.198650 1166 ts_tablet_manager.cc:1403] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.000s
I20260503 07:53:07.198771 2386 leader_election.cc:290] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:07.199306 1173 log.cc:1199] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ab33d15e70ec4856a15ed7c6175cd334
I20260503 07:53:07.199805 1173 ts_tablet_manager.cc:1950] T ab33d15e70ec4856a15ed7c6175cd334 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.205796 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08e403756a4d99867263d0941d2120 (DEFAULT_TABLE table=default.Table_6847e950344842ee9d8a308444ab7c47 [id=7c43da8936c340928a1035ff777af338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.206660 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08e403756a4d99867263d0941d2120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.207197 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 (DEFAULT_TABLE table=default.Table_d4d1026e4b5543358358b803c5854c5b [id=1da450f94f37431ba85022b9d443bca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.207615 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70243e24ae17460f9d3e20720a9bfa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.214015 1174 ts_tablet_manager.cc:1929] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.214910 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_20bbc89839134833b8f8a1091842a6e1 [id=63f0f416d7c54be89355008b47b3c7a7] alter complete (version 2)
I20260503 07:53:07.215502 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 637462b45502433796daa7a9cd8586d3 from {username='slave'} at 127.0.0.1:44308
W20260503 07:53:07.200289 854 leader_election.cc:343] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 92c1709a2a49475daaa2372360610b1e
I20260503 07:53:07.217629 596 master_service.cc:954] ReplaceTablet: received request to replace tablet a328057ceb3640d1a26b773862492f04 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:07.201009 1166 raft_consensus.cc:359] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.220321 1166 raft_consensus.cc:385] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.220408 1166 raft_consensus.cc:740] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.220664 1166 consensus_queue.cc:260] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:07.221148 851 leader_election.cc:343] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 92c1709a2a49475daaa2372360610b1e
I20260503 07:53:07.221372 851 leader_election.cc:304] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.221710 2386 raft_consensus.cc:2749] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.222767 1166 ts_tablet_manager.cc:1434] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260503 07:53:07.223032 1166 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.225123 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:07.226573 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b07f68090a746a685b088c54c84d5f8 consensus state has no leader
I20260503 07:53:07.228802 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:07.228977 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:07.231834 1166 tablet_bootstrap.cc:654] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.232141 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_371c2f73361d47ac88caf3061820323f" } modify_external_catalogs: true
I20260503 07:53:07.233935 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f99c7855a4485b3523b68b0ea24c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.234754 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.234999 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.232659 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fa00182294cd45cc9b8b17e2a1cb2072" } modify_external_catalogs: true
I20260503 07:53:07.235347 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fa00182294cd45cc9b8b17e2a1cb2072" } modify_external_catalogs: true
I20260503 07:53:07.236617 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_371c2f73361d47ac88caf3061820323f" } modify_external_catalogs: true
I20260503 07:53:07.237721 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ab33d15e70ec4856a15ed7c6175cd334 (table default.Table_dad6c6e91b084308a94abf81b5c120a3 [id=cb3204cb6061405bb6a2cdff89916775]) successfully deleted
I20260503 07:53:07.238034 1173 tablet_replica.cc:333] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.239552 1173 raft_consensus.cc:2243] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.239795 1173 raft_consensus.cc:2272] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.238503 891 tablet_service.cc:1511] Processing CreateTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 (DEFAULT_TABLE table=default.Table_d4d1026e4b5543358358b803c5854c5b [id=1da450f94f37431ba85022b9d443bca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.238210 886 tablet_service.cc:1511] Processing CreateTablet for tablet a1ebb64cded14c3a9f97e8d385cabb76 (DEFAULT_TABLE table=default.Table_08a0ebcd938740c2b493ff2654f8e854 [id=4d55cef4d4d74603bd1855d1431d7ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.240859 1173 ts_tablet_manager.cc:1916] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.241046 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ebb64cded14c3a9f97e8d385cabb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.242043 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a1ebb64cded14c3a9f97e8d385cabb76 (DEFAULT_TABLE table=default.Table_08a0ebcd938740c2b493ff2654f8e854 [id=4d55cef4d4d74603bd1855d1431d7ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.242488 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70243e24ae17460f9d3e20720a9bfa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.242789 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ebb64cded14c3a9f97e8d385cabb76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:07.246831 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4ab0752eb4fa49a48cf521f9a072689a consensus state has no leader
I20260503 07:53:07.248019 2365 catalog_manager.cc:1269] Loaded cluster ID: e159b1db76c34313bb974acd3f2dcf52
I20260503 07:53:07.251581 1952 raft_consensus.cc:493] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.251703 1952 raft_consensus.cc:515] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.252561 1952 leader_election.cc:290] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.255055 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.255558 988 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.257617 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 5b07f68090a746a685b088c54c84d5f8 (DEFAULT_TABLE table=default.Table_5382b8d2201a4c1d9ca76cb0726f6540 [id=b2d9b4e1fecb4c3b9f1a690139cf146e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.258036 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b07f68090a746a685b088c54c84d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.261931 1166 tablet_bootstrap.cc:492] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.262166 1166 ts_tablet_manager.cc:1403] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.000s
I20260503 07:53:07.263415 1166 raft_consensus.cc:359] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.263584 1166 raft_consensus.cc:385] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.263633 1166 raft_consensus.cc:740] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:07.263629 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dd241f8b17b412e8789b0918357bf35 consensus state has no leader
I20260503 07:53:07.263952 1166 consensus_queue.cc:260] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.269152 1166 ts_tablet_manager.cc:1434] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:53:07.270860 1166 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.271662 2365 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: loading cluster ID for follower catalog manager: success
I20260503 07:53:07.271920 882 tablet_service.cc:1511] Processing CreateTablet for tablet 11609c647aee4036b22ed35651b92087 (DEFAULT_TABLE table=default.Table_00edbca8b4c84e21b4f9ed7a14848bba [id=b3e3d90181094ba8bfdbd97d6e34e506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.272348 1166 tablet_bootstrap.cc:654] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.272606 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11609c647aee4036b22ed35651b92087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.274665 1166 tablet_bootstrap.cc:492] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.274762 1166 ts_tablet_manager.cc:1403] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260503 07:53:07.275374 1166 raft_consensus.cc:359] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.275523 1166 raft_consensus.cc:385] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.275568 1166 raft_consensus.cc:740] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.275768 1166 consensus_queue.cc:260] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.276465 1166 ts_tablet_manager.cc:1434] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:07.276712 1166 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.279376 1166 tablet_bootstrap.cc:654] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.286938 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32929eb0a40141398dfd93b0b6bddacf" } modify_external_catalogs: true
I20260503 07:53:07.287127 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32929eb0a40141398dfd93b0b6bddacf" } modify_external_catalogs: true
I20260503 07:53:07.291262 1166 tablet_bootstrap.cc:492] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.291388 1166 ts_tablet_manager.cc:1403] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.002s
I20260503 07:53:07.293056 1166 raft_consensus.cc:359] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.293213 1166 raft_consensus.cc:385] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.293256 1166 raft_consensus.cc:740] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.293473 1166 consensus_queue.cc:260] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.293623 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:07.296458 1166 ts_tablet_manager.cc:1434] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:07.296730 1166 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.298007 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_f481b7a1d80f4d70b7f976e55e0c3c83 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 2 got 0
I20260503 07:53:07.298271 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:07.300026 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5b07f68090a746a685b088c54c84d5f8 (DEFAULT_TABLE table=default.Table_5382b8d2201a4c1d9ca76cb0726f6540 [id=b2d9b4e1fecb4c3b9f1a690139cf146e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.301720 1171 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:07.301939 1171 ts_tablet_manager.cc:1403] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.207s user 0.001s sys 0.004s
I20260503 07:53:07.302695 1171 raft_consensus.cc:359] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.302924 1171 raft_consensus.cc:385] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.303547 1171 raft_consensus.cc:740] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.303468 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.303946 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.304021 1171 consensus_queue.cc:260] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.307214 1166 tablet_bootstrap.cc:654] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.307488 1171 ts_tablet_manager.cc:1434] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260503 07:53:07.307739 1171 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:07.309477 1171 tablet_bootstrap.cc:654] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.310523 597 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 468a420c2a87466398cad5dfd959b3be (table default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7]). Expected version 1 got 0
I20260503 07:53:07.314512 1166 tablet_bootstrap.cc:492] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.315857 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:07.314635 1166 ts_tablet_manager.cc:1403] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260503 07:53:07.317241 1166 raft_consensus.cc:359] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.317395 1166 raft_consensus.cc:385] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.317445 1166 raft_consensus.cc:740] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.317631 1166 consensus_queue.cc:260] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.317837 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 11609c647aee4036b22ed35651b92087 (DEFAULT_TABLE table=default.Table_00edbca8b4c84e21b4f9ed7a14848bba [id=b3e3d90181094ba8bfdbd97d6e34e506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.318226 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11609c647aee4036b22ed35651b92087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.319907 1166 ts_tablet_manager.cc:1434] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:07.320197 1166 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.321461 1166 tablet_bootstrap.cc:654] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.322818 1173 ts_tablet_manager.cc:1929] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:07.322983 1173 log.cc:1199] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/6a2a1079ce0e4e6da9779ccd401e98f9
I20260503 07:53:07.323360 1173 ts_tablet_manager.cc:1950] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.326170 1173 tablet_replica.cc:333] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.326395 1173 raft_consensus.cc:2243] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.326570 1173 raft_consensus.cc:2272] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.327340 1173 ts_tablet_manager.cc:1916] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.327970 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.328553 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b07f68090a746a685b088c54c84d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.337016 1173 ts_tablet_manager.cc:1929] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.340749 1173 log.cc:1199] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ecc39d127c71412ea867a0b3cad10452
I20260503 07:53:07.341334 1173 ts_tablet_manager.cc:1950] T ecc39d127c71412ea867a0b3cad10452 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.342165 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 49f13260592a48f4a68922b7cf392a48 (DEFAULT_TABLE table=default.Table_68891bf0cd2c4b0f96e3840dbb19dfe1 [id=8c46d742070144d7a035dfe8e445dd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.342381 1173 tablet_replica.cc:333] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.342540 1173 raft_consensus.cc:2243] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.342557 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f13260592a48f4a68922b7cf392a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.342655 1173 raft_consensus.cc:2272] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.343554 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 20eece13d60c42be953340038dfa6ff2 (DEFAULT_TABLE table=default.Table_42211d76c1f247b9928bafb30b2b26f0 [id=4e1b5b6ddf59494fa970f1883e1693da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.343684 1173 ts_tablet_manager.cc:1916] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.343830 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eece13d60c42be953340038dfa6ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.341928 2269 raft_consensus.cc:493] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.348868 2269 raft_consensus.cc:515] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.349613 2269 leader_election.cc:290] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.350270 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a117f416c611418a96963db600da1d04" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.350747 988 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.350998 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec19c82fda742da8f1366b581e94680 (DEFAULT_TABLE table=default.Table_2be120c3879e4a42bac0f6afd20cf9ba [id=2b1f89a100e34ec08674981ae94956f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:07.351158 986 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: a117f416c611418a96963db600da1d04
I20260503 07:53:07.351249 986 leader_election.cc:304] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.351459 2269 raft_consensus.cc:2749] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.351828 1020 tablet_service.cc:1511] Processing CreateTablet for tablet bc48fecaf43e4d3cb3bc591a20874980 (DEFAULT_TABLE table=default.Table_321ac527100e4b3b82f32fa3f9ad059b [id=18946725444e4446a6c99d0d00e74764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.352159 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec19c82fda742da8f1366b581e94680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.354112 1173 ts_tablet_manager.cc:1929] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.356386 1173 log.cc:1199] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b028017b7cc74ef6a199d6b9e0ba6e14
I20260503 07:53:07.356843 1173 ts_tablet_manager.cc:1950] T b028017b7cc74ef6a199d6b9e0ba6e14 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.357841 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48fecaf43e4d3cb3bc591a20874980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.358289 1173 tablet_replica.cc:333] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:07.358669 1173 raft_consensus.cc:2243] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.359145 1173 raft_consensus.cc:2272] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.360260 1173 ts_tablet_manager.cc:1916] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.362640 2365 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: acquiring CA information for follower catalog manager: success
I20260503 07:53:07.325462 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]) successfully deleted
W20260503 07:53:07.365170 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 437d8b148ade443790f5c42c7d955f48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437d8b148ade443790f5c42c7d955f48 already in progress: creating tablet
W20260503 07:53:07.365399 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 30c917e1bc514bcbb859340f9ef99f3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c917e1bc514bcbb859340f9ef99f3b already in progress: creating tablet
I20260503 07:53:07.365582 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ecc39d127c71412ea867a0b3cad10452 (table default.Table_63d40973d4274e249dabcfbeb69433aa [id=9290461419df4394a2c203b5ca8992eb]) successfully deleted
I20260503 07:53:07.365792 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b028017b7cc74ef6a199d6b9e0ba6e14 (table default.Table_569d7dd42684487a89c9749674c78b1a [id=1773e021ed7c489aa09d73e171b34837]) successfully deleted
I20260503 07:53:07.366843 886 tablet_service.cc:1511] Processing CreateTablet for tablet bc48fecaf43e4d3cb3bc591a20874980 (DEFAULT_TABLE table=default.Table_321ac527100e4b3b82f32fa3f9ad059b [id=18946725444e4446a6c99d0d00e74764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.367194 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48fecaf43e4d3cb3bc591a20874980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.368415 879 tablet_service.cc:1511] Processing CreateTablet for tablet 20eece13d60c42be953340038dfa6ff2 (DEFAULT_TABLE table=default.Table_42211d76c1f247b9928bafb30b2b26f0 [id=4e1b5b6ddf59494fa970f1883e1693da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.368583 1173 ts_tablet_manager.cc:1929] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:07.368664 1173 log.cc:1199] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/92c1709a2a49475daaa2372360610b1e
I20260503 07:53:07.368739 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eece13d60c42be953340038dfa6ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.368932 1173 ts_tablet_manager.cc:1950] T 92c1709a2a49475daaa2372360610b1e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:07.374975 917 raft_consensus.cc:3060] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.327601 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_eca1c70488b24800b87da036697e2137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.383786 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eca1c70488b24800b87da036697e2137 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.335242 601 master_service.cc:954] ReplaceTablet: received request to replace tablet 17b58e042a6442658d95d373409fa25e from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:07.387240 882 tablet_service.cc:1511] Processing CreateTablet for tablet 49f13260592a48f4a68922b7cf392a48 (DEFAULT_TABLE table=default.Table_68891bf0cd2c4b0f96e3840dbb19dfe1 [id=8c46d742070144d7a035dfe8e445dd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.387651 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f13260592a48f4a68922b7cf392a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.392706 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec19c82fda742da8f1366b581e94680 (DEFAULT_TABLE table=default.Table_2be120c3879e4a42bac0f6afd20cf9ba [id=2b1f89a100e34ec08674981ae94956f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.393420 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec19c82fda742da8f1366b581e94680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.403625 1171 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:07.403818 1171 ts_tablet_manager.cc:1403] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.096s user 0.000s sys 0.003s
I20260503 07:53:07.404613 1171 raft_consensus.cc:359] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.408239 1174 log.cc:1199] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/376e9889ca584931ac1d91a9af2c0689
I20260503 07:53:07.237318 747 tablet_service.cc:1511] Processing CreateTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 (DEFAULT_TABLE table=default.Table_d4d1026e4b5543358358b803c5854c5b [id=1da450f94f37431ba85022b9d443bca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.236342 1165 tablet_bootstrap.cc:654] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.408792 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70243e24ae17460f9d3e20720a9bfa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.410766 1174 ts_tablet_manager.cc:1950] T 376e9889ca584931ac1d91a9af2c0689 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:07.242321 746 tablet_service.cc:1511] Processing CreateTablet for tablet a1ebb64cded14c3a9f97e8d385cabb76 (DEFAULT_TABLE table=default.Table_08a0ebcd938740c2b493ff2654f8e854 [id=4d55cef4d4d74603bd1855d1431d7ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.412858 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 819) took 1819 ms. Trace:
I20260503 07:53:07.412933 1174 rpcz_store.cc:276] 0503 07:53:05.593638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.597138 (+ 3500us) service_pool.cc:224] Handling call
0503 07:53:07.058235 (+1461097us) ts_tablet_manager.cc:1151] Deleting tablet 376e9889ca584931ac1d91a9af2c0689
0503 07:53:07.058247 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:07.211050 (+152803us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.213940 (+ 2890us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.412813 (+198873us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460933}
I20260503 07:53:07.413285 1174 tablet_replica.cc:333] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:07.413442 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 376e9889ca584931ac1d91a9af2c0689 (table default.Table_b6e488110fe04337ababb42ab1c2a09e [id=a8b412e854214ea5b5f338060fffdee9]) successfully deleted
I20260503 07:53:07.413491 1174 raft_consensus.cc:2243] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:07.413618 1174 raft_consensus.cc:2272] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.414093 1174 ts_tablet_manager.cc:1916] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.254848 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.257365 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5b07f68090a746a685b088c54c84d5f8 (DEFAULT_TABLE table=default.Table_5382b8d2201a4c1d9ca76cb0726f6540 [id=b2d9b4e1fecb4c3b9f1a690139cf146e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.416725 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b07f68090a746a685b088c54c84d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.315299 751 tablet_service.cc:1511] Processing CreateTablet for tablet 11609c647aee4036b22ed35651b92087 (DEFAULT_TABLE table=default.Table_00edbca8b4c84e21b4f9ed7a14848bba [id=b3e3d90181094ba8bfdbd97d6e34e506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.420512 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11609c647aee4036b22ed35651b92087. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:07.423337 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a4d8b20f6d9467ba283f80f77e113a1 consensus state has no leader
I20260503 07:53:07.339918 760 tablet_service.cc:1511] Processing CreateTablet for tablet bc48fecaf43e4d3cb3bc591a20874980 (DEFAULT_TABLE table=default.Table_321ac527100e4b3b82f32fa3f9ad059b [id=18946725444e4446a6c99d0d00e74764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.341013 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec19c82fda742da8f1366b581e94680 (DEFAULT_TABLE table=default.Table_2be120c3879e4a42bac0f6afd20cf9ba [id=2b1f89a100e34ec08674981ae94956f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.348471 742 tablet_service.cc:1511] Processing CreateTablet for tablet 49f13260592a48f4a68922b7cf392a48 (DEFAULT_TABLE table=default.Table_68891bf0cd2c4b0f96e3840dbb19dfe1 [id=8c46d742070144d7a035dfe8e445dd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.350060 2298 raft_consensus.cc:493] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.424456 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48fecaf43e4d3cb3bc591a20874980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.424381 2298 raft_consensus.cc:515] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.424496 1165 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:07.424618 1165 ts_tablet_manager.cc:1403] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.287s user 0.004s sys 0.001s
I20260503 07:53:07.424667 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f13260592a48f4a68922b7cf392a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.425052 2298 leader_election.cc:290] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:07.236327 750 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.425390 1165 raft_consensus.cc:359] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.425519 1165 raft_consensus.cc:385] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.425560 1165 raft_consensus.cc:740] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.425719 1165 consensus_queue.cc:260] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.426132 1165 ts_tablet_manager.cc:1434] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:07.426192 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:07.428268 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec19c82fda742da8f1366b581e94680. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:07.428329 715 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.432521 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cff2bbd666e14e7bb766e5ae8f4b0a17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.433097 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff2bbd666e14e7bb766e5ae8f4b0a17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.436395 1171 raft_consensus.cc:385] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.436522 1171 raft_consensus.cc:740] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.436780 1171 consensus_queue.cc:260] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.439976 1165 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:07.441365 1165 tablet_bootstrap.cc:654] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.444866 1171 ts_tablet_manager.cc:1434] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.041s user 0.001s sys 0.000s
I20260503 07:53:07.447530 1171 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:07.303324 1175 ts_tablet_manager.cc:1929] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:07.415457 2269 raft_consensus.cc:493] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.449349 2269 raft_consensus.cc:515] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.449923 2269 leader_election.cc:290] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:07.416677 986 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.425657 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:07.450088 986 leader_election.cc:304] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:07.450538 716 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.450639 716 leader_election.cc:304] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.450784 2113 raft_consensus.cc:2749] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.450940 2298 raft_consensus.cc:2749] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.451367 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.451519 774 raft_consensus.cc:2468] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:07.452957 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.453419 988 leader_election.cc:343] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.456245 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:07.456848 988 consensus_peers.cc:597] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a2a1079ce0e4e6da9779ccd401e98f9. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:07.457250 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9316e2bb7ef54175aa2916cea992d039" } new_table_name: "default.Table_278c6e4b23b94ec4b8f7a502932f7962" modify_external_catalogs: true
I20260503 07:53:07.460430 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.468430 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3be0ae78ada34cd88debca569b77d24a
I20260503 07:53:07.471244 2269 raft_consensus.cc:493] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.471393 2269 raft_consensus.cc:515] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.472003 2269 leader_election.cc:290] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.472599 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.473065 988 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.473770 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a328057ceb3640d1a26b773862492f04
I20260503 07:53:07.474189 596 catalog_manager.cc:6741] ReplaceTablet: tablet a328057ceb3640d1a26b773862492f04 deleted and replaced by tablet bd484b35831d4dafa93385c40c8ab696
I20260503 07:53:07.474601 759 tablet_service.cc:1558] Processing DeleteTablet for tablet a328057ceb3640d1a26b773862492f04 with delete_type TABLET_DATA_DELETED (replaced by tablet bd484b35831d4dafa93385c40c8ab696) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.477557 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a328057ceb3640d1a26b773862492f04 with delete_type TABLET_DATA_DELETED (replaced by tablet bd484b35831d4dafa93385c40c8ab696) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.478503 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2df2ed7d2563487aa15fe917b3fcf313
I20260503 07:53:07.479136 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.485138 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.488284 882 tablet_service.cc:1558] Processing DeleteTablet for tablet a328057ceb3640d1a26b773862492f04 with delete_type TABLET_DATA_DELETED (replaced by tablet bd484b35831d4dafa93385c40c8ab696) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.488622 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3c5ac9e941434804bf7d8bd8208dcf4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.489562 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c5ac9e941434804bf7d8bd8208dcf4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.489082 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6775d8d897cf4e0bb4f30977e8d640de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.489995 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6775d8d897cf4e0bb4f30977e8d640de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.491066 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9aa3759511d942bfbc6e50ea2e2f2777
I20260503 07:53:07.491299 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet acbfff84673541929083cbc13b059398
I20260503 07:53:07.491703 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_49b37ac0c82347efae878d0fc6198faa" } new_table_name: "default.Table_95667d645ba543c795df2da82c455756" modify_external_catalogs: true
I20260503 07:53:07.491815 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_78050367c48f47a5831411a068239629"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.492211 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78050367c48f47a5831411a068239629 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.494130 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet acbfff84673541929083cbc13b059398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.494370 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.496444 760 tablet_service.cc:1558] Processing DeleteTablet for tablet acbfff84673541929083cbc13b059398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.496662 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.493506 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.495397 879 tablet_service.cc:1558] Processing DeleteTablet for tablet acbfff84673541929083cbc13b059398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.506059 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 17b58e042a6442658d95d373409fa25e
I20260503 07:53:07.506528 601 catalog_manager.cc:6741] ReplaceTablet: tablet 17b58e042a6442658d95d373409fa25e deleted and replaced by tablet c7263a5d258e4f8ab413a1619ac611f0
I20260503 07:53:07.506762 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 17b58e042a6442658d95d373409fa25e with delete_type TABLET_DATA_DELETED (replaced by tablet c7263a5d258e4f8ab413a1619ac611f0) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.506808 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cfb780593d00408c95ded7e5b545f97c" } new_table_name: "default.Table_07d524476f694b8ea7ce95c0fc005807" modify_external_catalogs: true
I20260503 07:53:07.507299 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ebb64cded14c3a9f97e8d385cabb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.508450 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 17b58e042a6442658d95d373409fa25e with delete_type TABLET_DATA_DELETED (replaced by tablet c7263a5d258e4f8ab413a1619ac611f0) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.508598 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2f58c734c20e4da180b30b1fbc3f2031" } new_table_name: "default.Table_614df9b3a0fa4a03ab70cc70d59fb99d" modify_external_catalogs: true
I20260503 07:53:07.509815 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 17b58e042a6442658d95d373409fa25e with delete_type TABLET_DATA_DELETED (replaced by tablet c7263a5d258e4f8ab413a1619ac611f0) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.513904 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f251ae3be30f4b1a8f888c898d6c17ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.514511 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f251ae3be30f4b1a8f888c898d6c17ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.517138 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80dc80e46ce94ce8bf4f2cb9962a5e25 has no consensus state
I20260503 07:53:07.517522 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2b4d0f0707354322996eba01d73d5ea9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:07.518302 2365 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 65adddd546eb49779519c7f7378d0e60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260503 07:53:07.518599 2386 raft_consensus.cc:493] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.518723 2386 raft_consensus.cc:515] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.519373 2386 leader_election.cc:290] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:07.519726 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b4d0f0707354322996eba01d73d5ea9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.520526 851 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:07.522393 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_032933754e71413aa0bd9a712e7bcc1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.522879 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_032933754e71413aa0bd9a712e7bcc1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.525779 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.525974 772 raft_consensus.cc:2468] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:07.527704 986 leader_election.cc:304] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.528003 2421 raft_consensus.cc:2804] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:07.528079 2421 raft_consensus.cc:493] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:07.528152 2421 raft_consensus.cc:3060] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.530802 2421 raft_consensus.cc:515] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.531744 2421 leader_election.cc:290] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.531697 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:07.532243 988 leader_election.cc:343] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:07.534188 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1799fea5a17f4a1cbbcd955d3813167c consensus state has no leader
I20260503 07:53:07.540468 986 leader_election.cc:304] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.540714 2269 raft_consensus.cc:2804] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:07.540784 2269 raft_consensus.cc:493] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:07.540866 2269 raft_consensus.cc:3060] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.543344 2269 raft_consensus.cc:515] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.543923 2269 leader_election.cc:290] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.545077 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:07.545526 988 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:07.546272 854 leader_election.cc:343] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:07.546377 854 leader_election.cc:304] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.546718 2386 raft_consensus.cc:2749] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.547353 596 master_service.cc:954] ReplaceTablet: received request to replace tablet eccf6c7770554ba3861e4add2f7f180a from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:07.548466 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be0ae78ada34cd88debca569b77d24a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:07.548636 774 raft_consensus.cc:3060] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.548739 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:07.548889 772 raft_consensus.cc:3060] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.551206 774 raft_consensus.cc:2468] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:07.551438 772 raft_consensus.cc:2468] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:07.555263 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be0ae78ada34cd88debca569b77d24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.555307 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be0ae78ada34cd88debca569b77d24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.555326 986 leader_election.cc:304] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.555546 2269 raft_consensus.cc:2804] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:07.555691 2269 raft_consensus.cc:697] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:07.555948 2269 consensus_queue.cc:237] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:07.558749 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2de368e66424e4d9edf7c840ac8071e consensus state has no leader
I20260503 07:53:07.571092 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0fa89bcfce9646958abc5de6041a5bc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.571992 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fa89bcfce9646958abc5de6041a5bc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.576390 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be0ae78ada34cd88debca569b77d24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.584720 986 leader_election.cc:304] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.585026 2269 raft_consensus.cc:2804] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:07.585217 2269 raft_consensus.cc:697] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:07.585558 2269 consensus_queue.cc:237] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.592329 2421 raft_consensus.cc:493] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.592536 2421 raft_consensus.cc:515] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.593672 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:07.593736 2421 leader_election.cc:290] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:07.594201 988 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.594681 1175 log.cc:1199] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/36b6147bab7a44b19b4a22addf68961f
I20260503 07:53:07.595305 1175 ts_tablet_manager.cc:1950] T 36b6147bab7a44b19b4a22addf68961f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:07.596527 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 908) took 1137 ms. Trace:
I20260503 07:53:07.596922 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df2ed7d2563487aa15fe917b3fcf313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.597640 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.597877 774 raft_consensus.cc:2468] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:07.598677 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_33d33732cee3402b871062f8882acc78" } modify_external_catalogs: true
I20260503 07:53:07.598907 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_33d33732cee3402b871062f8882acc78" } modify_external_catalogs: true
I20260503 07:53:07.601904 2419 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:07.598270 986 leader_election.cc:304] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.601640 2421 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.614136 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:07.614420 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_f481b7a1d80f4d70b7f976e55e0c3c83 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 2 got 0
I20260503 07:53:07.620550 600 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 8d0487d02934453fbb25104f3b8fe732 (table default.Table_f481b7a1d80f4d70b7f976e55e0c3c83 [id=ff32cf0130ba49fbbe5d93a0507bdc80]). Expected version 2 got 1
I20260503 07:53:07.622468 2386 raft_consensus.cc:493] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.622617 2386 raft_consensus.cc:515] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.612164 1952 raft_consensus.cc:2804] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:07.623246 1952 raft_consensus.cc:493] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:07.623281 2386 leader_election.cc:290] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.623318 1952 raft_consensus.cc:3060] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.624739 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c25addae8c94554a83344f07a11362f" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.625839 1952 raft_consensus.cc:515] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.626487 1952 leader_election.cc:290] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.628038 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:07.628651 988 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.629074 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2e8ccefd6fc44c6f8cad31baa38d52fb" } new_table_name: "default.Table_b5bdfb4adf594f41a537ae43bb0f9f7e" modify_external_catalogs: true
I20260503 07:53:07.630421 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61316b7a521e42a59bf955179b080f40" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:07.630578 774 raft_consensus.cc:3060] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.612023 2421 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.631569 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.631975 988 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.632287 2421 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.633176 774 raft_consensus.cc:2468] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:07.611636 1175 rpcz_store.cc:276] 0503 07:53:06.459005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.459059 (+ 54us) service_pool.cc:224] Handling call
0503 07:53:07.081179 (+622120us) ts_tablet_manager.cc:1151] Deleting tablet 36b6147bab7a44b19b4a22addf68961f
0503 07:53:07.081191 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:07.183785 (+102594us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.303263 (+119478us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.596502 (+293239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":620799}
I20260503 07:53:07.636410 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.636574 774 raft_consensus.cc:2468] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:07.643515 854 leader_election.cc:343] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8c25addae8c94554a83344f07a11362f
I20260503 07:53:07.643673 854 leader_election.cc:304] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.644089 2386 raft_consensus.cc:2749] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:07.657282 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 351b2289fa394e4296a70c18f99ea21e consensus state has no leader
I20260503 07:53:07.666342 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7426b06e1445432aab9f7f43f7b5ff39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.667261 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7426b06e1445432aab9f7f43f7b5ff39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.685511 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d83ff5edb21b430faaf244a27b9283eb" } modify_external_catalogs: true
I20260503 07:53:07.685745 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d83ff5edb21b430faaf244a27b9283eb" } modify_external_catalogs: true
I20260503 07:53:07.688690 746 tablet_service.cc:1511] Processing CreateTablet for tablet 20eece13d60c42be953340038dfa6ff2 (DEFAULT_TABLE table=default.Table_42211d76c1f247b9928bafb30b2b26f0 [id=4e1b5b6ddf59494fa970f1883e1693da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.689221 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eece13d60c42be953340038dfa6ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.691756 882 tablet_service.cc:1511] Processing CreateTablet for tablet aaef17b7249e4f208b672fde4a284590 (DEFAULT_TABLE table=default.Table_3571003422e4455f9f765cf5a1b64104 [id=a756717baa364b769c92265f1387c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.692134 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaef17b7249e4f208b672fde4a284590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.692425 759 tablet_service.cc:1511] Processing CreateTablet for tablet 7986115ad5ff47cf991009f545f0243e (DEFAULT_TABLE table=default.Table_b393ca71b84744349940320f484cae6b [id=b6281aa5ca66412caf362a96f7462f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.692745 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7986115ad5ff47cf991009f545f0243e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.699231 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6b18c4ecb2ca453ea69772cd68244394
I20260503 07:53:07.700284 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.701603 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.701990 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bb606273a187473da6be09b9183a8ec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.702762 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb606273a187473da6be09b9183a8ec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.704017 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b393ca71b84744349940320f484cae6b" } modify_external_catalogs: true
I20260503 07:53:07.704265 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b393ca71b84744349940320f484cae6b" } modify_external_catalogs: true
I20260503 07:53:07.705745 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_87eaff35bf554a20a9dbff384c14205b" } modify_external_catalogs: true
I20260503 07:53:07.705943 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_87eaff35bf554a20a9dbff384c14205b" } modify_external_catalogs: true
I20260503 07:53:07.708240 891 tablet_service.cc:1511] Processing CreateTablet for tablet 7986115ad5ff47cf991009f545f0243e (DEFAULT_TABLE table=default.Table_b393ca71b84744349940320f484cae6b [id=b6281aa5ca66412caf362a96f7462f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.708648 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7986115ad5ff47cf991009f545f0243e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.709784 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a4640dd37e014f91860a4a0647350191"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.710410 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4640dd37e014f91860a4a0647350191 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.717049 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7986115ad5ff47cf991009f545f0243e
I20260503 07:53:07.717725 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:07.719007 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 29fe06a56f70487ea7c479b107d83d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.720338 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 29fe06a56f70487ea7c479b107d83d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.719698 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e453763b83b34fc5a5c811138db3a7d8" } new_table_name: "default.Table_8b3be761059d4713947809373de2bd5d" modify_external_catalogs: true
I20260503 07:53:07.721138 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 7986115ad5ff47cf991009f545f0243e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.721870 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7986115ad5ff47cf991009f545f0243e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.643486 986 leader_election.cc:304] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:07.723044 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 79580.3us
I20260503 07:53:07.723268 986 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:07.690527 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 7986115ad5ff47cf991009f545f0243e (DEFAULT_TABLE table=default.Table_b393ca71b84744349940320f484cae6b [id=b6281aa5ca66412caf362a96f7462f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.724294 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7986115ad5ff47cf991009f545f0243e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.728243 2113 raft_consensus.cc:2804] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:07.701784 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b18c4ecb2ca453ea69772cd68244394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.720292 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 7986115ad5ff47cf991009f545f0243e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:07.728682 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e5283673660476eb689d41ef0daa2d0 consensus state has no leader
I20260503 07:53:07.730854 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6201cd5a177e4929bc6eb8d8ce93a292"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.731586 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6201cd5a177e4929bc6eb8d8ce93a292 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.732223 1952 raft_consensus.cc:2804] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:07.732300 1952 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:07.732353 1952 raft_consensus.cc:3060] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.734629 1952 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.737313 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2339f0b2fa814012a3cc8f330c6fc934"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.737773 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2339f0b2fa814012a3cc8f330c6fc934 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.746332 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4f747befb8f140abb67a16b1cbd92762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.746973 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f747befb8f140abb67a16b1cbd92762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.752718 1952 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.753707 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:07.754290 988 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.757869 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cff2bbd666e14e7bb766e5ae8f4b0a17" } new_table_name: "default.Table_d59831d36779464b849511b4d3640641" modify_external_catalogs: true
I20260503 07:53:07.761020 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50b786a031ce462fae095812adaa3bd2" } new_table_name: "default.Table_c7216ef303724f6fbd5c937325e72d42" modify_external_catalogs: true
I20260503 07:53:07.721347 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 29fe06a56f70487ea7c479b107d83d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:07.766732 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f743fe004124fc5994b9208c78632c1 has no consensus state
I20260503 07:53:07.772033 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]) successfully deleted
I20260503 07:53:07.773756 1175 tablet_replica.cc:333] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:07.774019 1175 raft_consensus.cc:2243] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:07.774400 1175 raft_consensus.cc:2272] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:07.775027 1175 ts_tablet_manager.cc:1916] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:07.779760 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a6359260f55a47dfb599fa173a09f0d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:07.780229 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2339f0b2fa814012a3cc8f330c6fc934" } new_table_name: "default.Table_bacfe879a66646fb88d9daa8623de480" modify_external_catalogs: true
W20260503 07:53:07.780400 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6359260f55a47dfb599fa173a09f0d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.781265 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36d2d4290d3c4cf7accb98c5a7b37c61 consensus state has no leader
I20260503 07:53:07.782495 2433 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:07.785188 916 raft_consensus.cc:3060] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.785887 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fff519033f9848929e462d6f336fc07b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.786319 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fff519033f9848929e462d6f336fc07b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.789196 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1682ce0a78774c818b995cd84ef71c24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:07.790036 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0e624ecc7a044b14861260875b044676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.790520 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e624ecc7a044b14861260875b044676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.791577 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1682ce0a78774c818b995cd84ef71c24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:07.798835 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59a311dc5ec244fab0cdd8e5c1d58cee has no consensus state
I20260503 07:53:07.800854 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4f6c9fb96d5a4397b51611254be1a970
I20260503 07:53:07.806370 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.806636 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.809938 2386 raft_consensus.cc:493] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.810060 2386 raft_consensus.cc:515] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.810592 2386 leader_election.cc:290] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:07.811633 851 leader_election.cc:343] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: fb821b329d284643a889b07f9a4f287e
I20260503 07:53:07.814932 2386 raft_consensus.cc:493] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.815043 2386 raft_consensus.cc:515] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.815519 2386 leader_election.cc:290] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.816180 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.817472 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.825091 1165 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:07.825268 1165 ts_tablet_manager.cc:1403] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.385s user 0.012s sys 0.018s
I20260503 07:53:07.825979 1165 raft_consensus.cc:359] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.826222 1165 raft_consensus.cc:385] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.826304 1165 raft_consensus.cc:740] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.827176 1165 consensus_queue.cc:260] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.832278 2386 raft_consensus.cc:493] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.832399 2386 raft_consensus.cc:515] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.832907 2386 leader_election.cc:290] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:07.833814 851 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:07.835269 1171 tablet_bootstrap.cc:700] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent opening tablet: real 0.226s user 0.002s sys 0.000s
I20260503 07:53:07.835647 1171 tablet_bootstrap.cc:654] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:07.837126 1166 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.065s sys 0.126s
W20260503 07:53:07.837215 1166 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.514s user 0.065s sys 0.126s
I20260503 07:53:07.837961 1166 tablet_bootstrap.cc:492] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.838075 1166 ts_tablet_manager.cc:1403] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.518s user 0.067s sys 0.126s
I20260503 07:53:07.838804 1166 raft_consensus.cc:359] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.838973 1166 raft_consensus.cc:385] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.839020 1166 raft_consensus.cc:740] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.839206 1166 consensus_queue.cc:260] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.839699 1166 ts_tablet_manager.cc:1434] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:07.840032 1166 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.841707 1166 tablet_bootstrap.cc:654] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.843010 2269 raft_consensus.cc:493] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:07.843189 2269 raft_consensus.cc:515] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.844312 2269 leader_election.cc:290] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:07.846065 1022 tablet_service.cc:1511] Processing CreateTablet for tablet aaef17b7249e4f208b672fde4a284590 (DEFAULT_TABLE table=default.Table_3571003422e4455f9f765cf5a1b64104 [id=a756717baa364b769c92265f1387c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.847597 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:07.848135 988 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:07.850232 2419 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:07.859373 1020 tablet_service.cc:1511] Processing CreateTablet for tablet fe33c27548c94942a9a9698040800301 (DEFAULT_TABLE table=default.Table_a14d62ecc9544ee5bc5344a57f1a6c5a [id=db8c346d211e449483a6aa99657b4bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.859683 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_01422e8139cf4d4581613f562e50fef7" } new_table_name: "default.Table_ac0821f2cf694a9d80dbc9315f2410d9" modify_external_catalogs: true
I20260503 07:53:07.859968 896 tablet_service.cc:1511] Processing CreateTablet for tablet fe33c27548c94942a9a9698040800301 (DEFAULT_TABLE table=default.Table_a14d62ecc9544ee5bc5344a57f1a6c5a [id=db8c346d211e449483a6aa99657b4bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.860440 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33c27548c94942a9a9698040800301. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:07.867359 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 146e76e22aa044c389d5c1fb1548f2cc consensus state has no leader
I20260503 07:53:07.871207 2113 raft_consensus.cc:697] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:07.871776 2113 consensus_queue.cc:237] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:07.877413 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 147217us
I20260503 07:53:07.881316 1171 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:07.883117 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_16195c0c53d241ed9b40dce502a92889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.883886 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16195c0c53d241ed9b40dce502a92889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.891885 917 raft_consensus.cc:3060] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.893709 1166 tablet_bootstrap.cc:492] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.893826 1166 ts_tablet_manager.cc:1403] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.000s
I20260503 07:53:07.894563 1166 raft_consensus.cc:359] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.894686 1166 raft_consensus.cc:385] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.894732 1166 raft_consensus.cc:740] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.894932 1166 consensus_queue.cc:260] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.889786 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be0ae78ada34cd88debca569b77d24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.899705 1171 ts_tablet_manager.cc:1403] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.452s user 0.004s sys 0.000s
I20260503 07:53:07.900701 1171 raft_consensus.cc:359] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.901145 1171 raft_consensus.cc:385] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.901247 1171 raft_consensus.cc:740] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.901437 1171 consensus_queue.cc:260] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:07.901917 1166 ts_tablet_manager.cc:1434] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260503 07:53:07.901978 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80eafe625685447b916b4021b04e45a3" } modify_external_catalogs: true
I20260503 07:53:07.902071 1171 ts_tablet_manager.cc:1434] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:07.902200 1166 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.902170 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80eafe625685447b916b4021b04e45a3" } modify_external_catalogs: true
I20260503 07:53:07.902305 1171 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:07.904138 1166 tablet_bootstrap.cc:654] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.909631 882 tablet_service.cc:1511] Processing CreateTablet for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10 (DEFAULT_TABLE table=default.Table_87c17af8fa6744e69eb0677e173f6372 [id=5831bdc5a73a4fd09caaaf04800d0fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.910050 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.912110 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 82f5e16014a34ab9a125d62c72cf2c00
I20260503 07:53:07.913236 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.913681 1166 tablet_bootstrap.cc:492] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.913792 1166 ts_tablet_manager.cc:1403] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260503 07:53:07.914366 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.914459 1166 raft_consensus.cc:359] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.914597 1166 raft_consensus.cc:385] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.914637 1166 raft_consensus.cc:740] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.916204 1166 consensus_queue.cc:260] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.916620 1166 ts_tablet_manager.cc:1434] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:07.916836 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_28f22c3e03ec4fd398b5ca4a0944c93a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.917439 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28f22c3e03ec4fd398b5ca4a0944c93a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.917637 1166 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.918993 1166 tablet_bootstrap.cc:654] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.919651 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_07d524476f694b8ea7ce95c0fc005807" } modify_external_catalogs: true
I20260503 07:53:07.919821 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_07d524476f694b8ea7ce95c0fc005807" } modify_external_catalogs: true
I20260503 07:53:07.920652 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_de8f39e067d944a1aa4452fc4b956897" } modify_external_catalogs: true
I20260503 07:53:07.920790 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_de8f39e067d944a1aa4452fc4b956897" } modify_external_catalogs: true
I20260503 07:53:07.922246 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7052813ac0e842698977de0865a32a09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.922734 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7052813ac0e842698977de0865a32a09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.924337 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbf07a603be411895839aece99fa78c" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:07.855341 746 tablet_service.cc:1511] Processing CreateTablet for tablet aaef17b7249e4f208b672fde4a284590 (DEFAULT_TABLE table=default.Table_3571003422e4455f9f765cf5a1b64104 [id=a756717baa364b769c92265f1387c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.859766 759 tablet_service.cc:1511] Processing CreateTablet for tablet fe33c27548c94942a9a9698040800301 (DEFAULT_TABLE table=default.Table_a14d62ecc9544ee5bc5344a57f1a6c5a [id=db8c346d211e449483a6aa99657b4bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.924923 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33c27548c94942a9a9698040800301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.879678 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:07.928282 772 raft_consensus.cc:2468] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:07.879944 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:07.928555 774 raft_consensus.cc:3060] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:07.929421 1166 tablet_bootstrap.cc:492] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.929527 1166 ts_tablet_manager.cc:1403] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260503 07:53:07.930958 774 raft_consensus.cc:2468] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:07.913040 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 82f5e16014a34ab9a125d62c72cf2c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.931497 1166 raft_consensus.cc:359] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.931653 1166 raft_consensus.cc:385] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.931897 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaef17b7249e4f208b672fde4a284590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:07.932271 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_806f5406fbdd4481879937bfc675fd46" } new_table_name: "default.Table_abba6964721349438039b34fee3f1fc5" modify_external_catalogs: true
I20260503 07:53:07.933372 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 766799446d1a480ca04246b0aec14852
I20260503 07:53:07.934036 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 766799446d1a480ca04246b0aec14852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.931713 1166 raft_consensus.cc:740] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.934501 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 766799446d1a480ca04246b0aec14852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.934602 1166 consensus_queue.cc:260] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.934932 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 766799446d1a480ca04246b0aec14852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.935055 1166 ts_tablet_manager.cc:1434] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260503 07:53:07.935331 1166 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.941073 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5f7ca52fe6064308a6bfe9e1edd07377"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.941620 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f7ca52fe6064308a6bfe9e1edd07377 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.943181 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5f7d50c1575341bca6673a3cd887415e
I20260503 07:53:07.946581 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7d50c1575341bca6673a3cd887415e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:07.947280 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7d50c1575341bca6673a3cd887415e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:07.947520 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7d50c1575341bca6673a3cd887415e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.948021 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_84316b71af09498f9e9a82cde5c24dff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.948658 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84316b71af09498f9e9a82cde5c24dff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.948642 2440 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:07.949717 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:07.950094 1166 tablet_bootstrap.cc:654] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.953689 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10 (DEFAULT_TABLE table=default.Table_87c17af8fa6744e69eb0677e173f6372 [id=5831bdc5a73a4fd09caaaf04800d0fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:07.954504 1165 ts_tablet_manager.cc:1434] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.129s user 0.001s sys 0.001s
W20260503 07:53:07.956719 854 leader_election.cc:343] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: fb821b329d284643a889b07f9a4f287e
I20260503 07:53:07.956826 854 leader_election.cc:304] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:07.957185 2386 raft_consensus.cc:2749] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:07.957883 854 leader_election.cc:304] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:07.958688 986 consensus_peers.cc:597] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 376e9889ca584931ac1d91a9af2c0689. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:07.967377 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9e72e720c3b648e1a5ca3e5765a300a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.968075 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e72e720c3b648e1a5ca3e5765a300a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.970163 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8d86476402b74bc1b5074ad74a7f08ab" } new_table_name: "default.Table_11cf25210559486dacae5baa7290ef46" modify_external_catalogs: true
W20260503 07:53:07.971045 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef0d8dca80f242b189f234634991a542 consensus state has no leader
I20260503 07:53:07.976886 2441 tablet.cc:1724] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:07.983636 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_20bbc89839134833b8f8a1091842a6e1" } new_table_name: "default.Table_63cc09a4856c4cc08931aa979733076a" modify_external_catalogs: true
I20260503 07:53:07.986744 1166 tablet_bootstrap.cc:492] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:07.986896 1166 ts_tablet_manager.cc:1403] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.003s
I20260503 07:53:07.987718 1166 raft_consensus.cc:359] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.987926 1166 raft_consensus.cc:385] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:07.987979 1166 raft_consensus.cc:740] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:07.988204 1166 consensus_queue.cc:260] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:07.988548 1166 ts_tablet_manager.cc:1434] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:07.988745 1166 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:07.989379 1165 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:07.990473 1166 tablet_bootstrap.cc:654] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.990751 1165 tablet_bootstrap.cc:654] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:07.994575 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b3776feee53c4ed8bf22d4354fd716ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:07.995733 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3776feee53c4ed8bf22d4354fd716ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:07.998838 1174 ts_tablet_manager.cc:1929] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.000087 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bd253e88034b45349bd86e73bdbdf0ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:08.000473 882 tablet_service.cc:1511] Processing CreateTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 (DEFAULT_TABLE table=default.Table_43d39570e97b440c823a2857ed6d3740 [id=402cd3eb1e514b20a0991c7b20af2b4f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.000563 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd253e88034b45349bd86e73bdbdf0ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.000837 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e47796d8f924117bcc5dcc5cf958874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.001118 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_177808a7b6234be8a8f79c240c720c85" } new_table_name: "default.Table_9f7bf46f985b4f68940463369aabab9b" modify_external_catalogs: true
I20260503 07:53:08.003618 1166 tablet_bootstrap.cc:492] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.003778 1166 ts_tablet_manager.cc:1403] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.002s
I20260503 07:53:08.004227 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2bc82c1725174620b6c53f604e2e9583"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:08.004592 1166 raft_consensus.cc:359] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.004729 1166 raft_consensus.cc:385] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.004771 1166 raft_consensus.cc:740] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:08.004767 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bc82c1725174620b6c53f604e2e9583 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.003074 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.004948 1166 consensus_queue.cc:260] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:08.005472 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 46811.4us
I20260503 07:53:08.005771 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33c27548c94942a9a9698040800301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.006204 986 leader_election.cc:304] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.006469 2431 raft_consensus.cc:2804] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:08.006534 2431 raft_consensus.cc:493] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:08.006587 2431 raft_consensus.cc:3060] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.008373 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaef17b7249e4f208b672fde4a284590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.009332 2431 raft_consensus.cc:515] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.010226 2433 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.010289 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_839fac2b5d174a708e3cda5fdd780baa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:08.010579 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:08.010725 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_839fac2b5d174a708e3cda5fdd780baa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:08.011096 988 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.011322 2431 leader_election.cc:290] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.014914 1171 tablet_bootstrap.cc:654] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.018469 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f8c37663d2a64a7f8a8f88d4a86e5280" } modify_external_catalogs: true
I20260503 07:53:08.018659 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f8c37663d2a64a7f8a8f88d4a86e5280" } modify_external_catalogs: true
I20260503 07:53:08.022572 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:08.037791 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 (DEFAULT_TABLE table=default.Table_43d39570e97b440c823a2857ed6d3740 [id=402cd3eb1e514b20a0991c7b20af2b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.040341 916 raft_consensus.cc:3060] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:08.047099 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 89229us
W20260503 07:53:08.047501 854 leader_election.cc:343] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:08.047665 854 leader_election.cc:304] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.049592 2446 raft_consensus.cc:493] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.049752 2446 raft_consensus.cc:515] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.050587 2446 leader_election.cc:290] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.050724 2446 raft_consensus.cc:2749] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.075676 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7426b06e1445432aab9f7f43f7b5ff39" } new_table_name: "default.Table_b2e3381e4c8441d0b9f0bd694a4b6f03" modify_external_catalogs: true
W20260503 07:53:08.085774 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81403b8a897b4e58a0f301d36d76dc8a consensus state has no leader
I20260503 07:53:08.093750 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4" } modify_external_catalogs: true
I20260503 07:53:08.094089 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7dc759257d4a4d2c8dc6c72f0df7edf4" } modify_external_catalogs: true
I20260503 07:53:08.095619 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e8cc570d68984efa918c9669ee2cba83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.096226 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8cc570d68984efa918c9669ee2cba83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:08.097114 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 90932.8us
I20260503 07:53:08.100746 1166 ts_tablet_manager.cc:1434] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.097s user 0.014s sys 0.014s
I20260503 07:53:08.101074 1166 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.102614 1166 tablet_bootstrap.cc:654] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.107822 2440 tablet.cc:1724] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:08.114427 2386 raft_consensus.cc:2749] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.116487 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 841) took 1208 ms. Trace:
I20260503 07:53:08.119459 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3c5ac9e941434804bf7d8bd8208dcf4a" } modify_external_catalogs: true
I20260503 07:53:08.119652 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3c5ac9e941434804bf7d8bd8208dcf4a" } modify_external_catalogs: true
I20260503 07:53:08.120990 593 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 782dd5de6cec4b1db17a65a8914c1d51
I20260503 07:53:08.121011 1173 rpcz_store.cc:276] 0503 07:53:06.907618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.907770 (+ 152us) service_pool.cc:224] Handling call
0503 07:53:07.358247 (+450477us) ts_tablet_manager.cc:1151] Deleting tablet 92c1709a2a49475daaa2372360610b1e
0503 07:53:07.358257 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:07.365907 (+ 7650us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.368539 (+ 2632us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.116468 (+747929us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":384771}
I20260503 07:53:08.121590 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 92c1709a2a49475daaa2372360610b1e (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]) successfully deleted
I20260503 07:53:08.122797 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]). Expected version 1 got 0
I20260503 07:53:08.124478 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eb362fee7bc4f948d3a5b660e9cbd1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.125527 882 tablet_service.cc:1511] Processing CreateTablet for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6 (DEFAULT_TABLE table=default.Table_3d89f1787e5a40f48708c777ff164671 [id=34138ab6ae704cab9b2f843ae59f4029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.125985 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.126533 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ebec2b05025444ccaf0bf0bb4ab62dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.127189 891 tablet_service.cc:1558] Processing DeleteTablet for tablet e16d225dde3247d1b61a03cf14b21d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:52 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.127880 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb4d150eadb479d9978f2450637bd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.132429 2386 raft_consensus.cc:493] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.132534 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 847) took 1167 ms. Trace:
I20260503 07:53:08.132582 2386 raft_consensus.cc:515] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.132608 1173 rpcz_store.cc:276] 0503 07:53:06.964884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.964960 (+ 76us) service_pool.cc:224] Handling call
0503 07:53:08.132415 (+1167455us) ts_tablet_manager.cc:1151] Deleting tablet 6ae4a8f39d67459dbb80c72947ae7005
0503 07:53:08.132425 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.132517 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152075}
W20260503 07:53:08.133037 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6ae4a8f39d67459dbb80c72947ae7005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae4a8f39d67459dbb80c72947ae7005 already in progress: creating tablet
I20260503 07:53:08.133368 2386 leader_election.cc:290] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.134092 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_a7c5e2fc2ee44029bc64a302a042a3fc [id=42229936a86a4dc29d6c778f946c494e] alter complete (version 3)
I20260503 07:53:08.135211 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e47796d8f924117bcc5dcc5cf958874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.135618 1171 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:08.136106 1171 ts_tablet_manager.cc:1403] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.234s user 0.003s sys 0.000s
I20260503 07:53:08.137555 1171 raft_consensus.cc:359] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.137784 1171 raft_consensus.cc:385] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.137892 1171 raft_consensus.cc:740] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.138279 1171 consensus_queue.cc:260] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:08.139497 988 consensus_peers.cc:597] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:08.143589 986 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:08.143955 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 46620.6us
I20260503 07:53:08.144253 2431 raft_consensus.cc:2804] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:08.144347 2431 raft_consensus.cc:697] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:08.144542 2431 consensus_queue.cc:237] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.145445 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 849) took 1131 ms. Trace:
I20260503 07:53:08.145515 1173 rpcz_store.cc:276] 0503 07:53:07.014253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.015257 (+ 1004us) service_pool.cc:224] Handling call
0503 07:53:08.145328 (+1130071us) ts_tablet_manager.cc:1151] Deleting tablet cec0b36fdcf64042bc87446977b9dcca
0503 07:53:08.145339 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.145426 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1129896}
I20260503 07:53:08.145789 1173 tablet_replica.cc:333] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:53:08.145968 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet cec0b36fdcf64042bc87446977b9dcca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cec0b36fdcf64042bc87446977b9dcca already in progress: creating tablet
W20260503 07:53:08.148010 851 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:08.151726 596 master_service.cc:954] ReplaceTablet: received request to replace tablet 78b3210d1ecd42198e080b02a8b594a5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:08.153131 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6 (DEFAULT_TABLE table=default.Table_3d89f1787e5a40f48708c777ff164671 [id=34138ab6ae704cab9b2f843ae59f4029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.155920 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.160233 1171 ts_tablet_manager.cc:1434] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260503 07:53:08.161211 1173 raft_consensus.cc:2243] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:08.164649 1173 raft_consensus.cc:2272] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.165956 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 96664f8cbd6141e8b5728ef9d67d7487 (DEFAULT_TABLE table=default.Table_a589c6a2ec3d420c8f18b89e4d67ab25 [id=05d51ff3c3b04c3f858cf7196d668138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.166302 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96664f8cbd6141e8b5728ef9d67d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.166790 1171 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:08.170853 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.170372 917 raft_consensus.cc:3060] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:08.175499 854 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:08.026386 2298 raft_consensus.cc:493] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.194103 2298 raft_consensus.cc:515] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.194831 2298 leader_election.cc:290] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.195384 1174 log.cc:1199] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/9e162006cee34182b51f97629a174509
I20260503 07:53:08.053802 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9edbc50a8e4194a46ecb1666daa5f1" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:08.054406 746 tablet_service.cc:1511] Processing CreateTablet for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10 (DEFAULT_TABLE table=default.Table_87c17af8fa6744e69eb0677e173f6372 [id=5831bdc5a73a4fd09caaaf04800d0fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.090184 2454 raft_consensus.cc:493] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.118301 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0e47796d8f924117bcc5dcc5cf958874 (DEFAULT_TABLE table=default.Table_43d39570e97b440c823a2857ed6d3740 [id=402cd3eb1e514b20a0991c7b20af2b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.146232 760 tablet_service.cc:1511] Processing CreateTablet for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6 (DEFAULT_TABLE table=default.Table_3d89f1787e5a40f48708c777ff164671 [id=34138ab6ae704cab9b2f843ae59f4029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.197660 2454 raft_consensus.cc:515] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.198387 2454 leader_election.cc:290] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.199067 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.203510 2434 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.204674 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e47796d8f924117bcc5dcc5cf958874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.204944 1175 ts_tablet_manager.cc:1929] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:08.205034 1175 log.cc:1199] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/6a2a1079ce0e4e6da9779ccd401e98f9
I20260503 07:53:08.208657 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a1e7d8e3d94bf4ae50e44031ccbc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.209225 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b5f948770f824e1987b35e0fdc9057cb" } modify_external_catalogs: true
I20260503 07:53:08.209434 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b5f948770f824e1987b35e0fdc9057cb" } modify_external_catalogs: true
I20260503 07:53:08.187121 854 leader_election.cc:304] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.211588 2386 raft_consensus.cc:2749] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.211721 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_587c420b7b004b84bace3e688ccd2dd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:08.211836 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_34513bbe165b4f238b34c137287c79c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:08.185582 1173 ts_tablet_manager.cc:1916] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:08.212854 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34513bbe165b4f238b34c137287c79c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.212471 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:08.213449 715 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:08.214015 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_587c420b7b004b84bace3e688ccd2dd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.214458 2468 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.215304 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:08.196957 851 leader_election.cc:304] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.212462 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:08.192312 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0d1656b9284e67887fb317e86e7309 (DEFAULT_TABLE table=default.Table_6e09b789a20347d88774fe43031bfa7b [id=f05c619ad6874fc2bd39c11d7b9badd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.217198 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0d1656b9284e67887fb317e86e7309. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.220233 715 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.221343 1171 tablet_bootstrap.cc:654] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.147090 2457 raft_consensus.cc:493] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.223913 2457 raft_consensus.cc:515] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.224551 2457 leader_election.cc:290] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.150931 1165 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:08.164556 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce16dd96cf04ae293601108381a2a47" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:08.226257 774 raft_consensus.cc:3060] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.226259 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:08.228513 879 tablet_service.cc:1511] Processing CreateTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 (DEFAULT_TABLE table=default.Table_6bfd9bf351fb41e4bd497d54a607e041 [id=59f0a8b5e3f04fd1a525d0f9a132f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.228649 774 raft_consensus.cc:2468] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:08.228899 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bff2e711dc43a7b8757df95f3173b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.165709 2441 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.190965 742 tablet_service.cc:1511] Processing CreateTablet for tablet 96664f8cbd6141e8b5728ef9d67d7487 (DEFAULT_TABLE table=default.Table_a589c6a2ec3d420c8f18b89e4d67ab25 [id=05d51ff3c3b04c3f858cf7196d668138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.230700 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96664f8cbd6141e8b5728ef9d67d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.233662 896 tablet_service.cc:1511] Processing CreateTablet for tablet 96664f8cbd6141e8b5728ef9d67d7487 (DEFAULT_TABLE table=default.Table_a589c6a2ec3d420c8f18b89e4d67ab25 [id=05d51ff3c3b04c3f858cf7196d668138]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.236277 715 leader_election.cc:343] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.226257 1165 ts_tablet_manager.cc:1403] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.237s user 0.001s sys 0.001s
I20260503 07:53:08.238382 1165 raft_consensus.cc:359] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.238586 1165 raft_consensus.cc:385] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.238673 1165 raft_consensus.cc:740] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.238732 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96664f8cbd6141e8b5728ef9d67d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.239806 1165 consensus_queue.cc:260] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.240341 1165 ts_tablet_manager.cc:1434] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:08.240571 1165 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:08.241889 1165 tablet_bootstrap.cc:654] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.196055 1174 ts_tablet_manager.cc:1950] T 9e162006cee34182b51f97629a174509 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:08.246762 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 820) took 2653 ms. Trace:
I20260503 07:53:08.246903 1174 rpcz_store.cc:276] 0503 07:53:05.593711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.597330 (+ 3619us) service_pool.cc:224] Handling call
0503 07:53:07.413242 (+1815912us) ts_tablet_manager.cc:1151] Deleting tablet 9e162006cee34182b51f97629a174509
0503 07:53:07.413252 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:07.923729 (+510477us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:07.998780 (+ 75051us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.246743 (+247963us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815794}
I20260503 07:53:08.247319 1174 tablet_replica.cc:333] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:08.247545 1174 raft_consensus.cc:2243] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:08.247879 1174 raft_consensus.cc:2272] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.248314 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 9e162006cee34182b51f97629a174509 (table default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]) successfully deleted
I20260503 07:53:08.230713 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0d1656b9284e67887fb317e86e7309 (DEFAULT_TABLE table=default.Table_6e09b789a20347d88774fe43031bfa7b [id=f05c619ad6874fc2bd39c11d7b9badd6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.193704 716 consensus_peers.cc:597] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c25addae8c94554a83344f07a11362f. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:08.249796 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 56126.6us
W20260503 07:53:08.250036 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a3724490a7ed4afc82e4f7ebc1190f76 (table default.Table_eb80e7b5f0714315aee7abdfca47508b [id=055e6ecd2ba14952b43509d286d41628], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet a3724490a7ed4afc82e4f7ebc1190f76 consensus state has no leader
I20260503 07:53:08.221551 1175 ts_tablet_manager.cc:1950] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:08.249022 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0d1656b9284e67887fb317e86e7309 (DEFAULT_TABLE table=default.Table_6e09b789a20347d88774fe43031bfa7b [id=f05c619ad6874fc2bd39c11d7b9badd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.250645 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.250818 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.252537 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0d1656b9284e67887fb317e86e7309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.250970 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:08.253769 1018 consensus_meta.cc:287] T 20eece13d60c42be953340038dfa6ff2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent flushing consensus metadata: real 0.906s user 0.018s sys 0.000s
W20260503 07:53:08.253971 716 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.254158 716 leader_election.cc:304] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:08.254755 716 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.254909 716 leader_election.cc:304] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.255262 2454 raft_consensus.cc:2749] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.255082 2457 raft_consensus.cc:2749] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.257973 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_dd7d9967fbc34ca8bcb7afd287593396" } modify_external_catalogs: true
I20260503 07:53:08.258224 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_dd7d9967fbc34ca8bcb7afd287593396" } modify_external_catalogs: true
W20260503 07:53:08.263613 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96f77e858c4e4b6f8d918f6e735ff340 has no consensus state
I20260503 07:53:08.266215 1166 tablet_bootstrap.cc:492] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.266338 1166 ts_tablet_manager.cc:1403] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.165s user 0.019s sys 0.057s
I20260503 07:53:08.266987 1166 raft_consensus.cc:359] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.267160 1166 raft_consensus.cc:385] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.267204 1166 raft_consensus.cc:740] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.267378 1166 consensus_queue.cc:260] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.267992 1166 ts_tablet_manager.cc:1434] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.270532 1166 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.272302 1166 tablet_bootstrap.cc:654] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.283360 1166 tablet_bootstrap.cc:492] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.283478 1166 ts_tablet_manager.cc:1403] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20260503 07:53:08.284189 1166 raft_consensus.cc:359] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.284355 1166 raft_consensus.cc:385] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.284415 1166 raft_consensus.cc:740] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.284616 1166 consensus_queue.cc:260] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.285199 1166 ts_tablet_manager.cc:1434] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:08.286396 1166 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.288005 1166 tablet_bootstrap.cc:654] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.291220 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e66033d0ee71439cba1545815aa5213f
I20260503 07:53:08.293503 742 tablet_service.cc:1558] Processing DeleteTablet for tablet e66033d0ee71439cba1545815aa5213f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:08.294354 879 tablet_service.cc:1558] Processing DeleteTablet for tablet e66033d0ee71439cba1545815aa5213f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.297055 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet ce181da64bad49389a64df1ade0e90ef (table default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775]). Expected version 1 got 0
I20260503 07:53:08.299188 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2f9dd118b5dc4939baed5ff4f8b624e5" } new_table_name: "default.Table_eb0a4f9c639f4edc917ea62eddfcdd04" modify_external_catalogs: true
I20260503 07:53:08.300009 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 596130e78eb1444a96480fc1075478cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.300067 1166 tablet_bootstrap.cc:492] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.300243 1166 ts_tablet_manager.cc:1403] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260503 07:53:08.301002 1166 raft_consensus.cc:359] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.301192 1166 raft_consensus.cc:385] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.301244 1166 raft_consensus.cc:740] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.301462 1166 consensus_queue.cc:260] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.302021 1166 ts_tablet_manager.cc:1434] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:08.302273 1166 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.303583 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 3650ec1de28c4f1bafd979257dd2b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.303889 1166 tablet_bootstrap.cc:654] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.308686 2441 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.309998 2419 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.313345 1166 tablet_bootstrap.cc:492] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.313465 1166 ts_tablet_manager.cc:1403] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260503 07:53:08.314213 1166 raft_consensus.cc:359] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.314371 1166 raft_consensus.cc:385] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.314430 1166 raft_consensus.cc:740] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.314637 1166 consensus_queue.cc:260] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.315223 1166 ts_tablet_manager.cc:1434] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:08.315615 1166 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.317328 742 tablet_service.cc:1511] Processing CreateTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 (DEFAULT_TABLE table=default.Table_6bfd9bf351fb41e4bd497d54a607e041 [id=59f0a8b5e3f04fd1a525d0f9a132f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.317628 1166 tablet_bootstrap.cc:654] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:08.320276 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 65685.2us
I20260503 07:53:08.320429 760 tablet_service.cc:1511] Processing CreateTablet for tablet 351b2289fa394e4296a70c18f99ea21e (DEFAULT_TABLE table=default.Table_b5bdfb4adf594f41a537ae43bb0f9f7e [id=ee75160e65454297be3afec0e11d4020]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.320549 716 leader_election.cc:343] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.320669 716 leader_election.cc:304] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.320785 751 tablet_service.cc:1511] Processing CreateTablet for tablet c101375191f941648f3a0880a4bde6b9 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.320971 2454 raft_consensus.cc:2749] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.320958 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_63cc09a4856c4cc08931aa979733076a [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 3 got 0
I20260503 07:53:08.321189 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet b7a65f69a6c145438e8c721fe2096080 (table default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664]). Expected version 1 got 0
I20260503 07:53:08.329468 601 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet f71cae146be44ea780aa55e7e3ac32ba
I20260503 07:53:08.335808 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8d9a6df25a9a4a289f66f8ffcbfe546a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.336386 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d9a6df25a9a4a289f66f8ffcbfe546a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.343935 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0d1656b9284e67887fb317e86e7309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.349488 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bff2e711dc43a7b8757df95f3173b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.352511 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351b2289fa394e4296a70c18f99ea21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.355789 594 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 993833e5b4c24e189562fabe2ec6dd55
I20260503 07:53:08.356432 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c101375191f941648f3a0880a4bde6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.358243 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ed54f32e26104932829e79bdf8b2f30f" } new_table_name: "default.Table_7304bba45276469fb11717cd6aa019d3" modify_external_catalogs: true
I20260503 07:53:08.360917 1166 tablet_bootstrap.cc:492] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.361066 1166 ts_tablet_manager.cc:1403] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.008s
I20260503 07:53:08.361876 1166 raft_consensus.cc:359] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.362092 1166 raft_consensus.cc:385] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.362174 1166 raft_consensus.cc:740] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.362385 1166 consensus_queue.cc:260] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.362917 1166 ts_tablet_manager.cc:1434] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.363224 1166 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.364890 1166 tablet_bootstrap.cc:654] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.367348 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 78b3210d1ecd42198e080b02a8b594a5
I20260503 07:53:08.367857 596 catalog_manager.cc:6741] ReplaceTablet: tablet 78b3210d1ecd42198e080b02a8b594a5 deleted and replaced by tablet db375404b0a34b6b9310b61182a40e79
I20260503 07:53:08.369913 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 with delete_type TABLET_DATA_DELETED (replaced by tablet db375404b0a34b6b9310b61182a40e79) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:08.371362 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_51d7f64d591047159048f9395ddbf407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.371994 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51d7f64d591047159048f9395ddbf407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.377023 1174 ts_tablet_manager.cc:1916] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:08.381415 1166 tablet_bootstrap.cc:492] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.381995 1166 ts_tablet_manager.cc:1403] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
I20260503 07:53:08.382751 1166 raft_consensus.cc:359] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.382915 1166 raft_consensus.cc:385] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.382982 1166 raft_consensus.cc:740] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.383236 1166 consensus_queue.cc:260] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.383267 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_08e346119e8646e4bc01a72cc216b6ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.383802 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08e346119e8646e4bc01a72cc216b6ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.383802 1166 ts_tablet_manager.cc:1434] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.384155 1166 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.385730 1166 tablet_bootstrap.cc:654] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.397033 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c9457d5693eb4f3da5501a0e581fe75c
I20260503 07:53:08.397740 1018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47074 (request call id 954) took 1054 ms. Trace:
I20260503 07:53:08.398226 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_01432a8a7eac48f3b2d392e5ee734b0e" } new_table_name: "default.Table_b288cc53a01f44898720edb61d592e17" modify_external_catalogs: true
I20260503 07:53:08.398247 1018 rpcz_store.cc:276] 0503 07:53:07.343335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.343379 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:07.343688 (+ 309us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:07.343710 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:07.347300 (+ 3590us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.397555 (+1050255us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:08.397706 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:08.398869 882 tablet_service.cc:1511] Processing CreateTablet for tablet 351b2289fa394e4296a70c18f99ea21e (DEFAULT_TABLE table=default.Table_b5bdfb4adf594f41a537ae43bb0f9f7e [id=ee75160e65454297be3afec0e11d4020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.399314 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351b2289fa394e4296a70c18f99ea21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.400509 1166 tablet_bootstrap.cc:492] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.400629 1166 ts_tablet_manager.cc:1403] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s
I20260503 07:53:08.400898 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b3a1aceccf7a4cebbb1849e7d7ae8d32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.401417 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3a1aceccf7a4cebbb1849e7d7ae8d32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.401466 1166 raft_consensus.cc:359] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.401633 1166 raft_consensus.cc:385] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.401685 1166 raft_consensus.cc:740] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.401873 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c9457d5693eb4f3da5501a0e581fe75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:08.401895 1166 consensus_queue.cc:260] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.258610 986 leader_election.cc:304] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.402355 2113 raft_consensus.cc:2804] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:08.402420 896 tablet_service.cc:1558] Processing DeleteTablet for tablet c9457d5693eb4f3da5501a0e581fe75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:08.402426 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 143834us
I20260503 07:53:08.402513 1166 ts_tablet_manager.cc:1434] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:08.259219 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 910) took 1703 ms. Trace:
I20260503 07:53:08.402683 2113 raft_consensus.cc:697] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:08.402731 1166 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.402704 1175 rpcz_store.cc:276] 0503 07:53:06.556167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.556297 (+ 130us) service_pool.cc:224] Handling call
0503 07:53:07.773703 (+1217406us) ts_tablet_manager.cc:1151] Deleting tablet 6a2a1079ce0e4e6da9779ccd401e98f9
0503 07:53:07.773713 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.003153 (+229440us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.204894 (+201741us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.259200 (+ 54306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6496,"tablet-delete.queue_time_us":1217220}
I20260503 07:53:08.402917 2113 consensus_queue.cc:237] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.403028 1175 tablet_replica.cc:333] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:08.403170 1175 raft_consensus.cc:2243] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:08.317329 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 (DEFAULT_TABLE table=default.Table_6bfd9bf351fb41e4bd497d54a607e041 [id=59f0a8b5e3f04fd1a525d0f9a132f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.403469 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bff2e711dc43a7b8757df95f3173b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.321960 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 351b2289fa394e4296a70c18f99ea21e (DEFAULT_TABLE table=default.Table_b5bdfb4adf594f41a537ae43bb0f9f7e [id=ee75160e65454297be3afec0e11d4020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.404203 1166 tablet_bootstrap.cc:654] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.404510 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351b2289fa394e4296a70c18f99ea21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.404597 2386 raft_consensus.cc:2749] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.406286 2386 raft_consensus.cc:493] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.406389 2386 raft_consensus.cc:515] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.406906 2386 leader_election.cc:290] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:08.407903 851 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:08.411525 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]) successfully deleted
I20260503 07:53:08.415307 2433 tablet.cc:1724] T b7a65f69a6c145438e8c721fe2096080 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:08.415521 896 tablet_service.cc:1511] Processing CreateTablet for tablet c101375191f941648f3a0880a4bde6b9 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.415912 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c101375191f941648f3a0880a4bde6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.420847 1166 tablet_bootstrap.cc:492] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.420967 1166 ts_tablet_manager.cc:1403] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260503 07:53:08.421780 1166 raft_consensus.cc:359] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.421938 1166 raft_consensus.cc:385] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.421988 1166 raft_consensus.cc:740] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.422256 1166 consensus_queue.cc:260] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.422828 1166 ts_tablet_manager.cc:1434] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.423105 1166 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.424547 1175 raft_consensus.cc:2272] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.424739 1166 tablet_bootstrap.cc:654] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.425021 1175 ts_tablet_manager.cc:1916] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:08.425582 2441 tablet.cc:1724] T b7a65f69a6c145438e8c721fe2096080 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:08.428092 1165 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:08.428237 1165 ts_tablet_manager.cc:1403] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.188s user 0.003s sys 0.000s
I20260503 07:53:08.428917 1165 raft_consensus.cc:359] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.429082 1165 raft_consensus.cc:385] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.429126 1165 raft_consensus.cc:740] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.431262 896 tablet_service.cc:1511] Processing CreateTablet for tablet 56d5a84f62f446c488a7e02be814a26c (DEFAULT_TABLE table=default.Table_06bac08106464609a451d7c139e2675c [id=91db2de019cc4654be45809d1f69a543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.431644 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d5a84f62f446c488a7e02be814a26c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.433295 854 leader_election.cc:343] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:08.433426 854 leader_election.cc:304] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.433790 2386 raft_consensus.cc:2749] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.327203 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e66033d0ee71439cba1545815aa5213f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:08.435817 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c9457d5693eb4f3da5501a0e581fe75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:08.436093 2386 raft_consensus.cc:493] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.436259 2386 raft_consensus.cc:515] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.436856 2386 leader_election.cc:290] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.437705 1166 tablet_bootstrap.cc:492] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.437865 1166 ts_tablet_manager.cc:1403] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
W20260503 07:53:08.438290 851 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:08.438627 1166 raft_consensus.cc:359] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:08.438680 854 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:08.438820 854 leader_election.cc:304] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.439024 2386 raft_consensus.cc:2749] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.439198 1166 raft_consensus.cc:385] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.439284 1166 raft_consensus.cc:740] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.439522 1166 consensus_queue.cc:260] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.440328 1166 ts_tablet_manager.cc:1434] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.440587 1166 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.440537 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 56d5a84f62f446c488a7e02be814a26c (DEFAULT_TABLE table=default.Table_06bac08106464609a451d7c139e2675c [id=91db2de019cc4654be45809d1f69a543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.440940 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d5a84f62f446c488a7e02be814a26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.441982 1166 tablet_bootstrap.cc:654] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.446972 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c101375191f941648f3a0880a4bde6b9 (DEFAULT_TABLE table=default.Table_e3fd6ab7214941de9e623fcb64c4f23f [id=6b575c55854448339c4f34a35d34d746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.447347 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c101375191f941648f3a0880a4bde6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.456558 2386 raft_consensus.cc:493] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.456683 2386 raft_consensus.cc:515] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.456816 2113 consensus_queue.cc:1048] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:08.457293 2386 leader_election.cc:290] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.439528 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 with delete_type TABLET_DATA_DELETED (replaced by tablet db375404b0a34b6b9310b61182a40e79) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:08.458137 851 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:08.458315 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskCEB381/build/asan/bin/kudu pid 1235
W20260503 07:53:08.460620 854 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:08.460721 854 leader_election.cc:304] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.461215 2386 raft_consensus.cc:2749] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.463675 1175 ts_tablet_manager.cc:1929] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.384395 1171 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:08.471860 1171 ts_tablet_manager.cc:1403] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.306s user 0.005s sys 0.000s
I20260503 07:53:08.385366 2434 tablet.cc:1724] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:08.472190 742 tablet_service.cc:1511] Processing CreateTablet for tablet bda89822863d4f70bc6f115dc2f808c8 (DEFAULT_TABLE table=default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b [id=e3ea35691df94710a2d02b985a3e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.472584 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda89822863d4f70bc6f115dc2f808c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.473387 1171 raft_consensus.cc:359] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.473560 1171 raft_consensus.cc:385] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.473623 1171 raft_consensus.cc:740] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.473840 1171 consensus_queue.cc:260] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.474339 1171 ts_tablet_manager.cc:1434] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:08.474850 1171 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:08.476408 759 tablet_service.cc:1511] Processing CreateTablet for tablet 56d5a84f62f446c488a7e02be814a26c (DEFAULT_TABLE table=default.Table_06bac08106464609a451d7c139e2675c [id=91db2de019cc4654be45809d1f69a543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.476784 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d5a84f62f446c488a7e02be814a26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.476826 1171 tablet_bootstrap.cc:654] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.483470 891 tablet_service.cc:1511] Processing CreateTablet for tablet bda89822863d4f70bc6f115dc2f808c8 (DEFAULT_TABLE table=default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b [id=e3ea35691df94710a2d02b985a3e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.483917 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda89822863d4f70bc6f115dc2f808c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.485265 599 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_63cc09a4856c4cc08931aa979733076a [id=63f0f416d7c54be89355008b47b3c7a7] alter complete (version 3)
I20260503 07:53:08.487020 879 tablet_service.cc:1558] Processing DeleteTablet for tablet b5bdaa3dd3a844d8b57def2b9faa03d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:08.488860 1173 ts_tablet_manager.cc:1929] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.488968 1173 log.cc:1199] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d58deacb99c643d89a6641ef09b026ba
I20260503 07:53:08.489259 1173 ts_tablet_manager.cc:1950] T d58deacb99c643d89a6641ef09b026ba P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:08.502172 1165 consensus_queue.cc:260] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.384271 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 78b3210d1ecd42198e080b02a8b594a5 with delete_type TABLET_DATA_DELETED (replaced by tablet db375404b0a34b6b9310b61182a40e79) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:08.467825 988 consensus_peers.cc:597] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:08.506767 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bda89822863d4f70bc6f115dc2f808c8 (DEFAULT_TABLE table=default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b [id=e3ea35691df94710a2d02b985a3e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.507292 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda89822863d4f70bc6f115dc2f808c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.512140 988 consensus_peers.cc:597] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:08.514972 1174 ts_tablet_manager.cc:1929] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.515143 1174 log.cc:1199] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:08.515538 1174 ts_tablet_manager.cc:1950] T 5ce16dd96cf04ae293601108381a2a47 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:08.517807 1165 ts_tablet_manager.cc:1434] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.089s user 0.002s sys 0.000s
I20260503 07:53:08.524211 1165 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:08.526865 879 tablet_service.cc:1511] Processing CreateTablet for tablet 32564d43180741f396c4682c32c29f43 (DEFAULT_TABLE table=default.Table_899ab16c8fbf4137b5e1a2b331af4feb [id=926515a71b294dcd802cb3c571d5fb3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.527256 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32564d43180741f396c4682c32c29f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.528717 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc50575cb85463d862e95757a35cfd5 (DEFAULT_TABLE table=default.Table_6644f47cf4974ac28fcc3d3529d0b88f [id=d7dd66e25d6649ca8cb9f4aba4675f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.529057 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc50575cb85463d862e95757a35cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.533969 1175 log.cc:1199] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/a117f416c611418a96963db600da1d04
I20260503 07:53:08.534368 1175 ts_tablet_manager.cc:1950] T a117f416c611418a96963db600da1d04 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:08.535111 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 912) took 1961 ms. Trace:
I20260503 07:53:08.535277 1175 rpcz_store.cc:276] 0503 07:53:06.574051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.575678 (+ 1627us) service_pool.cc:224] Handling call
0503 07:53:08.402985 (+1827307us) ts_tablet_manager.cc:1151] Deleting tablet a117f416c611418a96963db600da1d04
0503 07:53:08.402995 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.427655 (+ 24660us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.463629 (+ 35974us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.535093 (+ 71464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21216,"tablet-delete.queue_time_us":1826697}
I20260503 07:53:08.535880 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet a117f416c611418a96963db600da1d04 (table default.Table_ae5c088a97ba4ae4b68eaa5de9349bff [id=5a2aa391752141b78b08192babdec820]) successfully deleted
I20260503 07:53:08.537714 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e009ce0a5d9049d1b5f056b835c6f25a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.538233 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e009ce0a5d9049d1b5f056b835c6f25a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.539363 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cdfd677bac8248749219a17f174d571b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.539837 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdfd677bac8248749219a17f174d571b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.540949 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_90dc37ff14be4d1e964da0574ac9bd31" } new_table_name: "default.Table_fc2f1060428149818159c2074b32f1f0" modify_external_catalogs: true
I20260503 07:53:08.542419 2269 raft_consensus.cc:493] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.542531 2269 raft_consensus.cc:515] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.542971 2386 raft_consensus.cc:493] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.543048 2269 leader_election.cc:290] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.543140 2386 raft_consensus.cc:515] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.543365 896 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc50575cb85463d862e95757a35cfd5 (DEFAULT_TABLE table=default.Table_6644f47cf4974ac28fcc3d3529d0b88f [id=d7dd66e25d6649ca8cb9f4aba4675f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.543696 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc50575cb85463d862e95757a35cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.543778 2386 leader_election.cc:290] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.544064 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:08.544297 780 raft_consensus.cc:2468] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:08.544953 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:08.545404 851 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:08.545462 986 leader_election.cc:304] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:08.545754 854 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:08.545845 854 leader_election.cc:304] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.546180 2269 raft_consensus.cc:2804] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:08.546248 2269 raft_consensus.cc:493] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:08.546309 2269 raft_consensus.cc:3060] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.548549 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 850) took 1530 ms. Trace:
I20260503 07:53:08.548671 1173 rpcz_store.cc:276] 0503 07:53:07.018460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.018540 (+ 80us) service_pool.cc:224] Handling call
0503 07:53:08.145750 (+1127210us) ts_tablet_manager.cc:1151] Deleting tablet d58deacb99c643d89a6641ef09b026ba
0503 07:53:08.145758 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.322931 (+177173us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.488809 (+165878us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.548532 (+ 59723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1127070}
I20260503 07:53:08.548795 2269 raft_consensus.cc:515] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.549091 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d58deacb99c643d89a6641ef09b026ba (table default.Table_f5c89a6d8ef0470aa5c38d69321e49a8 [id=f892c4c9ee21484e9a16b3e368386dc3]) successfully deleted
I20260503 07:53:08.549312 2269 leader_election.cc:290] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.549463 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 851) took 1530 ms. Trace:
I20260503 07:53:08.549557 1173 rpcz_store.cc:276] 0503 07:53:07.018611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.020217 (+ 1606us) service_pool.cc:224] Handling call
0503 07:53:08.549346 (+1529129us) ts_tablet_manager.cc:1151] Deleting tablet 0a269a12729549469f86e184e2ed7e86
0503 07:53:08.549355 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.549448 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528931}
I20260503 07:53:08.549836 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
W20260503 07:53:08.549980 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0a269a12729549469f86e184e2ed7e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a269a12729549469f86e184e2ed7e86 already in progress: creating tablet
I20260503 07:53:08.550033 780 raft_consensus.cc:3060] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.550170 2386 raft_consensus.cc:2749] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.550304 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 852) took 1504 ms. Trace:
I20260503 07:53:08.550366 1173 rpcz_store.cc:276] 0503 07:53:07.046198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.049540 (+ 3342us) service_pool.cc:224] Handling call
0503 07:53:08.550209 (+1500669us) ts_tablet_manager.cc:1151] Deleting tablet 0e47796d8f924117bcc5dcc5cf958874
0503 07:53:08.550217 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.550292 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1500506}
W20260503 07:53:08.550791 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0e47796d8f924117bcc5dcc5cf958874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e47796d8f924117bcc5dcc5cf958874 already in progress: creating tablet
I20260503 07:53:08.551091 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 856) took 1462 ms. Trace:
I20260503 07:53:08.551168 1173 rpcz_store.cc:276] 0503 07:53:07.088643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.089510 (+ 867us) service_pool.cc:224] Handling call
0503 07:53:08.550999 (+1461489us) ts_tablet_manager.cc:1151] Deleting tablet 801e48526d634222875678f56ce00cfe
0503 07:53:08.551007 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.551077 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461313}
W20260503 07:53:08.551546 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 801e48526d634222875678f56ce00cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801e48526d634222875678f56ce00cfe already in progress: creating tablet
I20260503 07:53:08.551852 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 859) took 1422 ms. Trace:
I20260503 07:53:08.552181 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:08.552280 988 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.552526 2386 raft_consensus.cc:493] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.552639 2386 raft_consensus.cc:515] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.552770 780 raft_consensus.cc:2468] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:08.553561 2386 leader_election.cc:290] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:08.554185 851 leader_election.cc:343] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 596130e78eb1444a96480fc1075478cd
I20260503 07:53:08.554525 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 32564d43180741f396c4682c32c29f43 (DEFAULT_TABLE table=default.Table_899ab16c8fbf4137b5e1a2b331af4feb [id=926515a71b294dcd802cb3c571d5fb3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.554895 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32564d43180741f396c4682c32c29f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.556300 986 leader_election.cc:304] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:08.557252 2269 raft_consensus.cc:2804] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:08.557453 2269 raft_consensus.cc:697] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:08.557713 2269 consensus_queue.cc:237] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:08.560050 854 leader_election.cc:343] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 596130e78eb1444a96480fc1075478cd
I20260503 07:53:08.560143 854 leader_election.cc:304] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.560608 2386 raft_consensus.cc:2749] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.560562 742 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc50575cb85463d862e95757a35cfd5 (DEFAULT_TABLE table=default.Table_6644f47cf4974ac28fcc3d3529d0b88f [id=d7dd66e25d6649ca8cb9f4aba4675f4c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.560969 988 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.563057 2460 raft_consensus.cc:493] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.563197 2460 raft_consensus.cc:515] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.564251 2460 leader_election.cc:290] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.564707 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:08.564873 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:08.565380 715 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:08.565493 716 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.565608 715 leader_election.cc:304] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.566116 2460 raft_consensus.cc:2749] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:08.569203 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e51911038c2d44f9a5c5aebdbcb5946e consensus state has no leader
I20260503 07:53:08.575419 751 tablet_service.cc:1511] Processing CreateTablet for tablet 32564d43180741f396c4682c32c29f43 (DEFAULT_TABLE table=default.Table_899ab16c8fbf4137b5e1a2b331af4feb [id=926515a71b294dcd802cb3c571d5fb3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.576681 879 tablet_service.cc:1511] Processing CreateTablet for tablet 597d71ebabb344f7a7476d6d151907f5 (DEFAULT_TABLE table=default.Table_883e0f47ba5442029ef477aeebfecd8c [id=f0243eaea4bf43cdad5e88046a8111e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.577098 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597d71ebabb344f7a7476d6d151907f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.577260 760 tablet_service.cc:1511] Processing CreateTablet for tablet 597d71ebabb344f7a7476d6d151907f5 (DEFAULT_TABLE table=default.Table_883e0f47ba5442029ef477aeebfecd8c [id=f0243eaea4bf43cdad5e88046a8111e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.577939 1482 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 07:53:08.578536 892 tablet_service.cc:1511] Processing CreateTablet for tablet 407a28fbbb9b4678986fdaf761f95271 (DEFAULT_TABLE table=default.Table_bf0c0baea6dc4c2c8012c0138ef29207 [id=dbfc7048f9af4461ba32e72c22767088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.578846 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407a28fbbb9b4678986fdaf761f95271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.579195 746 tablet_service.cc:1511] Processing CreateTablet for tablet 407a28fbbb9b4678986fdaf761f95271 (DEFAULT_TABLE table=default.Table_bf0c0baea6dc4c2c8012c0138ef29207 [id=dbfc7048f9af4461ba32e72c22767088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.581019 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0edcd3617b4c73a419b382492a23aa (DEFAULT_TABLE table=default.Table_4ad45235559c41a89c55250d5bf4577b [id=8128542ed2ed4389af0c78150c350bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.581072 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0edcd3617b4c73a419b382492a23aa (DEFAULT_TABLE table=default.Table_4ad45235559c41a89c55250d5bf4577b [id=8128542ed2ed4389af0c78150c350bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.581341 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0edcd3617b4c73a419b382492a23aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.583986 885 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7d50c1575341bca6673a3cd887415e (DEFAULT_TABLE table=default.Table_de8f39e067d944a1aa4452fc4b956897 [id=088d288dc15b48ffbda33fda832362fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.584285 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7d50c1575341bca6673a3cd887415e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.584506 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc50575cb85463d862e95757a35cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.589921 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32564d43180741f396c4682c32c29f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.592378 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597d71ebabb344f7a7476d6d151907f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.596431 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407a28fbbb9b4678986fdaf761f95271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.600361 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0edcd3617b4c73a419b382492a23aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.601050 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 407a28fbbb9b4678986fdaf761f95271 (DEFAULT_TABLE table=default.Table_bf0c0baea6dc4c2c8012c0138ef29207 [id=dbfc7048f9af4461ba32e72c22767088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.601433 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407a28fbbb9b4678986fdaf761f95271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.608546 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0edcd3617b4c73a419b382492a23aa (DEFAULT_TABLE table=default.Table_4ad45235559c41a89c55250d5bf4577b [id=8128542ed2ed4389af0c78150c350bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.608855 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0edcd3617b4c73a419b382492a23aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.612111 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 597d71ebabb344f7a7476d6d151907f5 (DEFAULT_TABLE table=default.Table_883e0f47ba5442029ef477aeebfecd8c [id=f0243eaea4bf43cdad5e88046a8111e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.612931 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597d71ebabb344f7a7476d6d151907f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.619938 2386 raft_consensus.cc:493] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.620119 2386 raft_consensus.cc:515] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.620796 2451 raft_consensus.cc:493] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.620924 2451 raft_consensus.cc:515] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.621204 2386 leader_election.cc:290] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.621451 2451 leader_election.cc:290] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:08.622737 854 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 3650ec1de28c4f1bafd979257dd2b778
W20260503 07:53:08.622916 854 leader_election.cc:343] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: ebec2b05025444ccaf0bf0bb4ab62dae
W20260503 07:53:08.624265 851 leader_election.cc:343] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: ebec2b05025444ccaf0bf0bb4ab62dae
I20260503 07:53:08.624382 851 leader_election.cc:304] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.624702 2451 raft_consensus.cc:2749] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.625173 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 821) took 3031 ms. Trace:
W20260503 07:53:08.625267 851 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:08.625341 851 leader_election.cc:304] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.625265 1174 rpcz_store.cc:276] 0503 07:53:05.593791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.597462 (+ 3671us) service_pool.cc:224] Handling call
0503 07:53:08.247276 (+2649814us) ts_tablet_manager.cc:1151] Deleting tablet 5ce16dd96cf04ae293601108381a2a47
0503 07:53:08.247285 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.379789 (+132504us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.514917 (+135128us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.625155 (+110238us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2649724}
I20260503 07:53:08.625633 2451 raft_consensus.cc:2749] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.625675 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5ce16dd96cf04ae293601108381a2a47 (table default.Table_ef660e5b1231415e99e9d960d17d0ff3 [id=284b0bdf4f78412c9bc9ab30faaf0008]) successfully deleted
I20260503 07:53:08.626055 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 828) took 2999 ms. Trace:
I20260503 07:53:08.626159 1174 rpcz_store.cc:276] 0503 07:53:05.626401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.627068 (+ 667us) service_pool.cc:224] Handling call
0503 07:53:08.625918 (+2998850us) ts_tablet_manager.cc:1151] Deleting tablet 84d1372ba462479db6cf9e865c104df4
0503 07:53:08.625952 (+ 34us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.626036 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2998694}
W20260503 07:53:08.626624 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 84d1372ba462479db6cf9e865c104df4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d1372ba462479db6cf9e865c104df4 already in progress: creating tablet
I20260503 07:53:08.627121 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 829) took 3000 ms. Trace:
I20260503 07:53:08.627213 1174 rpcz_store.cc:276] 0503 07:53:05.626508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.627250 (+ 742us) service_pool.cc:224] Handling call
0503 07:53:08.627029 (+2999779us) ts_tablet_manager.cc:1151] Deleting tablet c51fe76096684794aac4f5f65c8de1b5
0503 07:53:08.627037 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.627105 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2999675}
W20260503 07:53:08.627584 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c51fe76096684794aac4f5f65c8de1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51fe76096684794aac4f5f65c8de1b5 already in progress: creating tablet
I20260503 07:53:08.634081 2113 raft_consensus.cc:493] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.634268 2113 raft_consensus.cc:515] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.634883 2113 leader_election.cc:290] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.635401 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:08.635865 988 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.636133 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:08.636399 775 raft_consensus.cc:2468] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:08.637696 986 leader_election.cc:304] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.638700 2113 raft_consensus.cc:2804] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:08.638831 2113 raft_consensus.cc:493] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:08.638942 2113 raft_consensus.cc:3060] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.641412 2451 raft_consensus.cc:493] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.641533 2451 raft_consensus.cc:515] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.642120 2451 leader_election.cc:290] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.644161 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.645025 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2146fa5f2fd54bf0baae1681ffb3547b" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:08.645550 851 leader_election.cc:304] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.551918 1173 rpcz_store.cc:276] 0503 07:53:07.129149 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.129202 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:08.551765 (+1422563us) ts_tablet_manager.cc:1151] Deleting tablet 0a67c4565c4c4c35bb54cd047258be07
0503 07:53:08.551773 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.551839 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1422374}
I20260503 07:53:08.645841 1173 tablet_replica.cc:333] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:08.646015 1173 raft_consensus.cc:2243] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:08.646063 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0a67c4565c4c4c35bb54cd047258be07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a67c4565c4c4c35bb54cd047258be07 already in progress: creating tablet
I20260503 07:53:08.646184 1173 raft_consensus.cc:2272] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.646420 2451 raft_consensus.cc:2749] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.646736 1173 ts_tablet_manager.cc:1916] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:08.650729 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 915) took 1968 ms. Trace:
I20260503 07:53:08.653844 1175 rpcz_store.cc:276] 0503 07:53:06.681954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.682092 (+ 138us) service_pool.cc:224] Handling call
0503 07:53:08.650602 (+1968510us) ts_tablet_manager.cc:1151] Deleting tablet 437d8b148ade443790f5c42c7d955f48
0503 07:53:08.650613 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.650710 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1968333}
W20260503 07:53:08.654325 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 437d8b148ade443790f5c42c7d955f48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437d8b148ade443790f5c42c7d955f48 already in progress: creating tablet
I20260503 07:53:08.655556 1171 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:08.655730 1171 ts_tablet_manager.cc:1403] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.181s user 0.002s sys 0.003s
I20260503 07:53:08.656596 1171 raft_consensus.cc:359] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.659091 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 827) took 3032 ms. Trace:
I20260503 07:53:08.659233 1174 rpcz_store.cc:276] 0503 07:53:05.626273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.628432 (+ 2159us) service_pool.cc:224] Handling call
0503 07:53:08.658962 (+3030530us) ts_tablet_manager.cc:1151] Deleting tablet 314618c911b148d48e4651a100d66fae
0503 07:53:08.658972 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.659072 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3030364}
W20260503 07:53:08.659755 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 314618c911b148d48e4651a100d66fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314618c911b148d48e4651a100d66fae already in progress: creating tablet
I20260503 07:53:08.662148 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 826) took 3036 ms. Trace:
I20260503 07:53:08.662284 1174 rpcz_store.cc:276] 0503 07:53:05.626147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.629114 (+ 2967us) service_pool.cc:224] Handling call
0503 07:53:08.660068 (+3030954us) ts_tablet_manager.cc:1151] Deleting tablet 05134e2081544b5fb7694d63265b047b
0503 07:53:08.660079 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.662119 (+ 2040us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3030086}
W20260503 07:53:08.663080 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 05134e2081544b5fb7694d63265b047b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05134e2081544b5fb7694d63265b047b already in progress: creating tablet
I20260503 07:53:08.663429 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 830) took 3016 ms. Trace:
I20260503 07:53:08.663542 1174 rpcz_store.cc:276] 0503 07:53:05.646777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.646840 (+ 63us) service_pool.cc:224] Handling call
0503 07:53:08.662928 (+3016088us) ts_tablet_manager.cc:1151] Deleting tablet 99e681a9fdf64f42a947b2cbc6b47b7b
0503 07:53:08.663323 (+ 395us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.663407 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3015813}
I20260503 07:53:08.673010 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 2146fa5f2fd54bf0baae1681ffb3547b (table default.Table_63cc09a4856c4cc08931aa979733076a [id=63f0f416d7c54be89355008b47b3c7a7]). Expected version 3 got 0
I20260503 07:53:08.673234 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 7d9edbc50a8e4194a46ecb1666daa5f1 (table default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e]). Expected version 1 got 0
I20260503 07:53:08.676896 891 tablet_service.cc:1511] Processing CreateTablet for tablet be88fd1af300484989dca8658ea5e090 (DEFAULT_TABLE table=default.Table_143191f2475a48059309728da56ea7a7 [id=bd1f1f2e9bf9422384435a87b70d74e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.677703 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be88fd1af300484989dca8658ea5e090. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.678730 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ba5f770a448465491160fc72f66a830 consensus state has no leader
I20260503 07:53:08.671092 760 tablet_service.cc:1511] Processing CreateTablet for tablet be88fd1af300484989dca8658ea5e090 (DEFAULT_TABLE table=default.Table_143191f2475a48059309728da56ea7a7 [id=bd1f1f2e9bf9422384435a87b70d74e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.693164 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be88fd1af300484989dca8658ea5e090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.697736 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:08.672056 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7d50c1575341bca6673a3cd887415e (DEFAULT_TABLE table=default.Table_de8f39e067d944a1aa4452fc4b956897 [id=088d288dc15b48ffbda33fda832362fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.699726 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7d50c1575341bca6673a3cd887415e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.692386 1165 tablet_bootstrap.cc:654] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.704854 1171 raft_consensus.cc:385] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:53:08.705384 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 99e681a9fdf64f42a947b2cbc6b47b7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99e681a9fdf64f42a947b2cbc6b47b7b already in progress: creating tablet
I20260503 07:53:08.705569 1171 raft_consensus.cc:740] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.705941 1174 tablet_replica.cc:333] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:08.705984 1171 consensus_queue.cc:260] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.706296 1174 raft_consensus.cc:2243] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:08.706466 1174 raft_consensus.cc:2272] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.706976 1174 ts_tablet_manager.cc:1916] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:08.708710 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_12ecbb3af87d4ca4bddbb7b3fd353682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:08.709232 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12ecbb3af87d4ca4bddbb7b3fd353682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:08.716645 882 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9a34f66d342fcbff7f8b8adb28b80 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.717129 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9a34f66d342fcbff7f8b8adb28b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.718288 1171 ts_tablet_manager.cc:1434] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.062s user 0.002s sys 0.000s
I20260503 07:53:08.723320 1171 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:08.723843 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5410078477804fa1b588adf95cad3c2f (DEFAULT_TABLE table=default.Table_fcc06f2c258f44a0beb34324b577713c [id=9ea866cb28414809828813042f978a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.723989 1166 tablet_bootstrap.cc:492] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.724112 1166 ts_tablet_manager.cc:1403] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.284s user 0.053s sys 0.128s
I20260503 07:53:08.724383 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5410078477804fa1b588adf95cad3c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.724946 1166 raft_consensus.cc:359] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.725098 1166 raft_consensus.cc:385] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.725162 1166 raft_consensus.cc:740] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.725375 1166 consensus_queue.cc:260] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.727754 1166 ts_tablet_manager.cc:1434] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:53:08.728035 1166 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.730954 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fadf876a1e6c4d0b98eec1b009f15056" } modify_external_catalogs: true
I20260503 07:53:08.731119 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fadf876a1e6c4d0b98eec1b009f15056" } modify_external_catalogs: true
I20260503 07:53:08.731307 1166 tablet_bootstrap.cc:654] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.734814 1171 tablet_bootstrap.cc:654] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.657325 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 916) took 1975 ms. Trace:
I20260503 07:53:08.735622 1175 rpcz_store.cc:276] 0503 07:53:06.682042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.682358 (+ 316us) service_pool.cc:224] Handling call
0503 07:53:08.657208 (+1974850us) ts_tablet_manager.cc:1151] Deleting tablet 30c917e1bc514bcbb859340f9ef99f3b
0503 07:53:08.657215 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.657308 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1974695}
I20260503 07:53:08.673846 1020 tablet_service.cc:1511] Processing CreateTablet for tablet be88fd1af300484989dca8658ea5e090 (DEFAULT_TABLE table=default.Table_143191f2475a48059309728da56ea7a7 [id=bd1f1f2e9bf9422384435a87b70d74e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.736042 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 924) took 1764 ms. Trace:
I20260503 07:53:08.736146 1175 rpcz_store.cc:276] 0503 07:53:06.972078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.984895 (+ 12817us) service_pool.cc:224] Handling call
0503 07:53:08.735904 (+1751009us) ts_tablet_manager.cc:1151] Deleting tablet 6ae4a8f39d67459dbb80c72947ae7005
0503 07:53:08.735913 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.736025 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1750767}
I20260503 07:53:08.736431 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be88fd1af300484989dca8658ea5e090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.736474 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 925) took 1722 ms. Trace:
I20260503 07:53:08.736534 1175 rpcz_store.cc:276] 0503 07:53:07.014235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.014290 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:08.736379 (+1722089us) ts_tablet_manager.cc:1151] Deleting tablet cec0b36fdcf64042bc87446977b9dcca
0503 07:53:08.736385 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.736456 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1721916}
I20260503 07:53:08.736822 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 926) took 1719 ms. Trace:
I20260503 07:53:08.736907 1175 rpcz_store.cc:276] 0503 07:53:07.017355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.018119 (+ 764us) service_pool.cc:224] Handling call
0503 07:53:08.736734 (+1718615us) ts_tablet_manager.cc:1151] Deleting tablet 0a269a12729549469f86e184e2ed7e86
0503 07:53:08.736742 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.736806 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1718389}
I20260503 07:53:08.737200 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 928) took 1692 ms. Trace:
I20260503 07:53:08.737279 1175 rpcz_store.cc:276] 0503 07:53:07.044649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.047605 (+ 2956us) service_pool.cc:224] Handling call
0503 07:53:08.737108 (+1689503us) ts_tablet_manager.cc:1151] Deleting tablet 0e47796d8f924117bcc5dcc5cf958874
0503 07:53:08.737116 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.737186 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689304}
I20260503 07:53:08.737557 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 931) took 1649 ms. Trace:
I20260503 07:53:08.737632 1175 rpcz_store.cc:276] 0503 07:53:07.088103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.088218 (+ 115us) service_pool.cc:224] Handling call
0503 07:53:08.737462 (+1649244us) ts_tablet_manager.cc:1151] Deleting tablet 801e48526d634222875678f56ce00cfe
0503 07:53:08.737470 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.737544 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649078}
I20260503 07:53:08.737905 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 934) took 1608 ms. Trace:
I20260503 07:53:08.737972 1175 rpcz_store.cc:276] 0503 07:53:07.129542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.129593 (+ 51us) service_pool.cc:224] Handling call
0503 07:53:08.737809 (+1608216us) ts_tablet_manager.cc:1151] Deleting tablet 0a67c4565c4c4c35bb54cd047258be07
0503 07:53:08.737820 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.737883 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1608071}
I20260503 07:53:08.738189 1175 tablet_replica.cc:333] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:08.738391 1175 raft_consensus.cc:2243] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:08.738529 1175 raft_consensus.cc:2272] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.739001 1175 ts_tablet_manager.cc:1916] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:08.740520 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 30c917e1bc514bcbb859340f9ef99f3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c917e1bc514bcbb859340f9ef99f3b already in progress: creating tablet
W20260503 07:53:08.740990 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6ae4a8f39d67459dbb80c72947ae7005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae4a8f39d67459dbb80c72947ae7005 already in progress: creating tablet
W20260503 07:53:08.741355 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet cec0b36fdcf64042bc87446977b9dcca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cec0b36fdcf64042bc87446977b9dcca already in progress: creating tablet
W20260503 07:53:08.741770 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0a269a12729549469f86e184e2ed7e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a269a12729549469f86e184e2ed7e86 already in progress: creating tablet
W20260503 07:53:08.742246 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0e47796d8f924117bcc5dcc5cf958874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e47796d8f924117bcc5dcc5cf958874 already in progress: creating tablet
I20260503 07:53:08.674316 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 5410078477804fa1b588adf95cad3c2f (DEFAULT_TABLE table=default.Table_fcc06f2c258f44a0beb34324b577713c [id=9ea866cb28414809828813042f978a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.742825 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5410078477804fa1b588adf95cad3c2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.747368 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 801e48526d634222875678f56ce00cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801e48526d634222875678f56ce00cfe already in progress: creating tablet
W20260503 07:53:08.748221 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0a67c4565c4c4c35bb54cd047258be07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a67c4565c4c4c35bb54cd047258be07 already in progress: creating tablet
I20260503 07:53:08.752113 2454 raft_consensus.cc:493] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.752303 2454 raft_consensus.cc:515] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.752940 2454 leader_election.cc:290] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.753420 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.753710 2434 tablet.cc:1724] T ce181da64bad49389a64df1ade0e90ef P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:08.754220 716 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.754527 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:08.755004 715 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.755105 715 leader_election.cc:304] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.755203 2419 tablet.cc:1724] T ce181da64bad49389a64df1ade0e90ef P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:08.755544 2454 raft_consensus.cc:2749] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.765374 1171 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:08.765587 1171 ts_tablet_manager.cc:1403] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.001s
I20260503 07:53:08.766569 1171 raft_consensus.cc:359] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.766942 1171 raft_consensus.cc:385] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.767038 1171 raft_consensus.cc:740] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.767273 1171 consensus_queue.cc:260] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.767789 1171 ts_tablet_manager.cc:1434] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.768421 1171 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:08.768752 1166 tablet_bootstrap.cc:492] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.768883 1166 ts_tablet_manager.cc:1403] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20260503 07:53:08.769595 1166 raft_consensus.cc:359] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.769785 1166 raft_consensus.cc:385] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.769850 1166 raft_consensus.cc:740] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.770074 1166 consensus_queue.cc:260] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.770752 1166 ts_tablet_manager.cc:1434] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:08.771023 1166 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.772938 1166 tablet_bootstrap.cc:654] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.773645 1171 tablet_bootstrap.cc:654] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.774784 2454 raft_consensus.cc:493] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.774959 2454 raft_consensus.cc:515] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.777872 2454 leader_election.cc:290] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:08.779210 760 tablet_service.cc:1511] Processing CreateTablet for tablet 353c14ee2adc49d9a3142272eeac0ac5 (DEFAULT_TABLE table=default.Table_e2a6aac10a79471f91a7e631116df017 [id=b0bc9b8613d74e0cb50c87effcd60532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.779572 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353c14ee2adc49d9a3142272eeac0ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.780426 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:08.780820 2451 raft_consensus.cc:493] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:08.780956 2451 raft_consensus.cc:515] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.781522 2451 leader_election.cc:290] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:08.781901 716 leader_election.cc:343] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.782397 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:08.783275 854 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d3fda3bba9234622b2c391a31c55dc3a
W20260503 07:53:08.783758 715 leader_election.cc:343] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.783846 715 leader_election.cc:304] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.784078 2454 raft_consensus.cc:2749] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:08.784667 851 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:08.784773 851 leader_election.cc:304] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:08.785159 2451 raft_consensus.cc:2749] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:08.786285 1166 tablet_bootstrap.cc:492] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.786414 1166 ts_tablet_manager.cc:1403] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260503 07:53:08.787088 1166 raft_consensus.cc:359] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.787254 1166 raft_consensus.cc:385] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.787320 1166 raft_consensus.cc:740] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.787523 1166 consensus_queue.cc:260] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.717065 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 353c14ee2adc49d9a3142272eeac0ac5 (DEFAULT_TABLE table=default.Table_e2a6aac10a79471f91a7e631116df017 [id=b0bc9b8613d74e0cb50c87effcd60532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.677269 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7d50c1575341bca6673a3cd887415e (DEFAULT_TABLE table=default.Table_de8f39e067d944a1aa4452fc4b956897 [id=088d288dc15b48ffbda33fda832362fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.788058 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7d50c1575341bca6673a3cd887415e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.788089 1166 ts_tablet_manager.cc:1434] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:08.788339 1166 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.789821 1166 tablet_bootstrap.cc:654] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.692714 2113 raft_consensus.cc:515] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.796455 2113 leader_election.cc:290] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:08.796880 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:08.797338 988 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:08.798273 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf42130a55744429d2c64ed55671507" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:08.798446 780 raft_consensus.cc:3060] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:08.801853 780 raft_consensus.cc:2468] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:08.802690 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5410078477804fa1b588adf95cad3c2f (DEFAULT_TABLE table=default.Table_fcc06f2c258f44a0beb34324b577713c [id=9ea866cb28414809828813042f978a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.803143 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5410078477804fa1b588adf95cad3c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.803844 986 leader_election.cc:304] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:08.804437 2421 raft_consensus.cc:2804] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:08.804543 2421 raft_consensus.cc:697] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:08.804746 2421 consensus_queue.cc:237] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.805585 1166 tablet_bootstrap.cc:492] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.805627 2431 consensus_queue.cc:1048] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:08.805696 1166 ts_tablet_manager.cc:1403] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.006s
I20260503 07:53:08.806388 1166 raft_consensus.cc:359] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.806538 1166 raft_consensus.cc:385] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.806589 1166 raft_consensus.cc:740] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.806762 1166 consensus_queue.cc:260] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.807190 1166 ts_tablet_manager.cc:1434] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:08.807425 1166 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:08.814129 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353c14ee2adc49d9a3142272eeac0ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.817070 1166 tablet_bootstrap.cc:654] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:08.829835 892 tablet_service.cc:1511] Processing CreateTablet for tablet b56ee573586b49d596592c32c509969f (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.830212 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56ee573586b49d596592c32c509969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.828521 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 76c7dececf6443ee91a0e2877e1e394a (DEFAULT_TABLE table=default.Table_a5d74281a14f40f09642704e2bf9042a [id=a2165c411544422399ef3daba0f155b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.843660 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c7dececf6443ee91a0e2877e1e394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.834947 1175 ts_tablet_manager.cc:1929] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.854387 1175 log.cc:1199] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:08.854856 1175 ts_tablet_manager.cc:1950] T 54bf46b34b1043e2ab6c9f8b2c871227 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:08.855792 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 939) took 1632 ms. Trace:
I20260503 07:53:08.855995 1175 rpcz_store.cc:276] 0503 07:53:07.223662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.225067 (+ 1405us) service_pool.cc:224] Handling call
0503 07:53:08.738155 (+1513088us) ts_tablet_manager.cc:1151] Deleting tablet 54bf46b34b1043e2ab6c9f8b2c871227
0503 07:53:08.738162 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.768663 (+ 30501us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.834902 (+ 66239us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.855770 (+ 20868us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1512669}
I20260503 07:53:08.856608 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 54bf46b34b1043e2ab6c9f8b2c871227 (table default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]) successfully deleted
I20260503 07:53:08.858316 746 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9a34f66d342fcbff7f8b8adb28b80 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.858793 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9a34f66d342fcbff7f8b8adb28b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.878536 757 tablet_service.cc:1511] Processing CreateTablet for tablet 76c7dececf6443ee91a0e2877e1e394a (DEFAULT_TABLE table=default.Table_a5d74281a14f40f09642704e2bf9042a [id=a2165c411544422399ef3daba0f155b3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:08.880543 986 consensus_peers.cc:597] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:08.880913 879 tablet_service.cc:1511] Processing CreateTablet for tablet 353c14ee2adc49d9a3142272eeac0ac5 (DEFAULT_TABLE table=default.Table_e2a6aac10a79471f91a7e631116df017 [id=b0bc9b8613d74e0cb50c87effcd60532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.881389 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353c14ee2adc49d9a3142272eeac0ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.879324 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c7dececf6443ee91a0e2877e1e394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.883092 751 tablet_service.cc:1511] Processing CreateTablet for tablet b56ee573586b49d596592c32c509969f (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.884923 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56ee573586b49d596592c32c509969f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:08.889739 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53de1c39d3884a158d92fa487091215c consensus state has no leader
I20260503 07:53:08.890025 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 56749914e1a349f0876f52157affdf69 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:08.899477 593 master_service.cc:954] ReplaceTablet: received request to replace tablet 91b9a724c6354a9eb17cc024c8f84669 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:08.926102 1174 ts_tablet_manager.cc:1929] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.926376 1174 log.cc:1199] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/61316b7a521e42a59bf955179b080f40
I20260503 07:53:08.926795 1174 ts_tablet_manager.cc:1950] T 61316b7a521e42a59bf955179b080f40 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:08.929916 1175 tablet_replica.cc:333] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:08.930197 1175 raft_consensus.cc:2243] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:08.930688 1175 pending_rounds.cc:70] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:08.930831 1175 pending_rounds.cc:77] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847453301571584 op_type: NO_OP noop_request { }
I20260503 07:53:08.931005 1175 raft_consensus.cc:2889] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:08.931181 1175 raft_consensus.cc:2272] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:08.933207 882 tablet_service.cc:1511] Processing CreateTablet for tablet 76c7dececf6443ee91a0e2877e1e394a (DEFAULT_TABLE table=default.Table_a5d74281a14f40f09642704e2bf9042a [id=a2165c411544422399ef3daba0f155b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.933760 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c7dececf6443ee91a0e2877e1e394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.949084 1175 ts_tablet_manager.cc:1916] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:08.951275 892 tablet_service.cc:1511] Processing CreateTablet for tablet 146e76e22aa044c389d5c1fb1548f2cc (DEFAULT_TABLE table=default.Table_ac0821f2cf694a9d80dbc9315f2410d9 [id=fe211ce9f8034cf4963fa5ea02a0ac58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.951727 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e76e22aa044c389d5c1fb1548f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.953998 1173 ts_tablet_manager.cc:1929] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:08.954197 1173 log.cc:1199] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/fb821b329d284643a889b07f9a4f287e
I20260503 07:53:08.954525 1173 ts_tablet_manager.cc:1950] T fb821b329d284643a889b07f9a4f287e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:08.955283 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 862) took 1800 ms. Trace:
I20260503 07:53:08.955412 1173 rpcz_store.cc:276] 0503 07:53:07.155201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.155257 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:08.645798 (+1490541us) ts_tablet_manager.cc:1151] Deleting tablet fb821b329d284643a889b07f9a4f287e
0503 07:53:08.645807 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.709786 (+ 63979us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.953954 (+244168us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.955265 (+ 1311us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1479343}
I20260503 07:53:08.955957 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet fb821b329d284643a889b07f9a4f287e (table default.Table_f3f0440daf4a4fe89f92e6c20afef7e5 [id=f7f0f8a122cf4e0aa71cf15ecb71078c]) successfully deleted
I20260503 07:53:08.957445 2113 consensus_queue.cc:1048] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:08.962608 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 146e76e22aa044c389d5c1fb1548f2cc (DEFAULT_TABLE table=default.Table_ac0821f2cf694a9d80dbc9315f2410d9 [id=fe211ce9f8034cf4963fa5ea02a0ac58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.962648 2506 tablet.cc:1724] T ce181da64bad49389a64df1ade0e90ef P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:08.962993 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e76e22aa044c389d5c1fb1548f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.964664 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9a34f66d342fcbff7f8b8adb28b80 (DEFAULT_TABLE table=default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.964999 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9a34f66d342fcbff7f8b8adb28b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.972036 760 tablet_service.cc:1511] Processing CreateTablet for tablet 146e76e22aa044c389d5c1fb1548f2cc (DEFAULT_TABLE table=default.Table_ac0821f2cf694a9d80dbc9315f2410d9 [id=fe211ce9f8034cf4963fa5ea02a0ac58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.972452 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e76e22aa044c389d5c1fb1548f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.972587 1166 tablet_bootstrap.cc:492] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:08.972714 1166 ts_tablet_manager.cc:1403] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.165s user 0.010s sys 0.028s
I20260503 07:53:08.973858 1018 tablet_service.cc:1511] Processing CreateTablet for tablet b56ee573586b49d596592c32c509969f (DEFAULT_TABLE table=default.Table_d91a5ae8b64743dcb9114fd581458903 [id=323853c86aa24548ba520e8b0732e11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:08.980325 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56ee573586b49d596592c32c509969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:08.981638 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 832) took 3287 ms. Trace:
I20260503 07:53:08.981786 1174 rpcz_store.cc:276] 0503 07:53:05.693702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.693888 (+ 186us) service_pool.cc:224] Handling call
0503 07:53:08.705894 (+3012006us) ts_tablet_manager.cc:1151] Deleting tablet 61316b7a521e42a59bf955179b080f40
0503 07:53:08.705905 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.899904 (+193999us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.926040 (+ 26136us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:08.981617 (+ 55577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51166,"tablet-delete.queue_time_us":3010990}
I20260503 07:53:08.982312 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 61316b7a521e42a59bf955179b080f40 (table default.Table_5d8b2c631087445188d01c39291fb9a3 [id=e211b19acaf94e3d9c00d4e88d23f4f2]) successfully deleted
I20260503 07:53:08.982859 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 831) took 3301 ms. Trace:
I20260503 07:53:08.982995 1174 rpcz_store.cc:276] 0503 07:53:05.681396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.696996 (+ 15600us) service_pool.cc:224] Handling call
0503 07:53:08.982753 (+3285757us) ts_tablet_manager.cc:1151] Deleting tablet ae3fcb4d83f64f6182a78a1a02da39d6
0503 07:53:08.982761 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.982844 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3285578}
W20260503 07:53:08.983494 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ae3fcb4d83f64f6182a78a1a02da39d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3fcb4d83f64f6182a78a1a02da39d6 already in progress: creating tablet
I20260503 07:53:08.984023 1174 tablet_replica.cc:333] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:08.987481 1165 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:08.987664 1165 ts_tablet_manager.cc:1403] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.464s user 0.012s sys 0.017s
I20260503 07:53:08.988592 1165 raft_consensus.cc:359] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.988795 1165 raft_consensus.cc:385] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.988899 1165 raft_consensus.cc:740] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.989321 1165 consensus_queue.cc:260] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:08.990073 1165 ts_tablet_manager.cc:1434] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:08.990353 1165 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:08.996320 1166 raft_consensus.cc:359] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.996486 1166 raft_consensus.cc:385] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:08.996549 1166 raft_consensus.cc:740] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:08.996742 1166 consensus_queue.cc:260] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:08.999825 1166 ts_tablet_manager.cc:1434] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260503 07:53:09.000110 1166 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.001768 1166 tablet_bootstrap.cc:654] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.006489 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 56749914e1a349f0876f52157affdf69 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:09.020515 592 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_11cf25210559486dacae5baa7290ef46 [id=bfd20c8eae3a49eabc6fdf562ee6e2ff] alter complete (version 3)
I20260503 07:53:09.021064 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_d009e885880b4b4482cd169335f355d8 [id=f172f2d652b645e2a1de7166bc496664] alter complete (version 1)
I20260503 07:53:09.023463 601 master_service.cc:954] ReplaceTablet: received request to replace tablet efbf07a603be411895839aece99fa78c from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:09.024264 1175 ts_tablet_manager.cc:1929] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:09.025377 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a178957514e4f77afe8a1879b57a96b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.025540 886 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fda3bba9234622b2c391a31c55dc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.037817 917 raft_consensus.cc:3060] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.043802 916 raft_consensus.cc:3060] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.047420 1166 tablet_bootstrap.cc:492] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.047562 1166 ts_tablet_manager.cc:1403] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.003s
I20260503 07:53:09.048328 1166 raft_consensus.cc:359] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.048496 1166 raft_consensus.cc:385] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.048554 1166 raft_consensus.cc:740] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.048738 1166 consensus_queue.cc:260] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.049225 1166 ts_tablet_manager.cc:1434] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:09.050932 1175 log.cc:1199] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:09.050752 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cac435b09639484ca1ae82f3d4990d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.051569 1175 ts_tablet_manager.cc:1950] T 5ce16dd96cf04ae293601108381a2a47 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:09.051508 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f7654a4a85b6441f9d36527ced775aa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.052356 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.056553 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 941) took 1828 ms. Trace:
I20260503 07:53:09.056814 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 94cd6a702c59445882a81ca2e3a0f3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.058792 2451 raft_consensus.cc:493] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.058815 1175 rpcz_store.cc:276] 0503 07:53:07.228540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.234708 (+ 6168us) service_pool.cc:224] Handling call
0503 07:53:08.929859 (+1695151us) ts_tablet_manager.cc:1151] Deleting tablet 5ce16dd96cf04ae293601108381a2a47
0503 07:53:08.929871 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:08.977777 (+ 47906us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.024209 (+ 46432us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.056528 (+ 32319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1694918}
I20260503 07:53:09.058947 2451 raft_consensus.cc:515] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.059290 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5ce16dd96cf04ae293601108381a2a47 (table default.Table_ef660e5b1231415e99e9d960d17d0ff3 [id=284b0bdf4f78412c9bc9ab30faaf0008]) successfully deleted
I20260503 07:53:09.059551 2451 leader_election.cc:290] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.060479 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.060757 1175 tablet_replica.cc:333] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:09.060941 1175 raft_consensus.cc:2243] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:09.061352 1175 pending_rounds.cc:70] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:09.062361 1173 tablet_replica.cc:333] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:09.066562 1175 pending_rounds.cc:77] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847447293693952 op_type: NO_OP noop_request { }
I20260503 07:53:09.066836 1175 raft_consensus.cc:2889] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:09.062845 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6c9fb96d5a4397b51611254be1a970" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.065173 915 raft_consensus.cc:3060] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.066392 1166 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.067927 854 leader_election.cc:304] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.070515 1166 tablet_bootstrap.cc:654] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.082324 2434 tablet.cc:1724] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.083328 2113 raft_consensus.cc:493] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.083453 2113 raft_consensus.cc:515] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.084120 2113 leader_election.cc:290] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.084753 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.084944 772 raft_consensus.cc:2468] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.085336 986 leader_election.cc:304] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:09.085597 2113 raft_consensus.cc:2804] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.085695 2113 raft_consensus.cc:493] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.085768 2113 raft_consensus.cc:3060] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.086386 1173 raft_consensus.cc:2243] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:09.087769 1171 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.087884 1171 ts_tablet_manager.cc:1403] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.320s user 0.048s sys 0.037s
I20260503 07:53:09.088575 1171 raft_consensus.cc:359] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.088706 1171 raft_consensus.cc:385] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.088745 1171 raft_consensus.cc:740] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.088970 1171 consensus_queue.cc:260] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.089408 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.089543 1171 ts_tablet_manager.cc:1434] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:09.089811 1171 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:09.089975 988 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:09.090379 988 consensus_peers.cc:597] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.091176 1171 tablet_bootstrap.cc:654] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.092193 2419 tablet.cc:1724] T af0c0f5999ee4b9cae56cbb3695de12f P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.088975 2113 raft_consensus.cc:515] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.096902 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:09.097075 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:09.097226 2113 leader_election.cc:290] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.097280 772 raft_consensus.cc:3060] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:09.098062 988 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.100121 1166 tablet_bootstrap.cc:492] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.100261 1166 ts_tablet_manager.cc:1403] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260503 07:53:09.100104 772 raft_consensus.cc:2468] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:09.100852 986 leader_election.cc:304] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.101006 1166 raft_consensus.cc:359] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.101222 2421 raft_consensus.cc:2804] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.101464 2421 raft_consensus.cc:697] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:09.101711 2421 consensus_queue.cc:237] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.103807 2386 raft_consensus.cc:493] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.103953 2386 raft_consensus.cc:515] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.104506 2386 leader_election.cc:290] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.104820 1171 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.104933 1171 ts_tablet_manager.cc:1403] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260503 07:53:09.105532 1171 raft_consensus.cc:359] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.105742 1171 raft_consensus.cc:385] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.105827 1171 raft_consensus.cc:740] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:09.105988 851 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9e162006cee34182b51f97629a174509
I20260503 07:53:09.106138 1171 consensus_queue.cc:260] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.106477 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.106626 1171 ts_tablet_manager.cc:1434] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:09.106828 1049 raft_consensus.cc:2468] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 0.
I20260503 07:53:09.107740 854 leader_election.cc:304] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.108167 1171 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.108304 2386 raft_consensus.cc:2804] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.108405 2386 raft_consensus.cc:493] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.108494 2386 raft_consensus.cc:3060] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.101187 1166 raft_consensus.cc:385] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.109700 1166 raft_consensus.cc:740] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.110066 1166 consensus_queue.cc:260] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.111207 2386 raft_consensus.cc:515] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.112748 2386 leader_election.cc:290] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.112823 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e162006cee34182b51f97629a174509" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:09.112972 1048 raft_consensus.cc:3060] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:09.113485 851 leader_election.cc:343] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 9e162006cee34182b51f97629a174509
I20260503 07:53:09.115263 1048 raft_consensus.cc:2468] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 1.
I20260503 07:53:09.115620 854 leader_election.cc:304] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.116088 2386 raft_consensus.cc:2804] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.116295 2386 raft_consensus.cc:697] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Running, Role: LEADER
I20260503 07:53:09.116639 2386 consensus_queue.cc:237] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.112679 1166 ts_tablet_manager.cc:1434] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260503 07:53:09.118055 1166 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.121371 1171 tablet_bootstrap.cc:654] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.128810 1166 tablet_bootstrap.cc:654] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.130728 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c73353e0401c48e98892a62a22b8496f" } modify_external_catalogs: true
I20260503 07:53:09.130913 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c73353e0401c48e98892a62a22b8496f" } modify_external_catalogs: true
I20260503 07:53:09.135715 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1cdb8a63a92742578347537d6b4434f5" } new_table_name: "default.Table_89197de9e3944b4ebeb6768405dc969d" modify_external_catalogs: true
I20260503 07:53:09.141822 1171 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.141940 1171 ts_tablet_manager.cc:1403] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260503 07:53:09.142098 1166 tablet_bootstrap.cc:492] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.142223 1166 ts_tablet_manager.cc:1403] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260503 07:53:09.142575 2520 raft_consensus.cc:493] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.142551 1171 raft_consensus.cc:359] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.142686 1171 raft_consensus.cc:385] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.142726 1171 raft_consensus.cc:740] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.142686 2520 raft_consensus.cc:515] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.142917 1171 consensus_queue.cc:260] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.143397 1171 ts_tablet_manager.cc:1434] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260503 07:53:09.143671 1171 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.143868 2520 leader_election.cc:290] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.144037 2520 raft_consensus.cc:493] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.144084 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8eb570874fa640a1bcfca8fccf8b9ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:09.144140 2520 raft_consensus.cc:515] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:09.144647 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eb570874fa640a1bcfca8fccf8b9ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.144979 1171 tablet_bootstrap.cc:654] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.145004 2520 leader_election.cc:290] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:09.146219 851 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:09.148277 1166 raft_consensus.cc:359] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.148411 1166 raft_consensus.cc:385] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.148452 1166 raft_consensus.cc:740] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.148615 1166 consensus_queue.cc:260] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.154242 1166 ts_tablet_manager.cc:1434] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260503 07:53:09.154567 1166 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:09.155095 851 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:09.167707 1173 raft_consensus.cc:2272] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.171059 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc
I20260503 07:53:09.172659 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 56749914e1a349f0876f52157affdf69
I20260503 07:53:09.173137 600 catalog_manager.cc:6741] ReplaceTablet: tablet 56749914e1a349f0876f52157affdf69 deleted and replaced by tablet 04d4e35fd9e444b2ac1df70568e7928c
I20260503 07:53:09.174258 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 56749914e1a349f0876f52157affdf69 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d4e35fd9e444b2ac1df70568e7928c) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.174774 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.176378 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 56749914e1a349f0876f52157affdf69 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d4e35fd9e444b2ac1df70568e7928c) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.177284 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c2a784fc0e5442e2b8d0b7531248e09f" } modify_external_catalogs: true
I20260503 07:53:09.177450 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c2a784fc0e5442e2b8d0b7531248e09f" } modify_external_catalogs: true
I20260503 07:53:09.178018 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_34513bbe165b4f238b34c137287c79c8" } modify_external_catalogs: true
I20260503 07:53:09.178177 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_34513bbe165b4f238b34c137287c79c8" } modify_external_catalogs: true
I20260503 07:53:09.182343 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.184046 1173 ts_tablet_manager.cc:1916] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.176929 1166 tablet_bootstrap.cc:654] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.182094 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 56749914e1a349f0876f52157affdf69 with delete_type TABLET_DATA_DELETED (replaced by tablet 04d4e35fd9e444b2ac1df70568e7928c) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.182664 891 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:08 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.189550 1166 tablet_bootstrap.cc:492] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.189698 1166 ts_tablet_manager.cc:1403] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.001s
I20260503 07:53:09.190534 1166 raft_consensus.cc:359] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.190706 1166 raft_consensus.cc:385] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.190755 1166 raft_consensus.cc:740] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.190929 1166 consensus_queue.cc:260] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.192034 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet baf176bdc6d54088846ee5eaf5e61447
I20260503 07:53:09.194451 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet baf176bdc6d54088846ee5eaf5e61447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.194856 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet efbf07a603be411895839aece99fa78c
W20260503 07:53:09.195631 986 consensus_peers.cc:597] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.195856 601 catalog_manager.cc:6741] ReplaceTablet: tablet efbf07a603be411895839aece99fa78c deleted and replaced by tablet cc933a07094146b1ad0c2949188c3470
I20260503 07:53:09.196861 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet efbf07a603be411895839aece99fa78c with delete_type TABLET_DATA_DELETED (replaced by tablet cc933a07094146b1ad0c2949188c3470) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.197854 757 tablet_service.cc:1558] Processing DeleteTablet for tablet efbf07a603be411895839aece99fa78c with delete_type TABLET_DATA_DELETED (replaced by tablet cc933a07094146b1ad0c2949188c3470) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.201045 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 31025296f77e431da6238360724fd60a (table default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd]). Expected version 1 got 0
I20260503 07:53:09.201206 1166 ts_tablet_manager.cc:1434] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260503 07:53:09.201227 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 79d43ae066e6411896c490f7c0b11180 (table default.Table_66f8737118b343c1b4f1043b9e59c504 [id=02296eaf13b0418ea0c47dfc4eeeb22c]). Expected version 3 got 0
I20260503 07:53:09.201508 1166 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.201961 896 tablet_service.cc:1558] Processing DeleteTablet for tablet efbf07a603be411895839aece99fa78c with delete_type TABLET_DATA_DELETED (replaced by tablet cc933a07094146b1ad0c2949188c3470) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.202296 759 tablet_service.cc:1558] Processing DeleteTablet for tablet baf176bdc6d54088846ee5eaf5e61447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.202580 891 tablet_service.cc:1558] Processing DeleteTablet for tablet baf176bdc6d54088846ee5eaf5e61447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.205435 1174 raft_consensus.cc:2243] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:09.205809 1174 pending_rounds.cc:70] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Trying to abort 1 pending ops.
I20260503 07:53:09.205920 1174 pending_rounds.cc:77] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847452242395136 op_type: NO_OP noop_request { }
I20260503 07:53:09.206084 1174 raft_consensus.cc:2889] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:09.206225 1174 raft_consensus.cc:2272] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.206323 1952 raft_consensus.cc:493] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.206457 1952 raft_consensus.cc:515] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.206997 1952 leader_election.cc:290] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.207597 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:09.208096 988 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.208933 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.209183 774 raft_consensus.cc:2468] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.209583 986 leader_election.cc:304] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.209959 1952 raft_consensus.cc:2804] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.210026 1952 raft_consensus.cc:493] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.210078 1952 raft_consensus.cc:3060] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.212908 1952 raft_consensus.cc:515] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.213735 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:09.214212 988 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.214455 1952 leader_election.cc:290] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.215010 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:09.215174 772 raft_consensus.cc:3060] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.217258 1166 tablet_bootstrap.cc:654] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.217617 2520 raft_consensus.cc:493] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.217727 2520 raft_consensus.cc:515] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.218205 2520 leader_election.cc:290] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.224339 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.227962 1166 tablet_bootstrap.cc:492] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.228096 1166 ts_tablet_manager.cc:1403] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.002s
I20260503 07:53:09.228085 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 91b9a724c6354a9eb17cc024c8f84669
I20260503 07:53:09.228590 593 catalog_manager.cc:6741] ReplaceTablet: tablet 91b9a724c6354a9eb17cc024c8f84669 deleted and replaced by tablet fad603dd15f545a999b6e45bcc20bafc
I20260503 07:53:09.228849 1166 raft_consensus.cc:359] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.228982 1166 raft_consensus.cc:385] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.229025 1166 raft_consensus.cc:740] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
W20260503 07:53:09.231106 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9d53943f50d49cea9828273369235f1 has no consensus state
I20260503 07:53:09.231393 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 8dbca27f54064345b374b0cea96ca1c4 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:09.232278 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 with delete_type TABLET_DATA_DELETED (replaced by tablet fad603dd15f545a999b6e45bcc20bafc) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.233266 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 with delete_type TABLET_DATA_DELETED (replaced by tablet fad603dd15f545a999b6e45bcc20bafc) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.233628 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b9a724c6354a9eb17cc024c8f84669 with delete_type TABLET_DATA_DELETED (replaced by tablet fad603dd15f545a999b6e45bcc20bafc) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.237080 2434 tablet.cc:1724] T 31025296f77e431da6238360724fd60a P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.238019 1166 consensus_queue.cc:260] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.238591 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskCEB381/build/asan/bin/kudu with pid 1235
I20260503 07:53:09.239900 1166 ts_tablet_manager.cc:1434] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260503 07:53:09.242172 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ceab487f54e44095871c32ab5c84ac23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.242662 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceab487f54e44095871c32ab5c84ac23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.245970 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b73e814e84a84ab2a3c4234d82d96659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.246497 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b73e814e84a84ab2a3c4234d82d96659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.247921 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_414cb9527c374653ab8763194d3af29c" } modify_external_catalogs: true
I20260503 07:53:09.248101 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_414cb9527c374653ab8763194d3af29c" } modify_external_catalogs: true
I20260503 07:53:09.249040 913 raft_consensus.cc:3060] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.252250 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3222cedb816c47b4b48e7865fb0fa990" } new_table_name: "default.Table_1f35f61e9e0d48febc20df62f2cce2e2" modify_external_catalogs: true
W20260503 07:53:09.254966 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d9d53943f50d49cea9828273369235f1 (table default.Table_89197de9e3944b4ebeb6768405dc969d [id=c3aab1ea79bd41f28e5fa876d95f21c3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d9d53943f50d49cea9828273369235f1 has no consensus state
I20260503 07:53:09.258014 2419 tablet.cc:1724] T 31025296f77e431da6238360724fd60a P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.258213 1166 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.260614 2506 tablet.cc:1724] T 31025296f77e431da6238360724fd60a P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.262413 1174 ts_tablet_manager.cc:1916] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.263243 1166 tablet_bootstrap.cc:654] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.265452 913 raft_consensus.cc:3060] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.267469 598 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet f7eb84a341bb47cabe3bdf35d5db0ddd
I20260503 07:53:09.269217 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_86b5945e96354692b1e82b9786a64113"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.269804 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b5945e96354692b1e82b9786a64113 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.271755 1166 tablet_bootstrap.cc:492] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.271881 1166 ts_tablet_manager.cc:1403] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260503 07:53:09.272603 1166 raft_consensus.cc:359] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.272759 1166 raft_consensus.cc:385] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.272807 1166 raft_consensus.cc:740] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.278961 2457 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.279165 2457 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.279963 2457 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.288873 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.289255 2419 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260503 07:53:09.289950 716 leader_election.cc:343] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.292966 2434 tablet.cc:1724] T 0f45941fd2c94161b5438fe65f858b95 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.294057 2506 tablet.cc:1724] T 0f45941fd2c94161b5438fe65f858b95 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.296105 2520 raft_consensus.cc:493] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.296258 2520 raft_consensus.cc:515] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.296835 2520 leader_election.cc:290] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.298169 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.300663 1166 consensus_queue.cc:260] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.302423 1166 ts_tablet_manager.cc:1434] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260503 07:53:09.302735 1166 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.305176 2451 raft_consensus.cc:2749] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:09.305717 988 consensus_peers.cc:597] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.306883 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4446badf064ecabc01b330f3babde2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.310225 1166 tablet_bootstrap.cc:654] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.317795 2419 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:09.318782 2506 tablet.cc:1724] T af0c0f5999ee4b9cae56cbb3695de12f P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.323964 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6cb608facc89412eafb322ecd2f41590" } new_table_name: "default.Table_1778f00aeeb541d69bbee108bd88c163" modify_external_catalogs: true
I20260503 07:53:09.324894 2538 tablet.cc:1724] T b7a65f69a6c145438e8c721fe2096080 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.325558 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_27a4722aa409479eb2e6afb23df82d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.326154 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27a4722aa409479eb2e6afb23df82d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.331316 1165 tablet_bootstrap.cc:654] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:09.332639 854 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:09.332760 854 leader_election.cc:304] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.333140 854 leader_election.cc:304] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.333341 2451 raft_consensus.cc:493] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.332654 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.333451 2451 raft_consensus.cc:515] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.333976 2451 leader_election.cc:290] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.334129 2451 raft_consensus.cc:2749] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.334285 2451 raft_consensus.cc:2749] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:09.334954 854 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:09.335048 854 leader_election.cc:304] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.335237 2451 raft_consensus.cc:2749] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:09.335655 715 leader_election.cc:343] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.335767 715 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.336210 2457 raft_consensus.cc:2749] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.336438 2451 raft_consensus.cc:493] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.336550 2451 raft_consensus.cc:515] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.337087 2451 leader_election.cc:290] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.337607 1166 tablet_bootstrap.cc:492] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.337642 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.339807 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d43ae066e6411896c490f7c0b11180" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.339919 1166 ts_tablet_manager.cc:1403] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.000s
W20260503 07:53:09.340770 854 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:09.341045 854 leader_election.cc:304] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.341353 2451 raft_consensus.cc:2749] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.341737 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cfc6488f404a14af0b7aca20710101" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:09.342520 851 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:09.342617 851 leader_election.cc:304] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.343638 2386 raft_consensus.cc:2749] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.345825 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fe059e59c2b24ead87ef36e5b7cac5bf
I20260503 07:53:09.345749 1166 raft_consensus.cc:359] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:09.347178 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23b8c1768a15487ba9140acd77c4ff7b consensus state has no leader
I20260503 07:53:09.347329 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.348232 1166 raft_consensus.cc:385] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.348539 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2037b66d5de74f39bdb3761dc0ec5729"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.349329 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2037b66d5de74f39bdb3761dc0ec5729 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.350797 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_db0e35ee49fb4e15a61f954954cd12bd" } new_table_name: "default.Table_91ace72de407482a9e12864e33af5d91" modify_external_catalogs: true
I20260503 07:53:09.367565 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_12ec486261344161bd8fcd5894291c74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.368479 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12ec486261344161bd8fcd5894291c74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.067071 1175 raft_consensus.cc:2272] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.374321 1175 ts_tablet_manager.cc:1916] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.348374 891 tablet_service.cc:1558] Processing DeleteTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.374886 1166 raft_consensus.cc:740] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.376355 1166 consensus_queue.cc:260] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.377079 1166 ts_tablet_manager.cc:1434] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.037s user 0.001s sys 0.000s
I20260503 07:53:09.377398 1166 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:09.382221 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73d5d6444bbf415ca5feb27ca96ebcd5 consensus state has no leader
I20260503 07:53:09.383015 1171 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.383250 1171 ts_tablet_manager.cc:1403] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.240s user 0.021s sys 0.051s
I20260503 07:53:09.384248 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4d98077554f141b28214686f206b90b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:09.384248 1171 raft_consensus.cc:359] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.384683 1171 raft_consensus.cc:385] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:53:09.384757 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d98077554f141b28214686f206b90b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.384797 1171 raft_consensus.cc:740] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.385195 1171 consensus_queue.cc:260] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.386003 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_11c7a70cb53d46d09a5e968d1720f762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.386569 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11c7a70cb53d46d09a5e968d1720f762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.387228 1165 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.387369 1165 ts_tablet_manager.cc:1403] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.397s user 0.001s sys 0.001s
I20260503 07:53:09.388077 1165 raft_consensus.cc:359] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.388306 1165 raft_consensus.cc:385] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.388376 1165 raft_consensus.cc:740] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.388572 1165 consensus_queue.cc:260] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.391647 1171 ts_tablet_manager.cc:1434] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260503 07:53:09.391987 1171 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.394960 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b98fead8af7440bb08aa42b8af00167" } new_table_name: "default.Table_d6eceb09895b43d3a76f41c98c9acf5a" modify_external_catalogs: true
I20260503 07:53:09.395560 1171 tablet_bootstrap.cc:654] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.398290 2386 raft_consensus.cc:493] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:09.399063 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53a744819d0d419b9e856ae2176b9ab9 has no consensus state
I20260503 07:53:09.399122 2386 raft_consensus.cc:515] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.399748 2386 leader_election.cc:290] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:09.402010 851 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:09.404013 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_15d017bc81f944509caf3605b55506a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.404815 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15d017bc81f944509caf3605b55506a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.406028 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1682ce0a78774c818b995cd84ef71c24" } modify_external_catalogs: true
I20260503 07:53:09.406219 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1682ce0a78774c818b995cd84ef71c24" } modify_external_catalogs: true
I20260503 07:53:09.407219 2421 raft_consensus.cc:493] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.407359 2421 raft_consensus.cc:515] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.407930 2421 leader_election.cc:290] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:09.409958 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.410214 775 raft_consensus.cc:2468] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.410666 986 leader_election.cc:304] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:09.410924 2421 raft_consensus.cc:2804] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.410997 2421 raft_consensus.cc:493] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.411062 2421 raft_consensus.cc:3060] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.411506 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_614df9b3a0fa4a03ab70cc70d59fb99d" } modify_external_catalogs: true
I20260503 07:53:09.411706 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_614df9b3a0fa4a03ab70cc70d59fb99d" } modify_external_catalogs: true
I20260503 07:53:09.415786 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:09.416270 988 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.418696 2538 tablet.cc:1724] T 0f45941fd2c94161b5438fe65f858b95 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:09.420547 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 79531.3us
I20260503 07:53:09.421483 913 raft_consensus.cc:3060] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.432992 760 tablet_service.cc:1558] Processing DeleteTablet for tablet fe059e59c2b24ead87ef36e5b7cac5bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.434621 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4483da8794df4f2a94b7b28908a76dc2" } new_table_name: "default.Table_617f07674fa14a57a807dd2404ccb547" modify_external_catalogs: true
I20260503 07:53:09.437943 2386 raft_consensus.cc:493] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.438203 2386 raft_consensus.cc:515] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.439271 2386 leader_election.cc:290] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:09.440102 851 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:09.440723 1165 ts_tablet_manager.cc:1434] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260503 07:53:09.441061 1166 tablet_bootstrap.cc:654] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.441198 1165 tablet_bootstrap.cc:492] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.442878 1165 tablet_bootstrap.cc:654] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.448343 854 leader_election.cc:304] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.448413 2421 raft_consensus.cc:515] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:09.448866 854 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:09.449074 2421 leader_election.cc:290] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:09.454531 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_28bca3d5b54a4c9fa87e96f0ff6ab6e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.455132 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28bca3d5b54a4c9fa87e96f0ff6ab6e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.459551 2421 raft_consensus.cc:493] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.459683 2421 raft_consensus.cc:515] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.460306 2421 leader_election.cc:290] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.477109 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3c3518b900d542d0bbaa3d961fe42977" } modify_external_catalogs: true
I20260503 07:53:09.477442 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3c3518b900d542d0bbaa3d961fe42977" } modify_external_catalogs: true
I20260503 07:53:09.480634 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f2de368e66424e4d9edf7c840ac8071e
I20260503 07:53:09.482231 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet f2de368e66424e4d9edf7c840ac8071e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:09.482939 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b74af21d58e4fe7aaad590adff10c4e consensus state has no leader
I20260503 07:53:09.494498 1171 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.494640 1171 ts_tablet_manager.cc:1403] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.103s user 0.006s sys 0.009s
I20260503 07:53:09.495419 1171 raft_consensus.cc:359] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.495573 1171 raft_consensus.cc:385] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.495625 1171 raft_consensus.cc:740] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.495841 1171 consensus_queue.cc:260] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.499305 1171 ts_tablet_manager.cc:1434] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:53:09.499240 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1a31915dab804360889f9e08e8eb20bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:09.499607 1171 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:09.499850 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a31915dab804360889f9e08e8eb20bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.500629 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_77ad9b6ea12644dcab768e70974699c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.501071 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77ad9b6ea12644dcab768e70974699c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.501832 1171 tablet_bootstrap.cc:654] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.503173 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c7a7ad2250a3414aa5167d54c2c90941
I20260503 07:53:09.460000 2524 raft_consensus.cc:2749] T 08cfc6488f404a14af0b7aca20710101 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.461024 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.467511 918 raft_consensus.cc:3060] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:09.503907 988 leader_election.cc:343] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.504207 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:09.505093 879 tablet_service.cc:1558] Processing DeleteTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.473912 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:09.474195 2538 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:09.481770 891 tablet_service.cc:1558] Processing DeleteTablet for tablet f2de368e66424e4d9edf7c840ac8071e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:09.490832 917 raft_consensus.cc:3060] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.506896 854 leader_election.cc:304] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.507331 2524 raft_consensus.cc:2749] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:09.507709 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 58843.6us
W20260503 07:53:09.508664 988 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.522681 2421 consensus_queue.cc:1048] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:09.540124 2434 tablet.cc:1724] T 468a420c2a87466398cad5dfd959b3be P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.541047 2419 tablet.cc:1724] T 468a420c2a87466398cad5dfd959b3be P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.549073 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_838891067c3b4d54a5e0f2f6cdd18aca" } modify_external_catalogs: true
I20260503 07:53:09.549291 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_838891067c3b4d54a5e0f2f6cdd18aca" } modify_external_catalogs: true
W20260503 07:53:09.551512 988 consensus_peers.cc:597] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.552678 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a7c5e2fc2ee44029bc64a302a042a3fc" } new_table_name: "default.Table_0b15f87be9ea47fbb396e1fb1779685e" modify_external_catalogs: true
I20260503 07:53:09.464643 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.474598 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef746161e6b446ab0d299d37e2151ea" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:09.554836 780 raft_consensus.cc:2468] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.554869 775 raft_consensus.cc:3060] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.555644 986 leader_election.cc:304] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.556156 2113 raft_consensus.cc:2804] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.556260 2113 raft_consensus.cc:493] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.556324 2113 raft_consensus.cc:3060] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.484519 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f2de368e66424e4d9edf7c840ac8071e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:09.504879 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c7a7ad2250a3414aa5167d54c2c90941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:09.514294 715 consensus_peers.cc:597] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:09.559343 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 45083.3us
I20260503 07:53:09.563558 1171 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.564615 1171 ts_tablet_manager.cc:1403] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.004s
I20260503 07:53:09.565915 1175 ts_tablet_manager.cc:1929] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:09.567157 1175 log.cc:1199] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/376e9889ca584931ac1d91a9af2c0689
I20260503 07:53:09.567726 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c24b8806a2994e039df3e7eccf6ce8e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.568427 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c24b8806a2994e039df3e7eccf6ce8e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.567795 1175 ts_tablet_manager.cc:1950] T 376e9889ca584931ac1d91a9af2c0689 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:09.570861 1171 raft_consensus.cc:359] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.572883 1171 raft_consensus.cc:385] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.572980 1171 raft_consensus.cc:740] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.573248 1171 consensus_queue.cc:260] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:09.563017 854 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:09.577780 854 leader_election.cc:304] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.578308 2386 raft_consensus.cc:2749] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.578773 1171 ts_tablet_manager.cc:1434] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260503 07:53:09.583854 1171 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.584422 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11c7a70cb53d46d09a5e968d1720f762" } new_table_name: "default.Table_870965ffd55d465c9e6d769178dd9516" modify_external_catalogs: true
I20260503 07:53:09.586428 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6fc180ce0ac64713b8d194543bd1e19c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.587090 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fc180ce0ac64713b8d194543bd1e19c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.589802 1171 tablet_bootstrap.cc:654] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.595808 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_003603bc65c441bb8dc35a78daf67dff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.596338 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_003603bc65c441bb8dc35a78daf67dff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.599594 1171 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.601835 1171 ts_tablet_manager.cc:1403] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260503 07:53:09.602771 1171 raft_consensus.cc:359] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:09.604528 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e382ffd461ec4ef6a80f5c29c062747a has no consensus state
I20260503 07:53:09.604578 2555 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.605597 1171 raft_consensus.cc:385] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.605823 1171 raft_consensus.cc:740] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.606256 1171 consensus_queue.cc:260] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.607584 1173 ts_tablet_manager.cc:1929] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:09.607753 1173 log.cc:1199] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8c25addae8c94554a83344f07a11362f
I20260503 07:53:09.608263 1173 ts_tablet_manager.cc:1950] T 8c25addae8c94554a83344f07a11362f P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:09.610051 2554 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.611883 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3811f4c1bc364be0bd601ca29c32140f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.612490 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3811f4c1bc364be0bd601ca29c32140f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.613098 2536 tablet.cc:1724] T 468a420c2a87466398cad5dfd959b3be P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.612555 1171 ts_tablet_manager.cc:1434] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260503 07:53:09.616647 1165 tablet_bootstrap.cc:492] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.617022 1165 ts_tablet_manager.cc:1403] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.176s user 0.005s sys 0.000s
I20260503 07:53:09.619398 1165 raft_consensus.cc:359] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.621706 1171 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.623382 1171 tablet_bootstrap.cc:654] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.623618 1166 tablet_bootstrap.cc:492] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.623761 1166 ts_tablet_manager.cc:1403] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.246s user 0.002s sys 0.007s
I20260503 07:53:09.626171 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c63f9158079846f0870332b154d4ec1b" } new_table_name: "default.Table_84866aa1f64b48ea81a58d1fcdede26b" modify_external_catalogs: true
I20260503 07:53:09.632366 2386 raft_consensus.cc:493] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.632560 2386 raft_consensus.cc:515] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.638388 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5470a2dd25b944ab9ebcb89d71140c03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.639118 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5470a2dd25b944ab9ebcb89d71140c03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.639420 1171 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.639611 1171 ts_tablet_manager.cc:1403] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260503 07:53:09.640591 1171 raft_consensus.cc:359] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.640846 1171 raft_consensus.cc:385] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.640959 1171 raft_consensus.cc:740] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.641247 1171 consensus_queue.cc:260] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.642812 2113 raft_consensus.cc:515] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.643250 775 raft_consensus.cc:2468] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:09.643417 2113 leader_election.cc:290] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.644022 986 leader_election.cc:304] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.644248 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:09.644374 2113 raft_consensus.cc:2804] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.644416 779 raft_consensus.cc:3060] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.644481 2113 raft_consensus.cc:697] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:09.644680 2113 consensus_queue.cc:237] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.646409 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 940) took 2418 ms. Trace:
I20260503 07:53:09.646528 1175 rpcz_store.cc:276] 0503 07:53:07.227845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.234968 (+ 7123us) service_pool.cc:224] Handling call
0503 07:53:09.060715 (+1825747us) ts_tablet_manager.cc:1151] Deleting tablet 376e9889ca584931ac1d91a9af2c0689
0503 07:53:09.060724 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.450084 (+389360us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.565857 (+115773us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.646384 (+ 80527us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1825582}
I20260503 07:53:09.646917 1175 tablet_replica.cc:333] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:09.647166 1175 raft_consensus.cc:2243] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:09.647459 1175 pending_rounds.cc:70] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:09.647512 1175 pending_rounds.cc:77] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847451332898816 op_type: NO_OP noop_request { }
I20260503 07:53:09.649760 2506 tablet.cc:1724] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.650727 1174 ts_tablet_manager.cc:1929] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:09.650828 1174 log.cc:1199] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:09.651204 1174 ts_tablet_manager.cc:1950] T 5deea77f36d540bb8f721657b7e3500e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:09.647610 1175 raft_consensus.cc:2889] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:09.652522 1175 raft_consensus.cc:2272] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.653187 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 376e9889ca584931ac1d91a9af2c0689 (table default.Table_b6e488110fe04337ababb42ab1c2a09e [id=a8b412e854214ea5b5f338060fffdee9]) successfully deleted
I20260503 07:53:09.653666 1175 ts_tablet_manager.cc:1916] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.654783 779 raft_consensus.cc:2468] T 8f64902f16534103be2968bdc1823a9e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:09.655182 986 leader_election.cc:304] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:09.655480 2431 raft_consensus.cc:2804] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.655593 2431 raft_consensus.cc:697] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:09.655788 2431 consensus_queue.cc:237] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.658140 2538 tablet.cc:1724] T 79d43ae066e6411896c490f7c0b11180 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:09.658739 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_07967b4e81bd431e86edc76d6da158de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.659596 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07967b4e81bd431e86edc76d6da158de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.659701 1171 ts_tablet_manager.cc:1434] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260503 07:53:09.660013 1171 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.661335 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 863) took 2486 ms. Trace:
I20260503 07:53:09.661465 1173 rpcz_store.cc:276] 0503 07:53:07.174578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.175123 (+ 545us) service_pool.cc:224] Handling call
0503 07:53:09.062292 (+1887169us) ts_tablet_manager.cc:1151] Deleting tablet 8c25addae8c94554a83344f07a11362f
0503 07:53:09.062302 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.258103 (+195801us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.607506 (+349403us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.661316 (+ 53810us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1886721}
I20260503 07:53:09.662117 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8c25addae8c94554a83344f07a11362f (table default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]) successfully deleted
I20260503 07:53:09.662405 2386 leader_election.cc:290] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:09.662817 854 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
W20260503 07:53:09.663268 851 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:09.663389 851 leader_election.cc:304] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.663836 2386 raft_consensus.cc:2749] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.664194 1173 tablet_replica.cc:333] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:09.666195 1171 tablet_bootstrap.cc:654] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:09.671988 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6649b63c3d6242dabd3f431f0286e85e consensus state has no leader
I20260503 07:53:09.664538 1173 raft_consensus.cc:2243] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:09.663637 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f64902f16534103be2968bdc1823a9e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:09.674268 1173 raft_consensus.cc:2272] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:09.674640 988 leader_election.cc:343] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.676504 1171 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.676713 1171 ts_tablet_manager.cc:1403] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260503 07:53:09.677583 1171 raft_consensus.cc:359] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.677800 1171 raft_consensus.cc:385] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.677908 1171 raft_consensus.cc:740] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.678184 1171 consensus_queue.cc:260] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.678778 1171 ts_tablet_manager.cc:1434] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:09.679090 1171 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.680821 1171 tablet_bootstrap.cc:654] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.683161 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ff000c9c4ffa4a9fa3c562a60af5c3e0" } new_table_name: "default.Table_16e24ea564f14a3681373d5a30b276be" modify_external_catalogs: true
I20260503 07:53:09.699915 1173 ts_tablet_manager.cc:1916] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.702358 2434 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.704622 1171 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.704763 1171 ts_tablet_manager.cc:1403] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.000s
I20260503 07:53:09.705546 1171 raft_consensus.cc:359] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.705710 1171 raft_consensus.cc:385] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.705760 1171 raft_consensus.cc:740] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.705886 2113 raft_consensus.cc:493] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.705958 1171 consensus_queue.cc:260] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.706017 2113 raft_consensus.cc:515] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.706432 1171 ts_tablet_manager.cc:1434] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:09.706494 2113 leader_election.cc:290] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.706693 1171 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.708047 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:09.708518 986 leader_election.cc:343] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.708920 1171 tablet_bootstrap.cc:654] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.619853 1165 raft_consensus.cc:385] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.709628 1165 raft_consensus.cc:740] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.712615 1165 consensus_queue.cc:260] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.713127 1165 ts_tablet_manager.cc:1434] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.096s user 0.002s sys 0.000s
I20260503 07:53:09.717342 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8a88ad9c45e946f797289227f8a1defc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:09.718379 1165 tablet_bootstrap.cc:492] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.719729 1165 tablet_bootstrap.cc:654] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.726491 1166 raft_consensus.cc:359] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.726698 1166 raft_consensus.cc:385] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.726750 1166 raft_consensus.cc:740] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.726953 1166 consensus_queue.cc:260] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.727490 1166 ts_tablet_manager.cc:1434] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.104s user 0.002s sys 0.000s
I20260503 07:53:09.727437 2568 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.727779 1166 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.731279 2556 tablet.cc:1724] T 1f4446badf064ecabc01b330f3babde2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:09.731841 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_709c32e6c48c4f3cac8a32c47d3c8db9" } modify_external_catalogs: true
I20260503 07:53:09.732062 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_709c32e6c48c4f3cac8a32c47d3c8db9" } modify_external_catalogs: true
I20260503 07:53:09.733693 2431 raft_consensus.cc:493] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.733896 2431 raft_consensus.cc:515] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.734087 1166 tablet_bootstrap.cc:654] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.734302 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.735788 2431 leader_election.cc:290] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:09.736765 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.736809 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.736965 775 raft_consensus.cc:2468] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.737316 986 leader_election.cc:304] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:09.737970 988 leader_election.cc:343] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.738061 988 leader_election.cc:304] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:09.738125 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 833) took 4044 ms. Trace:
I20260503 07:53:09.738200 1174 rpcz_store.cc:276] 0503 07:53:05.693828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.702933 (+ 9105us) service_pool.cc:224] Handling call
0503 07:53:08.983975 (+3281042us) ts_tablet_manager.cc:1151] Deleting tablet 5deea77f36d540bb8f721657b7e3500e
0503 07:53:08.983985 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.205718 (+221733us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x6160001d3e54. stack: 00007f5f2044c086 00007f5f2044be40 00007f5f1f4053ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f5f2c38f7e0 00007f5f2d6e3283 00007f5f302a8a77 00007f5f302dbb44 00007f5f302bc560 00007f5f302bc2ed 0000000000aa4cac 00007f5f20491f6f 00007f5f2049528b 00007f5f20495108
0503 07:53:09.479091 (+273373us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.650674 (+171583us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.738107 (+ 87433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508581760,"tablet-delete.queue_time_us":3280873}
W20260503 07:53:09.738359 988 leader_election.cc:343] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.738664 2421 raft_consensus.cc:2804] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.738647 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5deea77f36d540bb8f721657b7e3500e (table default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]) successfully deleted
I20260503 07:53:09.738724 2421 raft_consensus.cc:493] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.738776 2421 raft_consensus.cc:3060] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.739022 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 837) took 3920 ms. Trace:
I20260503 07:53:09.739097 1174 rpcz_store.cc:276] 0503 07:53:05.818971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.821481 (+ 2510us) service_pool.cc:224] Handling call
0503 07:53:09.738895 (+3917414us) ts_tablet_manager.cc:1151] Deleting tablet 579b36bfb4794a34907720b8b75ebf5c
0503 07:53:09.738917 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.739006 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3917247}
W20260503 07:53:09.739507 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 579b36bfb4794a34907720b8b75ebf5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 579b36bfb4794a34907720b8b75ebf5c already in progress: creating tablet
I20260503 07:53:09.739782 1174 tablet_replica.cc:333] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:09.739986 1174 raft_consensus.cc:2243] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:09.740135 1174 raft_consensus.cc:2272] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.740442 2431 raft_consensus.cc:2749] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:09.740864 772 consensus_meta.cc:287] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.526s user 0.016s sys 0.000s
I20260503 07:53:09.740944 772 raft_consensus.cc:2468] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:09.741318 986 leader_election.cc:304] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.741707 1952 raft_consensus.cc:2804] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.741852 1952 raft_consensus.cc:697] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:09.742067 1952 consensus_queue.cc:237] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.744864 2565 raft_consensus.cc:493] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.745464 2565 raft_consensus.cc:515] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.746558 1174 ts_tablet_manager.cc:1916] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:09.747162 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:09.747617 2565 leader_election.cc:290] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:09.747677 716 leader_election.cc:343] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.752499 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:09.753005 715 leader_election.cc:343] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.753113 715 leader_election.cc:304] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.753554 2565 raft_consensus.cc:2749] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:09.756043 2506 tablet.cc:1719] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 4a924c2134c54fa0bb164825da53bdd0: Skipping requested alter to schema version 4, tablet already version 4
I20260503 07:53:09.757386 2554 tablet.cc:1719] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 0c11eb9ffa7845269a6a8000e8ff248f: Skipping requested alter to schema version 4, tablet already version 4
W20260503 07:53:09.767660 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a88ad9c45e946f797289227f8a1defc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.787328 2554 tablet.cc:1724] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260503 07:53:09.788738 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d08b5135cb77444bb5ff35c5f9d68129 consensus state has no leader
I20260503 07:53:09.789639 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6066f083a03438ab6d742e6aac144d0" } new_table_name: "default.Table_f7d6abb46e1542c2a900101ca6fa5099" modify_external_catalogs: true
W20260503 07:53:09.791213 988 consensus_peers.cc:597] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.791975 2113 consensus_queue.cc:1048] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:09.793540 918 raft_consensus.cc:3060] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.798635 2506 tablet.cc:1724] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.806082 2419 tablet.cc:1724] T 7d9edbc50a8e4194a46ecb1666daa5f1 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:09.817186 1166 tablet_bootstrap.cc:492] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.817400 1166 ts_tablet_manager.cc:1403] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.000s
I20260503 07:53:09.818629 1166 raft_consensus.cc:359] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.818900 1166 raft_consensus.cc:385] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.819007 1166 raft_consensus.cc:740] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.819291 1166 consensus_queue.cc:260] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.821175 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_dbcd0c3837fc45e7a8779f49d790e9f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.822084 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbcd0c3837fc45e7a8779f49d790e9f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.825726 1165 tablet_bootstrap.cc:492] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.825870 1165 ts_tablet_manager.cc:1403] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.108s user 0.007s sys 0.005s
I20260503 07:53:09.826781 1165 raft_consensus.cc:359] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.826949 1165 raft_consensus.cc:385] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.827000 1165 raft_consensus.cc:740] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.827224 1165 consensus_queue.cc:260] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.827693 1165 ts_tablet_manager.cc:1434] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:09.828085 1165 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.828095 1171 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.828246 1171 ts_tablet_manager.cc:1403] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.002s
I20260503 07:53:09.829077 1171 raft_consensus.cc:359] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.829329 1171 raft_consensus.cc:385] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.829491 1171 raft_consensus.cc:740] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.829849 1171 consensus_queue.cc:260] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.830790 1171 ts_tablet_manager.cc:1434] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:09.833290 1166 ts_tablet_manager.cc:1434] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260503 07:53:09.835523 1173 ts_tablet_manager.cc:1929] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:09.836004 1166 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:09.837497 1173 log.cc:1199] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/0e5f99c7855a4485b3523b68b0ea24c1
I20260503 07:53:09.837961 1173 ts_tablet_manager.cc:1950] T 0e5f99c7855a4485b3523b68b0ea24c1 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:09.836103 2421 raft_consensus.cc:515] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.839099 2421 leader_election.cc:290] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:09.843732 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 45186.9us
I20260503 07:53:09.844542 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:09.846433 1165 tablet_bootstrap.cc:654] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:09.847569 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a7af140ce144bc8b2e147dad98ac201 consensus state has no leader
I20260503 07:53:09.847913 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cdfd677bac8248749219a17f174d571b" } modify_external_catalogs: true
I20260503 07:53:09.848104 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cdfd677bac8248749219a17f174d571b" } modify_external_catalogs: true
W20260503 07:53:09.845130 988 leader_election.cc:343] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:09.859009 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:09.859300 772 raft_consensus.cc:3060] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.865200 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5eb67445b84f47009db70743ef0767ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:09.865448 1166 tablet_bootstrap.cc:654] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:09.865801 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eb67445b84f47009db70743ef0767ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:09.846189 1171 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.867733 1171 tablet_bootstrap.cc:654] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.875171 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_aa13ddecf6574581b4989e7c33515014"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.876405 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa13ddecf6574581b4989e7c33515014 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:09.878749 852 connection.cc:570] client connection to 127.0.105.61:41759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:53:09.879004 987 connection.cc:570] client connection to 127.0.105.61:41759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:53:09.879042 714 connection.cc:570] client connection to 127.0.105.61:41759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 07:53:09.880080 586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.61:41759 (error 108) [suppressed 9 similar messages]
I20260503 07:53:09.880929 1165 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.881083 1165 ts_tablet_manager.cc:1403] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260503 07:53:09.881831 1165 raft_consensus.cc:359] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.881991 1165 raft_consensus.cc:385] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.882037 1165 raft_consensus.cc:740] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.882236 1165 consensus_queue.cc:260] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.882671 1165 ts_tablet_manager.cc:1434] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:09.882915 1165 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.884361 1165 tablet_bootstrap.cc:654] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.908931 1166 tablet_bootstrap.cc:492] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:09.909300 1166 ts_tablet_manager.cc:1403] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.001s
I20260503 07:53:09.910234 1166 raft_consensus.cc:359] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.910425 1166 raft_consensus.cc:385] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.910478 1166 raft_consensus.cc:740] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.910635 2457 raft_consensus.cc:493] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:09.910681 1166 consensus_queue.cc:260] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.910785 2457 raft_consensus.cc:515] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.911119 1166 ts_tablet_manager.cc:1434] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:09.911329 2457 leader_election.cc:290] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.911381 1166 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:09.914706 715 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Not found: Tablet not found: 36b6147bab7a44b19b4a22addf68961f
W20260503 07:53:09.916620 716 leader_election.cc:343] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 36b6147bab7a44b19b4a22addf68961f
I20260503 07:53:09.916716 716 leader_election.cc:304] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.917249 2565 raft_consensus.cc:2749] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:09.932432 1175 ts_tablet_manager.cc:1929] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:09.932542 1175 log.cc:1199] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/61316b7a521e42a59bf955179b080f40
I20260503 07:53:09.932852 1175 ts_tablet_manager.cc:1950] T 61316b7a521e42a59bf955179b080f40 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:09.936015 772 raft_consensus.cc:2468] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:09.938989 986 leader_election.cc:304] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:09.939342 2431 raft_consensus.cc:2804] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:09.939441 2431 raft_consensus.cc:697] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:09.939644 2431 consensus_queue.cc:237] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.940961 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 865) took 2707 ms. Trace:
I20260503 07:53:09.945137 2555 tablet.cc:1719] T 5cfbfc18284c4d7385c7d0e9ea1a42f2 P 48acfab19cf04a069d5166d663adb3c3: Skipping requested alter to schema version 4, tablet already version 4
W20260503 07:53:09.945772 586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 65660us
I20260503 07:53:09.946667 1165 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.946800 1165 ts_tablet_manager.cc:1403] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.019s
I20260503 07:53:09.947521 1165 raft_consensus.cc:359] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.947677 1165 raft_consensus.cc:385] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.947721 1165 raft_consensus.cc:740] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.947916 1165 consensus_queue.cc:260] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.948421 1165 ts_tablet_manager.cc:1434] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:09.948563 1171 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.948661 1165 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.948671 1171 ts_tablet_manager.cc:1403] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.004s
I20260503 07:53:09.950165 1165 tablet_bootstrap.cc:654] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.952399 2431 raft_consensus.cc:493] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.952520 2431 raft_consensus.cc:515] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.953222 2431 leader_election.cc:290] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.953662 1171 raft_consensus.cc:359] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.953804 1171 raft_consensus.cc:385] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.953830 1165 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:09.953852 1171 raft_consensus.cc:740] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.953965 1165 ts_tablet_manager.cc:1403] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:53:09.954020 1171 consensus_queue.cc:260] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.955011 1171 ts_tablet_manager.cc:1434] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260503 07:53:09.955317 1171 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:09.956048 1165 raft_consensus.cc:359] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.956246 1165 raft_consensus.cc:385] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:09.956295 1165 raft_consensus.cc:740] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:09.956488 1165 consensus_queue.cc:260] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.956921 1171 tablet_bootstrap.cc:654] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.956950 1165 ts_tablet_manager.cc:1434] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:09.957178 1165 tablet_bootstrap.cc:492] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:09.958603 1165 tablet_bootstrap.cc:654] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:09.961112 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.961287 774 raft_consensus.cc:2468] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.961954 986 leader_election.cc:304] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:09.962302 2577 raft_consensus.cc:2804] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.962376 2577 raft_consensus.cc:493] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:09.962435 2577 raft_consensus.cc:3060] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:09.965916 2421 raft_consensus.cc:493] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.966048 2421 raft_consensus.cc:515] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.966742 2421 leader_election.cc:290] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:09.969193 1171 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:09.941084 1173 rpcz_store.cc:276] 0503 07:53:07.233062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.233837 (+ 775us) service_pool.cc:224] Handling call
0503 07:53:09.664114 (+2430277us) ts_tablet_manager.cc:1151] Deleting tablet 0e5f99c7855a4485b3523b68b0ea24c1
0503 07:53:09.664129 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.832659 (+168530us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.835479 (+ 2820us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.940932 (+105453us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2430032}
I20260503 07:53:09.970455 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 875) took 2477 ms. Trace:
I20260503 07:53:09.970562 1173 rpcz_store.cc:276] 0503 07:53:07.493240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.493455 (+ 215us) service_pool.cc:224] Handling call
0503 07:53:09.970275 (+2476820us) ts_tablet_manager.cc:1151] Deleting tablet 9aa3759511d942bfbc6e50ea2e2f2777
0503 07:53:09.970291 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.970429 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2473037}
I20260503 07:53:09.971334 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 0e5f99c7855a4485b3523b68b0ea24c1 (table default.Table_3ad664ab8d5b44e388431152c86fa2c2 [id=c9e5792ef53e4b6abc2adf6406f10623]) successfully deleted
W20260503 07:53:09.971623 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 9aa3759511d942bfbc6e50ea2e2f2777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aa3759511d942bfbc6e50ea2e2f2777 already in progress: creating tablet
I20260503 07:53:09.971818 2524 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:09.971927 2524 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:09.972311 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:09.972478 774 raft_consensus.cc:2468] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:09.973289 986 leader_election.cc:304] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:09.973671 1171 ts_tablet_manager.cc:1403] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260503 07:53:09.975488 1171 raft_consensus.cc:359] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:09.979493 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 876) took 2486 ms. Trace:
I20260503 07:53:09.980697 1166 tablet_bootstrap.cc:654] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:09.984580 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:09.979609 1173 rpcz_store.cc:276] 0503 07:53:07.493402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.495354 (+ 1952us) service_pool.cc:224] Handling call
0503 07:53:09.970836 (+2475482us) ts_tablet_manager.cc:1151] Deleting tablet acbfff84673541929083cbc13b059398
0503 07:53:09.970846 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.979464 (+ 8618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2473463}
I20260503 07:53:09.986407 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 873) took 2509 ms. Trace:
I20260503 07:53:09.986479 1173 rpcz_store.cc:276] 0503 07:53:07.476464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.488229 (+ 11765us) service_pool.cc:224] Handling call
0503 07:53:09.986263 (+2498034us) ts_tablet_manager.cc:1151] Deleting tablet a328057ceb3640d1a26b773862492f04
0503 07:53:09.986276 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.986367 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2488851}
I20260503 07:53:09.986773 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 877) took 2478 ms. Trace:
I20260503 07:53:09.986833 1173 rpcz_store.cc:276] 0503 07:53:07.508094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.509773 (+ 1679us) service_pool.cc:224] Handling call
0503 07:53:09.986679 (+2476906us) ts_tablet_manager.cc:1151] Deleting tablet 17b58e042a6442658d95d373409fa25e
0503 07:53:09.986687 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.986759 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2476667}
I20260503 07:53:09.987053 1173 tablet_replica.cc:333] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:09.986984 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_06bac08106464609a451d7c139e2675c" } new_table_name: "default.Table_b9fdcdcde6b2490a81b1cbfa679b4834" modify_external_catalogs: true
I20260503 07:53:09.987241 1173 raft_consensus.cc:2243] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:09.992256 2524 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:09.992820 1173 raft_consensus.cc:2272] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:09.995014 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:09.995110 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:09.996143 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56d5a84f62f446c488a7e02be814a26c consensus state has no leader
I20260503 07:53:09.996714 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_09b279a4b8654d5e9ddb5aae42a2d480"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:09.997197 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09b279a4b8654d5e9ddb5aae42a2d480 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:09.997865 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet acbfff84673541929083cbc13b059398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acbfff84673541929083cbc13b059398 already in progress: creating tablet
W20260503 07:53:09.998246 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet a328057ceb3640d1a26b773862492f04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a328057ceb3640d1a26b773862492f04 already in progress: creating tablet
W20260503 07:53:09.998582 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 17b58e042a6442658d95d373409fa25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17b58e042a6442658d95d373409fa25e already in progress: creating tablet
I20260503 07:53:09.998750 1173 ts_tablet_manager.cc:1916] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:09.999614 851 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
W20260503 07:53:10.000007 851 consensus_peers.cc:597] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e162006cee34182b51f97629a174509. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:10.004026 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7a4fc080fdcc4332aade3874b1685db1" } new_table_name: "default.Table_6d19f1e09913434d875e3a17f0832791" modify_external_catalogs: true
I20260503 07:53:09.973798 2431 raft_consensus.cc:2804] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:09.994000 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5deea77f36d540bb8f721657b7e3500e" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:09.995883 988 consensus_peers.cc:597] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:10.006093 988 leader_election.cc:343] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:10.006418 988 leader_election.cc:343] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.007304 854 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.004951 2421 consensus_queue.cc:1048] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.008850 2431 raft_consensus.cc:493] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.009021 2431 raft_consensus.cc:3060] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.009685 2591 raft_consensus.cc:2749] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.009980 1171 raft_consensus.cc:385] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.010107 1171 raft_consensus.cc:740] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:10.010342 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef666aa007504682bc044cbd0b56060d consensus state has no leader
I20260503 07:53:10.010385 1171 consensus_queue.cc:260] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.010740 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4e0954b14b3b420a9aebc96e192e0859"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.011282 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e0954b14b3b420a9aebc96e192e0859 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.012475 1171 ts_tablet_manager.cc:1434] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.038s user 0.000s sys 0.002s
I20260503 07:53:10.015103 2565 raft_consensus.cc:493] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:10.015260 2565 raft_consensus.cc:515] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.015836 2565 leader_election.cc:290] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:10.017297 716 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 6a2a1079ce0e4e6da9779ccd401e98f9
W20260503 07:53:10.017652 715 leader_election.cc:343] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Not found: Tablet not found: 6a2a1079ce0e4e6da9779ccd401e98f9
I20260503 07:53:10.017632 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6b850b1ebc7545aa8ba22c0d794201b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:10.017732 715 leader_election.cc:304] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:10.018155 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b850b1ebc7545aa8ba22c0d794201b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.018831 1166 tablet_bootstrap.cc:492] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.018959 1166 ts_tablet_manager.cc:1403] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.108s user 0.002s sys 0.001s
I20260503 07:53:10.019641 1166 raft_consensus.cc:359] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.019795 1166 raft_consensus.cc:385] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.019847 1166 raft_consensus.cc:740] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.020408 1166 consensus_queue.cc:260] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.021533 2565 raft_consensus.cc:2749] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:10.022119 1166 ts_tablet_manager.cc:1434] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:10.024130 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4a226e0c25d2475b97321d18bf53e6d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:10.024708 1166 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.026531 1166 tablet_bootstrap.cc:654] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:10.024726 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a226e0c25d2475b97321d18bf53e6d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.028177 1165 tablet_bootstrap.cc:492] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.028352 1165 ts_tablet_manager.cc:1403] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.024s
I20260503 07:53:10.032934 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 6720679e01e44baaa1501c8dbadba08a from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:10.034566 1174 ts_tablet_manager.cc:1929] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.034660 1174 log.cc:1199] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:10.035008 1174 ts_tablet_manager.cc:1950] T e662fd10883b401c8f0d4a45735e2639 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:10.037675 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 838) took 4203 ms. Trace:
I20260503 07:53:10.037758 1174 rpcz_store.cc:276] 0503 07:53:05.834326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.834388 (+ 62us) service_pool.cc:224] Handling call
0503 07:53:09.739739 (+3905351us) ts_tablet_manager.cc:1151] Deleting tablet e662fd10883b401c8f0d4a45735e2639
0503 07:53:09.739748 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.832687 (+ 92939us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.034515 (+201828us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.037659 (+ 3144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3905160}
I20260503 07:53:10.039100 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 839) took 4181 ms. Trace:
I20260503 07:53:10.039177 1174 rpcz_store.cc:276] 0503 07:53:05.857710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.857792 (+ 82us) service_pool.cc:224] Handling call
0503 07:53:10.038989 (+4181197us) ts_tablet_manager.cc:1151] Deleting tablet 7cca44c2622e4f9493d71e59fc3056ae
0503 07:53:10.038998 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.039085 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4180933}
I20260503 07:53:10.039479 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 840) took 4160 ms. Trace:
I20260503 07:53:10.039544 1174 rpcz_store.cc:276] 0503 07:53:05.879528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.881360 (+ 1832us) service_pool.cc:224] Handling call
0503 07:53:10.039391 (+4158031us) ts_tablet_manager.cc:1151] Deleting tablet bfb51a2a01aa4806aedc3a2b76908477
0503 07:53:10.039399 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.039465 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4157838}
I20260503 07:53:10.039789 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 841) took 4136 ms. Trace:
I20260503 07:53:10.039845 1174 rpcz_store.cc:276] 0503 07:53:05.902932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.903254 (+ 322us) service_pool.cc:224] Handling call
0503 07:53:10.039705 (+4136451us) ts_tablet_manager.cc:1151] Deleting tablet 9833d3b3bf174720b5da54e19ae8e015
0503 07:53:10.039714 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.039777 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4136261}
I20260503 07:53:10.040091 1165 raft_consensus.cc:359] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.041138 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e662fd10883b401c8f0d4a45735e2639 (table default.Table_9b18605b4adc4e3a80ea92cc4be7f484 [id=04f2fc2b32524124b168e59b80670c7e]) successfully deleted
W20260503 07:53:10.041414 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7cca44c2622e4f9493d71e59fc3056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cca44c2622e4f9493d71e59fc3056ae already in progress: creating tablet
W20260503 07:53:10.041627 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bfb51a2a01aa4806aedc3a2b76908477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfb51a2a01aa4806aedc3a2b76908477 already in progress: creating tablet
W20260503 07:53:10.041815 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9833d3b3bf174720b5da54e19ae8e015 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9833d3b3bf174720b5da54e19ae8e015 already in progress: creating tablet
I20260503 07:53:10.023152 2421 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.045073 2421 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.045599 2421 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.035319 2577 raft_consensus.cc:515] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.046062 2577 leader_election.cc:290] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.036751 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 944) took 2739 ms. Trace:
I20260503 07:53:10.046941 1175 rpcz_store.cc:276] 0503 07:53:07.297302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.303423 (+ 6121us) service_pool.cc:224] Handling call
0503 07:53:09.646866 (+2343443us) ts_tablet_manager.cc:1151] Deleting tablet 61316b7a521e42a59bf955179b080f40
0503 07:53:09.646877 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:09.836324 (+189447us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:09.932369 (+ 96045us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.036733 (+104364us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2342998}
I20260503 07:53:10.047259 1175 tablet_replica.cc:333] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:10.047441 1175 raft_consensus.cc:2243] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:10.047576 1175 raft_consensus.cc:2272] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.048043 1175 ts_tablet_manager.cc:1916] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.049479 1171 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.038144 2431 raft_consensus.cc:515] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.050671 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.051065 1171 tablet_bootstrap.cc:654] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.051399 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 61316b7a521e42a59bf955179b080f40 (table default.Table_5d8b2c631087445188d01c39291fb9a3 [id=e211b19acaf94e3d9c00d4e88d23f4f2]) successfully deleted
I20260503 07:53:10.051652 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.053426 988 leader_election.cc:343] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.040141 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 842) took 4130 ms. Trace:
W20260503 07:53:10.053666 988 leader_election.cc:343] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.053722 1174 rpcz_store.cc:276] 0503 07:53:05.909709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:05.940513 (+ 30804us) service_pool.cc:224] Handling call
0503 07:53:10.040037 (+4099524us) ts_tablet_manager.cc:1151] Deleting tablet 5776840523f54e6bb18d674815d3b447
0503 07:53:10.040045 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.040129 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4083385}
I20260503 07:53:10.054289 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 849) took 3842 ms. Trace:
W20260503 07:53:10.054396 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5776840523f54e6bb18d674815d3b447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5776840523f54e6bb18d674815d3b447 already in progress: creating tablet
I20260503 07:53:10.054369 1174 rpcz_store.cc:276] 0503 07:53:06.212208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.212265 (+ 57us) service_pool.cc:224] Handling call
0503 07:53:10.054181 (+3841916us) ts_tablet_manager.cc:1151] Deleting tablet c4f85848e3ad467a98b34e314c4c0ac9
0503 07:53:10.054191 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.054273 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3841683}
I20260503 07:53:10.054636 1174 tablet_replica.cc:333] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:10.054800 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c4f85848e3ad467a98b34e314c4c0ac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4f85848e3ad467a98b34e314c4c0ac9 already in progress: creating tablet
I20260503 07:53:10.054821 1174 raft_consensus.cc:2243] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:10.055377 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.055441 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.055580 775 raft_consensus.cc:3060] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:10.055809 988 leader_election.cc:343] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.057394 1174 raft_consensus.cc:2272] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.057873 1174 ts_tablet_manager.cc:1916] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.060431 2431 leader_election.cc:290] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.049702 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.060803 774 raft_consensus.cc:3060] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.050465 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.061286 772 raft_consensus.cc:2468] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.061671 986 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.062106 2431 raft_consensus.cc:2804] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.062222 2431 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.062326 2431 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.040275 1165 raft_consensus.cc:385] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.064935 1165 raft_consensus.cc:740] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.065215 1165 consensus_queue.cc:260] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.068300 1165 ts_tablet_manager.cc:1434] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260503 07:53:10.069712 1165 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.072208 1165 tablet_bootstrap.cc:654] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.072732 1171 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.072907 1171 ts_tablet_manager.cc:1403] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260503 07:53:10.073625 1171 raft_consensus.cc:359] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.074399 1166 tablet_bootstrap.cc:492] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.074533 1166 ts_tablet_manager.cc:1403] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.001s
I20260503 07:53:10.075139 1166 raft_consensus.cc:359] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.075309 1166 raft_consensus.cc:385] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.075369 1166 raft_consensus.cc:740] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.075405 1171 raft_consensus.cc:385] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.075556 1171 raft_consensus.cc:740] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.075613 1166 consensus_queue.cc:260] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.075909 1171 consensus_queue.cc:260] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.078293 2577 raft_consensus.cc:493] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.078433 2577 raft_consensus.cc:515] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.078995 2577 leader_election.cc:290] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.079304 2591 raft_consensus.cc:493] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.079422 2591 raft_consensus.cc:515] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.079996 2591 leader_election.cc:290] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.080096 2524 raft_consensus.cc:493] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.080283 2524 raft_consensus.cc:515] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.080641 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.080758 2524 leader_election.cc:290] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:10.081684 988 leader_election.cc:343] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.081851 2577 raft_consensus.cc:493] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.082089 1171 ts_tablet_manager.cc:1434] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260503 07:53:10.082104 2577 raft_consensus.cc:515] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:10.082254 854 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 376e9889ca584931ac1d91a9af2c0689
I20260503 07:53:10.082412 1171 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:10.082430 854 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: a117f416c611418a96963db600da1d04
I20260503 07:53:10.082652 2577 leader_election.cc:290] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.082899 1166 ts_tablet_manager.cc:1434] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260503 07:53:10.083298 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.083330 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.083442 779 raft_consensus.cc:2468] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
W20260503 07:53:10.083722 988 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.084022 986 leader_election.cc:304] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.084393 2577 raft_consensus.cc:2804] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.084486 2577 raft_consensus.cc:493] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.084573 2577 raft_consensus.cc:3060] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.079833 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.085146 986 leader_election.cc:343] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.085275 986 leader_election.cc:304] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.085407 1166 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.085567 2421 raft_consensus.cc:2749] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:10.085880 851 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: a117f416c611418a96963db600da1d04
I20260503 07:53:10.085976 851 leader_election.cc:304] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:10.086318 851 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 376e9889ca584931ac1d91a9af2c0689
I20260503 07:53:10.086395 851 leader_election.cc:304] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.086815 2524 raft_consensus.cc:2749] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.086977 2524 raft_consensus.cc:2749] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.089743 1166 tablet_bootstrap.cc:654] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.092075 1171 tablet_bootstrap.cc:654] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.098835 1165 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.098994 1165 ts_tablet_manager.cc:1403] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260503 07:53:10.099989 1165 raft_consensus.cc:359] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.100157 1165 raft_consensus.cc:385] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.100257 1165 raft_consensus.cc:740] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.100466 1165 consensus_queue.cc:260] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.100944 1165 ts_tablet_manager.cc:1434] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:10.101223 1165 tablet_bootstrap.cc:492] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.102694 1165 tablet_bootstrap.cc:654] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.104403 1171 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.104568 1171 ts_tablet_manager.cc:1403] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260503 07:53:10.105271 1171 raft_consensus.cc:359] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.105446 1171 raft_consensus.cc:385] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.105507 1171 raft_consensus.cc:740] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.105681 1171 consensus_queue.cc:260] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.106123 1171 ts_tablet_manager.cc:1434] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:10.109030 2565 raft_consensus.cc:493] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.109159 2565 raft_consensus.cc:515] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.109658 2565 leader_election.cc:290] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.110042 1166 tablet_bootstrap.cc:492] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.110193 1166 ts_tablet_manager.cc:1403] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
I20260503 07:53:10.110502 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de65c754b47440a914f3f2bdb86059c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.110865 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de65c754b47440a914f3f2bdb86059c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.111028 1050 raft_consensus.cc:2468] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:10.111058 1166 raft_consensus.cc:359] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.111259 1166 raft_consensus.cc:385] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.111322 1166 raft_consensus.cc:740] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.111532 716 leader_election.cc:304] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:10.111531 1166 consensus_queue.cc:260] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.112288 1166 ts_tablet_manager.cc:1434] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260503 07:53:10.112706 715 leader_election.cc:343] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.113721 1166 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.114424 1171 tablet_bootstrap.cc:492] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.115003 1165 tablet_bootstrap.cc:492] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.115118 1165 ts_tablet_manager.cc:1403] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260503 07:53:10.116479 2565 raft_consensus.cc:2804] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.116551 2565 raft_consensus.cc:493] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.116603 2565 raft_consensus.cc:3060] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.116961 2421 raft_consensus.cc:493] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.117087 2421 raft_consensus.cc:515] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.117551 2421 leader_election.cc:290] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.120900 1166 tablet_bootstrap.cc:654] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.122890 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:10.123112 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]). Expected version 1 got 0
I20260503 07:53:10.123095 1165 raft_consensus.cc:359] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.123302 1165 raft_consensus.cc:385] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.123363 1165 raft_consensus.cc:740] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.123626 1165 consensus_queue.cc:260] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.124325 1165 ts_tablet_manager.cc:1434] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260503 07:53:10.125743 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_184be13fa24a4b018786f553392278f4 [id=a72fb85d9f1f4adeb68adfa64c805775] alter complete (version 1)
W20260503 07:53:10.127086 596 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.3:37895 (request call id 125) took 1089 ms (client timeout 1000 ms). Trace:
I20260503 07:53:10.127435 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7439917c2a764658bfa8bf62ba67e34f (DEFAULT_TABLE table=default.Table_12ecbb3af87d4ca4bddbb7b3fd353682 [id=aaef799eb0f34558b7c963ab0eafb58a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:10.127193 596 rpcz_store.cc:269] 0503 07:53:09.037212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.126272 (+ 89060us) service_pool.cc:224] Handling call
0503 07:53:09.133530 (+ 7258us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:10.127009 (+993479us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:09.200051 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:09.200206 (+ 155us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:09.200215 (+ 9us) write_op.cc:435] Acquired schema lock
0503 07:53:09.200219 (+ 4us) tablet.cc:662] Decoding operations
0503 07:53:09.200318 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:09.200327 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:09.200331 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:09.200384 (+ 53us) tablet.cc:701] Row locks acquired
0503 07:53:09.200386 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:09.200420 (+ 34us) write_op.cc:270] Start()
0503 07:53:09.200451 (+ 31us) write_op.cc:276] Timestamp: P: 1777794789200367 usec, L: 0
0503 07:53:09.200455 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:09.243751 (+ 43296us) log.cc:844] Serialized 356 byte log entry
0503 07:53:09.243923 (+ 172us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007ff8f8eaef22 00007ff8fa297c55 00007ff8fa296779 00007ff8fa29eba0 00007ff8fa29e9ad 0000000000aa4cac 00007ff8ecfdbf6f 00007ff8ecfdf28b 00007ff8ecfdf108 0000000000aa4cac
0503 07:53:09.266238 (+ 22315us) op_driver.cc:464] REPLICATION: finished
0503 07:53:09.266812 (+ 574us) write_op.cc:301] APPLY: starting
0503 07:53:09.266825 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:09.266859 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:09.266864 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:09.266926 (+ 62us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:09.266960 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:09.266972 (+ 12us) write_op.cc:312] APPLY: finished
0503 07:53:09.267034 (+ 62us) log.cc:844] Serialized 23 byte log entry
0503 07:53:09.267080 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:09.267095 (+ 15us) write_op.cc:454] Released schema lock
0503 07:53:09.267101 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":14802176,"child_traces":[["op",{"apply.queue_time_us":534,"apply.run_cpu_time_us":352,"apply.run_wall_time_us":351,"num_ops":1,"prepare.queue_time_us":202,"prepare.run_cpu_time_us":1501,"prepare.run_wall_time_us":44569,"raft.queue_time_us":32,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":207,"replication_time_us":65761,"spinlock_wait_cycles":99216256}]]}
I20260503 07:53:10.130508 1171 tablet_bootstrap.cc:654] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.130986 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.131225 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.131937 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bf46b34b1043e2ab6c9f8b2c871227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.132346 879 tablet_service.cc:1511] Processing CreateTablet for tablet 7439917c2a764658bfa8bf62ba67e34f (DEFAULT_TABLE table=default.Table_12ecbb3af87d4ca4bddbb7b3fd353682 [id=aaef799eb0f34558b7c963ab0eafb58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.132648 896 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7a0272fdc34044af78ba21b6ca31bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.132784 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.133363 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fe06a56f70487ea7c479b107d83d8b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.134732 760 tablet_service.cc:1511] Processing CreateTablet for tablet 7439917c2a764658bfa8bf62ba67e34f (DEFAULT_TABLE table=default.Table_12ecbb3af87d4ca4bddbb7b3fd353682 [id=aaef799eb0f34558b7c963ab0eafb58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.135059 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fe06a56f70487ea7c479b107d83d8b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.138458 2577 raft_consensus.cc:515] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.138625 775 raft_consensus.cc:2468] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.139099 2577 leader_election.cc:290] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.141525 2524 raft_consensus.cc:493] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.141659 2524 raft_consensus.cc:515] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.142242 2524 leader_election.cc:290] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.143522 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.136113 2431 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.144753 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7439917c2a764658bfa8bf62ba67e34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.144834 2431 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.145067 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7439917c2a764658bfa8bf62ba67e34f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:10.146804 988 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.148590 986 leader_election.cc:304] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.149065 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.149257 2574 raft_consensus.cc:2804] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.149392 2574 raft_consensus.cc:697] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.149658 2574 consensus_queue.cc:237] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:10.149950 988 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:10.150066 851 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 61316b7a521e42a59bf955179b080f40
W20260503 07:53:10.150480 988 leader_election.cc:343] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:10.150898 854 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 61316b7a521e42a59bf955179b080f40
I20260503 07:53:10.151032 854 leader_election.cc:304] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.151361 2591 raft_consensus.cc:2749] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.151547 2457 raft_consensus.cc:493] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.151674 2457 raft_consensus.cc:515] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.152022 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.152191 779 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.152143 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.152297 775 raft_consensus.cc:3060] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:10.152760 592 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.2:51725 (request call id 199) took 1100 ms (client timeout 1000 ms). Trace:
I20260503 07:53:10.152841 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db13f91ef1d740c387bacbb689ddf1a8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.153021 1050 raft_consensus.cc:2468] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:10.152887 592 rpcz_store.cc:269] 0503 07:53:09.028556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.029292 (+ 736us) service_pool.cc:224] Handling call
0503 07:53:09.147606 (+118314us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:10.129438 (+981832us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":270805760}
I20260503 07:53:10.154145 716 leader_election.cc:304] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:10.154728 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f481b7a1d80f4d70b7f976e55e0c3c83" } new_table_name: "default.Table_eb390da88f1447448a900b2aa205b223" modify_external_catalogs: true
I20260503 07:53:10.152307 2457 leader_election.cc:290] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:10.155633 2457 raft_consensus.cc:2804] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.155689 2457 raft_consensus.cc:493] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.155745 2457 raft_consensus.cc:3060] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:10.156402 595 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.1:41325 (request call id 161) took 1080 ms (client timeout 1000 ms). Trace:
I20260503 07:53:10.156526 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.156812 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db13f91ef1d740c387bacbb689ddf1a8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.157265 715 leader_election.cc:343] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:10.157179 595 rpcz_store.cc:269] 0503 07:53:09.075705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.171698 (+ 95993us) service_pool.cc:224] Handling call
0503 07:53:09.179342 (+ 7644us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:10.156365 (+977023us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":15793024}
I20260503 07:53:10.158989 2431 raft_consensus.cc:493] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.159117 2431 raft_consensus.cc:515] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.159683 2431 leader_election.cc:290] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.159818 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 0f707cb0257c4d6182ec331a235ba06c (DEFAULT_TABLE table=default.Table_cdfd677bac8248749219a17f174d571b [id=2811ef30798b4c7aaaa100120d3ef78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.160208 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2beb13a5d2844d44a3146d7937c8e964
I20260503 07:53:10.160379 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.160524 778 raft_consensus.cc:2468] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.160874 986 leader_election.cc:304] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:10.161114 2431 raft_consensus.cc:2804] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.161214 2431 raft_consensus.cc:493] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.161316 2431 raft_consensus.cc:3060] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.162263 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.163641 917 raft_consensus.cc:3060] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.163755 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.164047 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:10.164244 988 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.165272 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 2beb13a5d2844d44a3146d7937c8e964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.166450 879 tablet_service.cc:1511] Processing CreateTablet for tablet 0f707cb0257c4d6182ec331a235ba06c (DEFAULT_TABLE table=default.Table_cdfd677bac8248749219a17f174d571b [id=2811ef30798b4c7aaaa100120d3ef78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.169399 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0f707cb0257c4d6182ec331a235ba06c
I20260503 07:53:10.169406 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0f707cb0257c4d6182ec331a235ba06c (DEFAULT_TABLE table=default.Table_cdfd677bac8248749219a17f174d571b [id=2811ef30798b4c7aaaa100120d3ef78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.170054 593 master_service.cc:954] ReplaceTablet: received request to replace tablet 64c6dad26de642879307b7dca6ae85f5 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:10.170197 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b216e8fdaefa4757b1c0567eae3749ee (DEFAULT_TABLE table=default.Table_b3a1aceccf7a4cebbb1849e7d7ae8d32 [id=4e5c9cbce9dc4aa5a67d312886ac21a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.170964 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f707cb0257c4d6182ec331a235ba06c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.171530 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f707cb0257c4d6182ec331a235ba06c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.172050 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f707cb0257c4d6182ec331a235ba06c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.175225 1166 tablet_bootstrap.cc:492] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.175398 1166 ts_tablet_manager.cc:1403] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20260503 07:53:10.176486 1166 raft_consensus.cc:359] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.176714 1166 raft_consensus.cc:385] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.176776 1166 raft_consensus.cc:740] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.177027 1166 consensus_queue.cc:260] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.177603 1166 ts_tablet_manager.cc:1434] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:10.177958 1166 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.179693 1166 tablet_bootstrap.cc:654] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.179937 892 tablet_service.cc:1511] Processing CreateTablet for tablet b216e8fdaefa4757b1c0567eae3749ee (DEFAULT_TABLE table=default.Table_b3a1aceccf7a4cebbb1849e7d7ae8d32 [id=4e5c9cbce9dc4aa5a67d312886ac21a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.182161 757 tablet_service.cc:1511] Processing CreateTablet for tablet b216e8fdaefa4757b1c0567eae3749ee (DEFAULT_TABLE table=default.Table_b3a1aceccf7a4cebbb1849e7d7ae8d32 [id=4e5c9cbce9dc4aa5a67d312886ac21a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.182907 1018 tablet_service.cc:1511] Processing CreateTablet for tablet c239db0cf001482fafbf0fe739385b10 (DEFAULT_TABLE table=default.Table_587c420b7b004b84bace3e688ccd2dd6 [id=d577309d34dd447b84b1f6d0f9675842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.185410 896 tablet_service.cc:1511] Processing CreateTablet for tablet c239db0cf001482fafbf0fe739385b10 (DEFAULT_TABLE table=default.Table_587c420b7b004b84bace3e688ccd2dd6 [id=d577309d34dd447b84b1f6d0f9675842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.186100 746 tablet_service.cc:1511] Processing CreateTablet for tablet c239db0cf001482fafbf0fe739385b10 (DEFAULT_TABLE table=default.Table_587c420b7b004b84bace3e688ccd2dd6 [id=d577309d34dd447b84b1f6d0f9675842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.186363 2591 raft_consensus.cc:493] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.186482 2591 raft_consensus.cc:515] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.187129 2591 leader_election.cc:290] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.187143 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8d950f7c08ad40d088668cc696f9a937 (DEFAULT_TABLE table=default.Table_e8cc570d68984efa918c9669ee2cba83 [id=4270a80d579a4d3aa6ff5f25f1a24da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.187779 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e662fd10883b401c8f0d4a45735e2639" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.189442 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8d950f7c08ad40d088668cc696f9a937 (DEFAULT_TABLE table=default.Table_e8cc570d68984efa918c9669ee2cba83 [id=4270a80d579a4d3aa6ff5f25f1a24da1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:10.189963 851 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:10.190062 851 leader_election.cc:304] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.190277 742 tablet_service.cc:1511] Processing CreateTablet for tablet 8d950f7c08ad40d088668cc696f9a937 (DEFAULT_TABLE table=default.Table_e8cc570d68984efa918c9669ee2cba83 [id=4270a80d579a4d3aa6ff5f25f1a24da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.190485 2524 raft_consensus.cc:2749] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.190623 2524 raft_consensus.cc:493] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.190716 2524 raft_consensus.cc:515] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.191290 1171 tablet_bootstrap.cc:492] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.191499 1171 ts_tablet_manager.cc:1403] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.003s
I20260503 07:53:10.192760 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ba7562faa48159e7f09c1fbc37d6c (DEFAULT_TABLE table=default.Table_839fac2b5d174a708e3cda5fdd780baa [id=14807a6203de4077a54f47b5ea23efed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.193051 2524 leader_election.cc:290] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.193284 1171 raft_consensus.cc:359] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.193473 1171 raft_consensus.cc:385] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.193555 1171 raft_consensus.cc:740] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.193770 1171 consensus_queue.cc:260] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.194013 886 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ba7562faa48159e7f09c1fbc37d6c (DEFAULT_TABLE table=default.Table_839fac2b5d174a708e3cda5fdd780baa [id=14807a6203de4077a54f47b5ea23efed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.194234 751 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ba7562faa48159e7f09c1fbc37d6c (DEFAULT_TABLE table=default.Table_839fac2b5d174a708e3cda5fdd780baa [id=14807a6203de4077a54f47b5ea23efed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:10.194525 854 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:10.195695 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 00313f32277c4a779c47e9becc89b9b8 (DEFAULT_TABLE table=default.Table_bd253e88034b45349bd86e73bdbdf0ef [id=23703e75bf384bb0afb2e62108c096d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.195859 772 raft_consensus.cc:2468] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.196327 986 leader_election.cc:304] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.196736 2574 raft_consensus.cc:2804] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.196835 2574 raft_consensus.cc:493] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.196940 2574 raft_consensus.cc:3060] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:10.197979 851 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:10.198071 1165 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.198083 851 leader_election.cc:304] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.198426 2524 raft_consensus.cc:2749] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.199693 1165 tablet_bootstrap.cc:654] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.200565 885 tablet_service.cc:1511] Processing CreateTablet for tablet 00313f32277c4a779c47e9becc89b9b8 (DEFAULT_TABLE table=default.Table_bd253e88034b45349bd86e73bdbdf0ef [id=23703e75bf384bb0afb2e62108c096d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.202009 2421 raft_consensus.cc:493] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.202162 2421 raft_consensus.cc:515] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.202796 2421 leader_election.cc:290] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.203365 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.203764 986 leader_election.cc:343] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.206189 747 tablet_service.cc:1511] Processing CreateTablet for tablet 00313f32277c4a779c47e9becc89b9b8 (DEFAULT_TABLE table=default.Table_bd253e88034b45349bd86e73bdbdf0ef [id=23703e75bf384bb0afb2e62108c096d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.210873 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34e93dd9e043439f0c30b3273636e9 (DEFAULT_TABLE table=default.Table_5f7ca52fe6064308a6bfe9e1edd07377 [id=4bc2a4c2b0fb4bd09eff1d6e08f2baaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.211645 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.211941 2386 raft_consensus.cc:493] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:10.212100 2386 raft_consensus.cc:515] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.212489 882 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34e93dd9e043439f0c30b3273636e9 (DEFAULT_TABLE table=default.Table_5f7ca52fe6064308a6bfe9e1edd07377 [id=4bc2a4c2b0fb4bd09eff1d6e08f2baaf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:10.212797 988 leader_election.cc:343] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.212872 2386 leader_election.cc:290] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.212919 988 leader_election.cc:304] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.213140 2421 raft_consensus.cc:2749] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.214434 1171 ts_tablet_manager.cc:1434] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260503 07:53:10.215831 750 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34e93dd9e043439f0c30b3273636e9 (DEFAULT_TABLE table=default.Table_5f7ca52fe6064308a6bfe9e1edd07377 [id=4bc2a4c2b0fb4bd09eff1d6e08f2baaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.216810 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.217260 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c6dad26de642879307b7dca6ae85f5" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.219575 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6b08393d6dc448cb83b53551d377ee44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.220248 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b08393d6dc448cb83b53551d377ee44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.220824 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb (DEFAULT_TABLE table=default.Table_7052813ac0e842698977de0865a32a09 [id=97c646e5e44c4af8b19b624a3516ef0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.220979 1171 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.222488 851 leader_election.cc:304] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.222946 2386 raft_consensus.cc:2749] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:10.226356 1166 tablet_bootstrap.cc:492] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.226496 1166 ts_tablet_manager.cc:1403] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.000s
I20260503 07:53:10.227198 1166 raft_consensus.cc:359] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.227348 1166 raft_consensus.cc:385] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.227393 1166 raft_consensus.cc:740] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.227581 1166 consensus_queue.cc:260] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.231503 1166 ts_tablet_manager.cc:1434] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:53:10.231775 1166 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.233446 1166 tablet_bootstrap.cc:654] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.234810 1171 tablet_bootstrap.cc:654] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.236322 2431 raft_consensus.cc:515] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.236555 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b216e8fdaefa4757b1c0567eae3749ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.236757 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d950f7c08ad40d088668cc696f9a937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.236999 2431 leader_election.cc:290] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.238104 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ba7562faa48159e7f09c1fbc37d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.238322 1165 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.238456 1165 ts_tablet_manager.cc:1403] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.007s
I20260503 07:53:10.238600 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00313f32277c4a779c47e9becc89b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.239008 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34e93dd9e043439f0c30b3273636e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.239248 1165 raft_consensus.cc:359] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.239378 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f707cb0257c4d6182ec331a235ba06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.239408 1165 raft_consensus.cc:385] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.239459 1165 raft_consensus.cc:740] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.239650 1165 consensus_queue.cc:260] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.239745 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239db0cf001482fafbf0fe739385b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.240125 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ba7562faa48159e7f09c1fbc37d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.240434 1165 ts_tablet_manager.cc:1434] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.240471 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00313f32277c4a779c47e9becc89b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.240816 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34e93dd9e043439f0c30b3273636e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.241804 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.242045 772 raft_consensus.cc:3060] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.244835 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d950f7c08ad40d088668cc696f9a937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.245263 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.245668 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f707cb0257c4d6182ec331a235ba06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.246476 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239db0cf001482fafbf0fe739385b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.247589 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b216e8fdaefa4757b1c0567eae3749ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.249892 1171 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.250030 1171 ts_tablet_manager.cc:1403] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
I20260503 07:53:10.250834 1171 raft_consensus.cc:359] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.251016 1171 raft_consensus.cc:385] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.251106 1171 raft_consensus.cc:740] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.251371 1171 consensus_queue.cc:260] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.257673 1171 ts_tablet_manager.cc:1434] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260503 07:53:10.260964 1166 tablet_bootstrap.cc:492] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.261128 1166 ts_tablet_manager.cc:1403] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260503 07:53:10.261870 1166 raft_consensus.cc:359] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.262404 1166 raft_consensus.cc:385] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.262492 1166 raft_consensus.cc:740] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.262701 1166 consensus_queue.cc:260] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.263154 1166 ts_tablet_manager.cc:1434] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:10.263432 1166 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.263943 1171 tablet_bootstrap.cc:492] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.265689 1171 tablet_bootstrap.cc:654] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:10.268270 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e382ffd461ec4ef6a80f5c29c062747a (table default.Table_870965ffd55d465c9e6d769178dd9516 [id=d89f7483b886457ca8b4126f4dbe536f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e382ffd461ec4ef6a80f5c29c062747a has no consensus state
I20260503 07:53:10.269428 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6243db5cd8c343a090334a84b493bf40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.270207 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6243db5cd8c343a090334a84b493bf40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.272358 2565 raft_consensus.cc:515] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.273379 2565 leader_election.cc:290] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.273711 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de65c754b47440a914f3f2bdb86059c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:10.273931 1050 raft_consensus.cc:3060] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.274045 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de65c754b47440a914f3f2bdb86059c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:10.277455 715 leader_election.cc:343] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.283977 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.285795 1166 tablet_bootstrap.cc:654] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:10.286831 988 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.294399 596 catalog_manager.cc:5671] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:10.295682 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7439917c2a764658bfa8bf62ba67e34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.296263 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f707cb0257c4d6182ec331a235ba06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.296692 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ba7562faa48159e7f09c1fbc37d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.297078 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00313f32277c4a779c47e9becc89b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.297802 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239db0cf001482fafbf0fe739385b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.300299 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b216e8fdaefa4757b1c0567eae3749ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.303135 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d950f7c08ad40d088668cc696f9a937. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:10.308730 854 consensus_peers.cc:597] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:10.309629 1174 ts_tablet_manager.cc:1929] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.310009 1174 log.cc:1199] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8c25addae8c94554a83344f07a11362f
I20260503 07:53:10.310531 1174 ts_tablet_manager.cc:1950] T 8c25addae8c94554a83344f07a11362f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:10.311015 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_ba4ac916a85e49c793f64e171c13382a [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 1 got 0
I20260503 07:53:10.311643 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:10.313127 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_a043996e2db248e59da337f4eb243320 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 1 got 0
I20260503 07:53:10.313472 1171 tablet_bootstrap.cc:492] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.313668 1171 ts_tablet_manager.cc:1403] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260503 07:53:10.313794 596 catalog_manager.cc:5671] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:10.314185 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:10.314487 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]). Expected version 1 got 0
I20260503 07:53:10.314652 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1ae4a39d4e3a42db816e592123a6a2e7 (table default.Table_a6a85043cd814a5d8d17300cc43be157 [id=c5d1c3d4bc32495a9966899ba145e3cb]). Expected version 3 got 0
I20260503 07:53:10.314667 1171 raft_consensus.cc:359] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.314931 1171 raft_consensus.cc:385] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.314932 596 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:10.315056 1171 raft_consensus.cc:740] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.315347 1171 consensus_queue.cc:260] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.321420 1171 ts_tablet_manager.cc:1434] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260503 07:53:10.322486 1171 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.323925 1171 tablet_bootstrap.cc:654] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.324030 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 57261ae6531348d7bdd8deb5dfd980b4
I20260503 07:53:10.324584 600 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1225) took 1793 ms. Trace:
I20260503 07:53:10.324748 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.324700 600 rpcz_store.cc:276] 0503 07:53:08.531434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.173346 (+641912us) service_pool.cc:224] Handling call
0503 07:53:09.177200 (+ 3854us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9db06 00007ff8f7832486 00007ff8f78321b5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:09.177546 (+ 346us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:09.177678 (+ 132us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:09.177760 (+ 82us) catalog_manager.cc:2824] Locking tablets
0503 07:53:10.124462 (+946702us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:10.323801 (+199339us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:10.323890 (+ 89us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:10.323937 (+ 47us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:10.324549 (+ 612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:10.125707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:10.125832 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:10.125840 (+ 8us) write_op.cc:435] Acquired schema lock
0503 07:53:10.125843 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:10.125959 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:10.125969 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:10.125974 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:10.126093 (+ 119us) tablet.cc:701] Row locks acquired
0503 07:53:10.126097 (+ 4us) write_op.cc:260] PREPARE: finished
0503 07:53:10.126128 (+ 31us) write_op.cc:270] Start()
0503 07:53:10.126152 (+ 24us) write_op.cc:276] Timestamp: P: 1777794790126087 usec, L: 0
0503 07:53:10.126154 (+ 2us) op_driver.cc:348] REPLICATION: starting
0503 07:53:10.126340 (+ 186us) log.cc:844] Serialized 731 byte log entry
0503 07:53:10.309335 (+182995us) op_driver.cc:464] REPLICATION: finished
0503 07:53:10.322267 (+ 12932us) write_op.cc:301] APPLY: starting
0503 07:53:10.322283 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:10.322320 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:10.322345 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:10.322408 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:10.322439 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:10.322445 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:10.322520 (+ 75us) log.cc:844] Serialized 29 byte log entry
0503 07:53:10.322581 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:10.322961 (+ 380us) write_op.cc:454] Released schema lock
0503 07:53:10.322968 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:10.323059 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:10.323065 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":8208256,"child_traces":[["op",{"apply.queue_time_us":12882,"apply.run_cpu_time_us":781,"apply.run_wall_time_us":781,"num_ops":2,"prepare.queue_time_us":742,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":723,"raft.queue_time_us":4822,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":183143}]]}
I20260503 07:53:10.326830 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b38735fd577548b192131a769daa1d78
I20260503 07:53:10.328429 774 raft_consensus.cc:2468] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.334692 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b38735fd577548b192131a769daa1d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.334986 986 leader_election.cc:304] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.335376 2431 raft_consensus.cc:2804] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.335477 2431 raft_consensus.cc:697] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.335632 1166 tablet_bootstrap.cc:492] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.335753 1166 ts_tablet_manager.cc:1403] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.008s
I20260503 07:53:10.335681 2431 consensus_queue.cc:237] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.336598 1166 raft_consensus.cc:359] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.336771 1166 raft_consensus.cc:385] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.336814 1166 raft_consensus.cc:740] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.337047 1166 consensus_queue.cc:260] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.337512 1166 ts_tablet_manager.cc:1434] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:10.338244 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.338532 1166 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.338717 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b38735fd577548b192131a769daa1d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.342017 1166 tablet_bootstrap.cc:654] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.354810 1171 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.355104 1171 ts_tablet_manager.cc:1403] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.002s
I20260503 07:53:10.355839 1171 raft_consensus.cc:359] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.356062 1171 raft_consensus.cc:385] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.356161 1171 raft_consensus.cc:740] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.356498 1171 consensus_queue.cc:260] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.357092 1171 ts_tablet_manager.cc:1434] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:10.357384 1171 tablet_bootstrap.cc:492] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.358716 1171 tablet_bootstrap.cc:654] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.366787 1166 tablet_bootstrap.cc:492] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.366917 1166 ts_tablet_manager.cc:1403] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.000s
I20260503 07:53:10.367566 1166 raft_consensus.cc:359] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.367719 1166 raft_consensus.cc:385] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.367769 1166 raft_consensus.cc:740] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.368005 1166 consensus_queue.cc:260] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.368479 1166 ts_tablet_manager.cc:1434] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260503 07:53:10.369144 2421 raft_consensus.cc:493] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.369271 2421 raft_consensus.cc:515] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.369777 2421 leader_election.cc:290] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.370007 1166 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.372117 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be28ad252ff47879caa1021fdf5db66" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.372380 774 raft_consensus.cc:2468] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.372946 986 leader_election.cc:304] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:10.373266 2113 raft_consensus.cc:2804] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.374109 2113 raft_consensus.cc:493] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.374179 2113 raft_consensus.cc:3060] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.375502 1175 ts_tablet_manager.cc:1929] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:10.375599 1175 log.cc:1199] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9e162006cee34182b51f97629a174509
I20260503 07:53:10.375905 1175 ts_tablet_manager.cc:1950] T 9e162006cee34182b51f97629a174509 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:10.377318 1166 tablet_bootstrap.cc:654] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.378541 1171 tablet_bootstrap.cc:492] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.378657 1171 ts_tablet_manager.cc:1403] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260503 07:53:10.379395 1171 raft_consensus.cc:359] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.379614 1171 raft_consensus.cc:385] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.379702 1171 raft_consensus.cc:740] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.379962 1171 consensus_queue.cc:260] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.380604 1171 ts_tablet_manager.cc:1434] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:10.380887 1171 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.382448 1171 tablet_bootstrap.cc:654] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.389007 1173 ts_tablet_manager.cc:1929] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.389189 1173 log.cc:1199] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/3be0ae78ada34cd88debca569b77d24a
I20260503 07:53:10.389683 1173 ts_tablet_manager.cc:1950] T 3be0ae78ada34cd88debca569b77d24a P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:53:10.392778 986 consensus_peers.cc:597] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e662fd10883b401c8f0d4a45735e2639. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:10.402941 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be28ad252ff47879caa1021fdf5db66" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.403797 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 57261ae6531348d7bdd8deb5dfd980b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.404075 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b38735fd577548b192131a769daa1d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:10.407987 988 leader_election.cc:343] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.410012 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_42211d76c1f247b9928bafb30b2b26f0" } new_table_name: "default.Table_112cd8bd9a24496ead1a7c994ca7095c" modify_external_catalogs: true
I20260503 07:53:10.412253 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8dbca27f54064345b374b0cea96ca1c4
I20260503 07:53:10.412662 599 catalog_manager.cc:6741] ReplaceTablet: tablet 8dbca27f54064345b374b0cea96ca1c4 deleted and replaced by tablet e93d2f3321bb4a018c1798eeef92abac
I20260503 07:53:10.412779 599 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:44308 (request call id 1230) took 1669 ms. Trace:
I20260503 07:53:10.412878 599 rpcz_store.cc:276] 0503 07:53:08.743354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.231321 (+487967us) service_pool.cc:224] Handling call
0503 07:53:09.241877 (+ 10556us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900da985b 00007ff8f783d107 00007ff8f783ce35 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:10.412758 (+1170881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:10.127002 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:10.127093 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:10.127099 (+ 6us) write_op.cc:435] Acquired schema lock
0503 07:53:10.127102 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:10.127171 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:10.127178 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:10.127186 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:10.127245 (+ 59us) tablet.cc:701] Row locks acquired
0503 07:53:10.127247 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:10.127269 (+ 22us) write_op.cc:270] Start()
0503 07:53:10.127291 (+ 22us) write_op.cc:276] Timestamp: P: 1777794790127231 usec, L: 0
0503 07:53:10.127294 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:10.131355 (+ 4061us) log.cc:844] Serialized 622 byte log entry
0503 07:53:10.411355 (+280000us) op_driver.cc:464] REPLICATION: finished
0503 07:53:10.411424 (+ 69us) write_op.cc:301] APPLY: starting
0503 07:53:10.411438 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:10.411474 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:10.411496 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:10.411584 (+ 88us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:10.411629 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:10.411636 (+ 7us) write_op.cc:312] APPLY: finished
0503 07:53:10.411703 (+ 67us) log.cc:844] Serialized 29 byte log entry
0503 07:53:10.411760 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:10.411779 (+ 19us) write_op.cc:454] Released schema lock
0503 07:53:10.411786 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":23497600,"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":414,"apply.run_wall_time_us":414,"num_ops":2,"prepare.queue_time_us":1354,"prepare.run_cpu_time_us":518,"prepare.run_wall_time_us":6504,"raft.queue_time_us":2041,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":284039}]]}
I20260503 07:53:10.415266 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 with delete_type TABLET_DATA_DELETED (replaced by tablet e93d2f3321bb4a018c1798eeef92abac) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.415900 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 with delete_type TABLET_DATA_DELETED (replaced by tablet e93d2f3321bb4a018c1798eeef92abac) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.416462 2574 raft_consensus.cc:515] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.417610 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fe06a56f70487ea7c479b107d83d8b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.417762 774 raft_consensus.cc:3060] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.418298 2574 leader_election.cc:290] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.418787 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dbca27f54064345b374b0cea96ca1c4 with delete_type TABLET_DATA_DELETED (replaced by tablet e93d2f3321bb4a018c1798eeef92abac) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.419438 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fe06a56f70487ea7c479b107d83d8b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.420361 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_112d3a0905e347eb8349ca00511849f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.420890 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_112d3a0905e347eb8349ca00511849f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:10.424131 988 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.433061 779 raft_consensus.cc:2468] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.433663 986 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.435050 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 878) took 2879 ms. Trace:
I20260503 07:53:10.435170 1173 rpcz_store.cc:276] 0503 07:53:07.555157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.555210 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:09.987013 (+2431803us) ts_tablet_manager.cc:1151] Deleting tablet 3be0ae78ada34cd88debca569b77d24a
0503 07:53:09.987021 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.235839 (+248818us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.388935 (+153096us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.435003 (+ 46068us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2431571}
I20260503 07:53:10.435814 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 874) took 2956 ms. Trace:
I20260503 07:53:10.435930 1173 rpcz_store.cc:276] 0503 07:53:07.479103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.596859 (+117756us) service_pool.cc:224] Handling call
0503 07:53:10.435646 (+2838787us) ts_tablet_manager.cc:1151] Deleting tablet 2df2ed7d2563487aa15fe917b3fcf313
0503 07:53:10.435662 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.435790 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2838500}
I20260503 07:53:10.436472 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 881) took 2736 ms. Trace:
I20260503 07:53:10.436643 1173 rpcz_store.cc:276] 0503 07:53:07.700156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.700230 (+ 74us) service_pool.cc:224] Handling call
0503 07:53:10.436358 (+2736128us) ts_tablet_manager.cc:1151] Deleting tablet 6b18c4ecb2ca453ea69772cd68244394
0503 07:53:10.436370 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.436456 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735928}
I20260503 07:53:10.437294 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 883) took 2718 ms. Trace:
I20260503 07:53:10.437459 1173 rpcz_store.cc:276] 0503 07:53:07.718911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.718962 (+ 51us) service_pool.cc:224] Handling call
0503 07:53:10.437155 (+2718193us) ts_tablet_manager.cc:1151] Deleting tablet 29fe06a56f70487ea7c479b107d83d8b
0503 07:53:10.437167 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.437277 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718030}
I20260503 07:53:10.438077 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 882) took 2720 ms. Trace:
I20260503 07:53:10.438225 1173 rpcz_store.cc:276] 0503 07:53:07.717895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.721086 (+ 3191us) service_pool.cc:224] Handling call
0503 07:53:10.437947 (+2716861us) ts_tablet_manager.cc:1151] Deleting tablet 7986115ad5ff47cf991009f545f0243e
0503 07:53:10.437959 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.438060 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716685}
I20260503 07:53:10.438539 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]) successfully deleted
W20260503 07:53:10.438836 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2df2ed7d2563487aa15fe917b3fcf313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2ed7d2563487aa15fe917b3fcf313 already in progress: creating tablet
W20260503 07:53:10.439927 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 6b18c4ecb2ca453ea69772cd68244394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b18c4ecb2ca453ea69772cd68244394 already in progress: creating tablet
W20260503 07:53:10.440371 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 29fe06a56f70487ea7c479b107d83d8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29fe06a56f70487ea7c479b107d83d8b already in progress: creating tablet
I20260503 07:53:10.443967 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 945) took 3146 ms. Trace:
I20260503 07:53:10.444154 1175 rpcz_store.cc:276] 0503 07:53:07.297411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.303907 (+ 6496us) service_pool.cc:224] Handling call
0503 07:53:10.047211 (+2743304us) ts_tablet_manager.cc:1151] Deleting tablet 9e162006cee34182b51f97629a174509
0503 07:53:10.047221 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.235399 (+188178us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.375451 (+140052us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.443938 (+ 68487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2743119}
I20260503 07:53:10.444646 1175 tablet_replica.cc:333] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:10.445004 1175 raft_consensus.cc:2243] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:10.444816 2431 raft_consensus.cc:2804] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.445173 2431 raft_consensus.cc:697] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.445385 2431 consensus_queue.cc:237] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.446743 2421 raft_consensus.cc:493] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.446857 2421 raft_consensus.cc:515] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.447360 2421 leader_election.cc:290] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.448230 1175 raft_consensus.cc:2272] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.448859 1175 ts_tablet_manager.cc:1916] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.451176 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.459059 986 leader_election.cc:343] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.460804 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9e162006cee34182b51f97629a174509 (table default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]) successfully deleted
I20260503 07:53:10.461140 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.462316 1173 tablet_replica.cc:333] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:10.462541 1173 raft_consensus.cc:2243] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:10.462741 1173 raft_consensus.cc:2272] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.463408 1173 ts_tablet_manager.cc:1916] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.464816 2615 raft_consensus.cc:493] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:10.464819 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 7986115ad5ff47cf991009f545f0243e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7986115ad5ff47cf991009f545f0243e already in progress: creating tablet
I20260503 07:53:10.464954 2615 raft_consensus.cc:515] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.465536 2615 leader_election.cc:290] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:10.465626 988 leader_election.cc:343] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.465723 988 leader_election.cc:304] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.465891 2421 raft_consensus.cc:2749] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.466346 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:10.466805 716 leader_election.cc:343] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.467027 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.467420 715 leader_election.cc:343] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.467519 715 leader_election.cc:304] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.467816 2615 raft_consensus.cc:2749] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.477320 2615 raft_consensus.cc:493] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.477447 2615 raft_consensus.cc:515] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.477959 2615 leader_election.cc:290] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:10.478999 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.479354 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.479867 715 leader_election.cc:343] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:10.480280 716 leader_election.cc:343] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.480371 716 leader_election.cc:304] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.480736 2615 raft_consensus.cc:2749] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.481596 1050 raft_consensus.cc:2468] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:10.482065 716 leader_election.cc:304] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.482487 2615 raft_consensus.cc:2804] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.482600 2615 raft_consensus.cc:697] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:10.482815 2615 consensus_queue.cc:237] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.489243 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c5a592a14c3e4659ba81754cbe62c438
I20260503 07:53:10.489611 1171 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.489751 1171 ts_tablet_manager.cc:1403] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.022s
I20260503 07:53:10.490465 1171 raft_consensus.cc:359] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.490608 1171 raft_consensus.cc:385] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.490651 1171 raft_consensus.cc:740] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.490837 1171 consensus_queue.cc:260] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.491325 1171 ts_tablet_manager.cc:1434] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.491587 1171 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.492280 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c5a592a14c3e4659ba81754cbe62c438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.493250 892 tablet_service.cc:1558] Processing DeleteTablet for tablet c5a592a14c3e4659ba81754cbe62c438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.493697 1171 tablet_bootstrap.cc:654] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.493956 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet c5a592a14c3e4659ba81754cbe62c438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:09 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.508845 917 raft_consensus.cc:3060] T 8f64902f16534103be2968bdc1823a9e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.509040 918 raft_consensus.cc:3060] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.510371 2367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ac6a9a921d4741bacf707b8f217874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65adddd546eb49779519c7f7378d0e60" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 44841 } } peers { permanent_uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c" member_type: VOTER last_known_addr { host: "127.0.105.61" port: 41759 } } peers { permanent_uuid: "04ac6a9a921d4741bacf707b8f217874" member_type: VOTER last_known_addr { host: "127.0.105.60" port: 40873 } } }
I20260503 07:53:10.510535 2367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 [sys.catalog]: This master's current role is: LEADER
I20260503 07:53:10.534875 1175 ts_tablet_manager.cc:1929] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.535938 1175 log.cc:1199] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:10.535902 775 raft_consensus.cc:2468] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.536628 1175 ts_tablet_manager.cc:1950] T 5deea77f36d540bb8f721657b7e3500e P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:10.536962 2113 raft_consensus.cc:515] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.537724 2113 leader_election.cc:290] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.540306 986 leader_election.cc:304] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.541101 2421 raft_consensus.cc:2804] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.541244 2421 raft_consensus.cc:697] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.541538 2421 consensus_queue.cc:237] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.546193 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be28ad252ff47879caa1021fdf5db66" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.546352 775 raft_consensus.cc:3060] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.556438 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be28ad252ff47879caa1021fdf5db66" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.559943 918 raft_consensus.cc:3060] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.563946 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6720679e01e44baaa1501c8dbadba08a
I20260503 07:53:10.564482 598 catalog_manager.cc:6741] ReplaceTablet: tablet 6720679e01e44baaa1501c8dbadba08a deleted and replaced by tablet 17db30b1109845d783ade7c4860a3d0d
I20260503 07:53:10.565693 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 6720679e01e44baaa1501c8dbadba08a with delete_type TABLET_DATA_DELETED (replaced by tablet 17db30b1109845d783ade7c4860a3d0d) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.566658 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6720679e01e44baaa1501c8dbadba08a with delete_type TABLET_DATA_DELETED (replaced by tablet 17db30b1109845d783ade7c4860a3d0d) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.568713 2574 raft_consensus.cc:493] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.568881 2386 raft_consensus.cc:493] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.569064 2574 raft_consensus.cc:515] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.569070 2386 raft_consensus.cc:515] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.569784 2574 leader_election.cc:290] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.569844 2386 leader_election.cc:290] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.569922 2574 consensus_queue.cc:1048] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.570256 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.570468 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:10.570749 986 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.571256 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30f15ad13340c89df3f5c8d65d63c7" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.570749 988 leader_election.cc:343] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.571759 851 leader_election.cc:304] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.572289 2386 raft_consensus.cc:2749] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.572343 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.573135 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6720679e01e44baaa1501c8dbadba08a with delete_type TABLET_DATA_DELETED (replaced by tablet 17db30b1109845d783ade7c4860a3d0d) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:10.573387 988 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.573539 988 leader_election.cc:304] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.574602 2574 raft_consensus.cc:2749] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.576464 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 64c6dad26de642879307b7dca6ae85f5
I20260503 07:53:10.576691 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3b1841a8266d43b9819c5598c0b8fac1" } new_table_name: "default.Table_1d7472fe4c0e4303ab8502ac10ae7498" modify_external_catalogs: true
I20260503 07:53:10.577047 593 catalog_manager.cc:6741] ReplaceTablet: tablet 64c6dad26de642879307b7dca6ae85f5 deleted and replaced by tablet 6076544a93644c69b3a9a8bb890bd1ef
I20260503 07:53:10.577443 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_914d5e7cae5146b78cb18e6e57795d15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.578080 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_914d5e7cae5146b78cb18e6e57795d15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.578099 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c6dad26de642879307b7dca6ae85f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6076544a93644c69b3a9a8bb890bd1ef) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:10.578435 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c6dad26de642879307b7dca6ae85f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6076544a93644c69b3a9a8bb890bd1ef) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:10.581482 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c6dad26de642879307b7dca6ae85f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 6076544a93644c69b3a9a8bb890bd1ef) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:10.582000 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_83f3ee8f642e44b4b9b58e951c9f7300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.582430 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83f3ee8f642e44b4b9b58e951c9f7300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.589073 892 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb (DEFAULT_TABLE table=default.Table_7052813ac0e842698977de0865a32a09 [id=97c646e5e44c4af8b19b624a3516ef0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.589573 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.589948 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb (DEFAULT_TABLE table=default.Table_7052813ac0e842698977de0865a32a09 [id=97c646e5e44c4af8b19b624a3516ef0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.591641 1024 tablet_service.cc:1511] Processing CreateTablet for tablet cd998373252f40fe8955b4aacc0fb212 (DEFAULT_TABLE table=default.Table_fff519033f9848929e462d6f336fc07b [id=baa7718b3b8447cdb20135dafdea3bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.592018 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd998373252f40fe8955b4aacc0fb212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.592420 753 tablet_service.cc:1511] Processing CreateTablet for tablet cd998373252f40fe8955b4aacc0fb212 (DEFAULT_TABLE table=default.Table_fff519033f9848929e462d6f336fc07b [id=baa7718b3b8447cdb20135dafdea3bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.593348 2615 raft_consensus.cc:493] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.593514 2615 raft_consensus.cc:515] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.594555 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.595088 715 leader_election.cc:343] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.595604 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34e93dd9e043439f0c30b3273636e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.595674 1165 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.597294 1165 tablet_bootstrap.cc:654] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.599771 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 847) took 4387 ms. Trace:
I20260503 07:53:10.599903 1174 rpcz_store.cc:276] 0503 07:53:06.211956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.212485 (+ 529us) service_pool.cc:224] Handling call
0503 07:53:10.054598 (+3842113us) ts_tablet_manager.cc:1151] Deleting tablet 8c25addae8c94554a83344f07a11362f
0503 07:53:10.054606 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.167055 (+112449us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.309584 (+142529us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.599748 (+290164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3838236}
I20260503 07:53:10.600335 1174 tablet_replica.cc:333] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:10.600569 1174 raft_consensus.cc:2243] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:10.600735 1174 raft_consensus.cc:2272] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.601518 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.601697 1174 ts_tablet_manager.cc:1916] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.604339 2615 leader_election.cc:290] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.592885 886 tablet_service.cc:1511] Processing CreateTablet for tablet cd998373252f40fe8955b4aacc0fb212 (DEFAULT_TABLE table=default.Table_fff519033f9848929e462d6f336fc07b [id=baa7718b3b8447cdb20135dafdea3bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.604375 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd998373252f40fe8955b4aacc0fb212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.605582 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 950) took 3277 ms. Trace:
I20260503 07:53:10.605671 1175 rpcz_store.cc:276] 0503 07:53:07.327730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.327901 (+ 171us) service_pool.cc:224] Handling call
0503 07:53:10.444568 (+3116667us) ts_tablet_manager.cc:1151] Deleting tablet 5deea77f36d540bb8f721657b7e3500e
0503 07:53:10.444581 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.531044 (+ 86463us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.534809 (+ 3765us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.605562 (+ 70753us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3116469}
I20260503 07:53:10.605954 1175 tablet_replica.cc:333] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:10.606117 1175 raft_consensus.cc:2243] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:10.606426 1175 raft_consensus.cc:2272] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:10.606905 1175 ts_tablet_manager.cc:1916] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.607446 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5deea77f36d540bb8f721657b7e3500e (table default.Table_079c0329f9e24361bd7fa7d067c93fe3 [id=38add89cf082440d93b3999599cbb90d]) successfully deleted
I20260503 07:53:10.607792 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.608018 1050 raft_consensus.cc:2468] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:10.608359 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8c25addae8c94554a83344f07a11362f (table default.Table_38ec270c366e4af089360207052b918a [id=5df2b0cf7f3a49d0a38b5bb542e5398f]) successfully deleted
I20260503 07:53:10.608762 716 leader_election.cc:304] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:10.609364 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20eece13d60c42be953340038dfa6ff2 consensus state has no leader
I20260503 07:53:10.609452 2608 raft_consensus.cc:2804] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.609565 2608 raft_consensus.cc:493] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.609648 2608 raft_consensus.cc:3060] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.611426 2574 consensus_queue.cc:1048] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.612301 2615 raft_consensus.cc:493] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.612474 2615 raft_consensus.cc:515] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.613520 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7af140ce144bc8b2e147dad98ac201" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.613749 1050 raft_consensus.cc:2468] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:10.614145 2574 raft_consensus.cc:493] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.614223 716 leader_election.cc:304] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:10.614321 2574 raft_consensus.cc:515] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.614562 2565 raft_consensus.cc:2804] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.614640 2565 raft_consensus.cc:493] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.614712 2565 raft_consensus.cc:3060] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.614950 2574 leader_election.cc:290] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.620769 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.624497 988 leader_election.cc:343] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.626080 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.626257 777 raft_consensus.cc:2468] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.626296 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7af140ce144bc8b2e147dad98ac201" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.626434 1165 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.625926 2615 leader_election.cc:290] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:10.626551 1165 ts_tablet_manager.cc:1403] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.005s
W20260503 07:53:10.626966 715 leader_election.cc:343] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.627408 986 leader_election.cc:304] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.627813 1165 raft_consensus.cc:359] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.627930 2574 raft_consensus.cc:2804] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.627970 1165 raft_consensus.cc:385] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.628010 2574 raft_consensus.cc:493] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.628021 1165 raft_consensus.cc:740] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.628086 2574 raft_consensus.cc:3060] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.628252 1165 consensus_queue.cc:260] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.628744 1165 ts_tablet_manager.cc:1434] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:10.629026 1165 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.630730 1165 tablet_bootstrap.cc:654] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.631767 2554 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:10.635757 2386 raft_consensus.cc:493] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.635875 2386 raft_consensus.cc:515] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.636484 2386 leader_election.cc:290] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.636896 1171 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.637027 1171 ts_tablet_manager.cc:1403] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.146s user 0.029s sys 0.018s
I20260503 07:53:10.637243 2457 raft_consensus.cc:515] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.637794 2457 leader_election.cc:290] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:10.637737 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b38735fd577548b192131a769daa1d78 (DEFAULT_TABLE table=default.Table_1682ce0a78774c818b995cd84ef71c24 [id=8b7aca54adf84e06b871951742378d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.637899 1171 raft_consensus.cc:359] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.638087 1171 raft_consensus.cc:385] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.638152 1171 raft_consensus.cc:740] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.638428 1171 consensus_queue.cc:260] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.639091 1171 ts_tablet_manager.cc:1434] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.640206 1171 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.638164 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38735fd577548b192131a769daa1d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.647908 1171 tablet_bootstrap.cc:654] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.648128 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db13f91ef1d740c387bacbb689ddf1a8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:10.648346 1050 raft_consensus.cc:3060] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.649205 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.649513 2421 consensus_queue.cc:1048] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.650885 2431 consensus_queue.cc:1048] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.655226 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db13f91ef1d740c387bacbb689ddf1a8" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:10.655435 988 consensus_peers.cc:597] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3be0ae78ada34cd88debca569b77d24a. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:10.655534 1171 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.655671 1171 ts_tablet_manager.cc:1403] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
W20260503 07:53:10.655773 715 leader_election.cc:343] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.656566 1171 raft_consensus.cc:359] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.660429 2640 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:10.661093 912 raft_consensus.cc:3060] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.662760 1171 raft_consensus.cc:385] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.662986 1171 raft_consensus.cc:740] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.663340 1171 consensus_queue.cc:260] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.664332 1171 ts_tablet_manager.cc:1434] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260503 07:53:10.665138 1171 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.666981 1171 tablet_bootstrap.cc:654] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.667529 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd998373252f40fe8955b4aacc0fb212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.671615 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskCEB381/build/asan/bin/kudu
/tmp/dist-test-taskCEB381/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--webserver_interface=127.0.105.61
--webserver_port=38399
--builtin_ntp_servers=127.0.105.20:43005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260503 07:53:10.671470 2113 consensus_queue.cc:1048] T 8f64902f16534103be2968bdc1823a9e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.672103 2421 raft_consensus.cc:493] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.672983 2421 raft_consensus.cc:515] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.673475 2421 leader_election.cc:290] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.674294 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ba5e9cfe6b4f24a8f91c571416dae3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.674489 776 raft_consensus.cc:2468] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.674785 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ba5e9cfe6b4f24a8f91c571416dae3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.675212 988 leader_election.cc:343] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.675498 986 leader_election.cc:304] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.675865 2421 raft_consensus.cc:2804] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.675935 2421 raft_consensus.cc:493] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.675997 2421 raft_consensus.cc:3060] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.677794 2386 raft_consensus.cc:493] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.677927 2386 raft_consensus.cc:515] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.678572 2386 leader_election.cc:290] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.679369 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.680325 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb48844c2a04b5e8b6f73b9986127ee" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.680804 851 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: Tablet not RUNNING: STOPPED
I20260503 07:53:10.680922 851 leader_election.cc:304] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.681357 2386 raft_consensus.cc:2749] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.681563 2113 raft_consensus.cc:493] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.681702 2113 raft_consensus.cc:515] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.682349 2113 leader_election.cc:290] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.683426 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f31cff599248dd994a7bcee38ef2ab" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:10.683902 988 leader_election.cc:343] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.684499 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f31cff599248dd994a7bcee38ef2ab" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.684695 777 raft_consensus.cc:2468] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:10.685182 986 leader_election.cc:304] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.685638 2113 raft_consensus.cc:2804] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:10.685726 2113 raft_consensus.cc:493] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:10.685802 2113 raft_consensus.cc:3060] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.690267 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd151f5e0d54bdab58423c24186b38d" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.690845 851 leader_election.cc:304] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.693473 913 raft_consensus.cc:3060] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.715191 896 tablet_service.cc:1511] Processing CreateTablet for tablet b38735fd577548b192131a769daa1d78 (DEFAULT_TABLE table=default.Table_1682ce0a78774c818b995cd84ef71c24 [id=8b7aca54adf84e06b871951742378d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.715732 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38735fd577548b192131a769daa1d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.721819 2637 tablet.cc:1724] T 8d0487d02934453fbb25104f3b8fe732 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:10.724493 2386 raft_consensus.cc:493] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.724663 2386 raft_consensus.cc:515] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.725869 2386 leader_election.cc:290] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:10.729800 851 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:10.740463 774 raft_consensus.cc:2468] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.745218 986 leader_election.cc:304] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.745612 2431 raft_consensus.cc:2804] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.745721 2431 raft_consensus.cc:697] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.745939 2431 consensus_queue.cc:237] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.747593 1165 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.747747 1165 ts_tablet_manager.cc:1403] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.119s user 0.013s sys 0.015s
I20260503 07:53:10.748510 1165 raft_consensus.cc:359] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.748706 1165 raft_consensus.cc:385] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.748783 1165 raft_consensus.cc:740] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.748991 1165 consensus_queue.cc:260] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.749904 1050 raft_consensus.cc:2468] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:10.750385 1165 ts_tablet_manager.cc:1434] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:10.750480 716 leader_election.cc:304] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.750779 1165 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.750876 2615 raft_consensus.cc:2804] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.750998 2615 raft_consensus.cc:697] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:10.751263 1166 tablet_bootstrap.cc:492] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.751219 2615 consensus_queue.cc:237] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.751420 1166 ts_tablet_manager.cc:1403] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.382s user 0.058s sys 0.073s
I20260503 07:53:10.752297 1166 raft_consensus.cc:359] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.752467 1166 raft_consensus.cc:385] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.752508 1166 raft_consensus.cc:740] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.753432 1952 raft_consensus.cc:493] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.753561 1952 raft_consensus.cc:515] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.754109 1165 tablet_bootstrap.cc:654] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.754136 1952 leader_election.cc:290] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.755180 1174 ts_tablet_manager.cc:1929] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.755228 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.755761 986 leader_election.cc:343] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.755286 1174 log.cc:1199] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:53:10.756376 1174 ts_tablet_manager.cc:1950] T 5eb48844c2a04b5e8b6f73b9986127ee P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:10.758761 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.752764 1166 consensus_queue.cc:260] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.759864 1171 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.760057 1171 ts_tablet_manager.cc:1403] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.095s user 0.010s sys 0.009s
W20260503 07:53:10.760663 988 leader_election.cc:343] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.760861 988 leader_election.cc:304] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.761147 1171 raft_consensus.cc:359] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.761344 1171 raft_consensus.cc:385] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.761425 1171 raft_consensus.cc:740] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.761651 1171 consensus_queue.cc:260] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.761792 2577 raft_consensus.cc:2749] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.766588 1171 ts_tablet_manager.cc:1434] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260503 07:53:10.767656 1171 tablet_bootstrap.cc:492] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.769322 1171 tablet_bootstrap.cc:654] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.772253 1166 ts_tablet_manager.cc:1434] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260503 07:53:10.772538 1166 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.772706 2577 raft_consensus.cc:493] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.772827 2577 raft_consensus.cc:515] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.773399 2577 leader_election.cc:290] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.773844 1166 tablet_bootstrap.cc:654] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.773988 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.774595 986 leader_election.cc:343] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.776479 1165 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.776692 1165 ts_tablet_manager.cc:1403] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260503 07:53:10.777715 1165 raft_consensus.cc:359] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.778019 1165 raft_consensus.cc:385] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.778138 1165 raft_consensus.cc:740] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.778448 1165 consensus_queue.cc:260] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.779163 1165 ts_tablet_manager.cc:1434] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.781378 1166 tablet_bootstrap.cc:492] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.781596 1166 ts_tablet_manager.cc:1403] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.001s
I20260503 07:53:10.782214 1166 raft_consensus.cc:359] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.782371 1166 raft_consensus.cc:385] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.782415 1166 raft_consensus.cc:740] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.782820 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.782572 1166 consensus_queue.cc:260] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.783465 1166 ts_tablet_manager.cc:1434] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.783730 1166 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.785121 1166 tablet_bootstrap.cc:654] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:10.786175 988 leader_election.cc:343] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.786304 988 leader_election.cc:304] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.786625 2577 raft_consensus.cc:2749] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.786748 1165 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.793326 1165 tablet_bootstrap.cc:654] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.793407 1166 tablet_bootstrap.cc:492] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.793529 1166 ts_tablet_manager.cc:1403] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260503 07:53:10.794149 1166 raft_consensus.cc:359] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.794296 1166 raft_consensus.cc:385] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.794343 1166 raft_consensus.cc:740] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.794713 1166 consensus_queue.cc:260] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.795274 1166 ts_tablet_manager.cc:1434] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.798432 1166 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.799693 1166 tablet_bootstrap.cc:654] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:10.801184 854 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:10.801635 854 leader_election.cc:304] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.801966 2386 raft_consensus.cc:2749] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:10.802318 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 61451.9us
W20260503 07:53:10.813448 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 83505.3us
I20260503 07:53:10.817067 918 raft_consensus.cc:3060] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.818034 914 raft_consensus.cc:3060] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:10.821794 986 consensus_peers.cc:597] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:10.830518 1166 tablet_bootstrap.cc:492] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.830647 1166 ts_tablet_manager.cc:1403] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.006s
I20260503 07:53:10.831260 1166 raft_consensus.cc:359] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.831409 1166 raft_consensus.cc:385] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.831451 1166 raft_consensus.cc:740] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.831627 1166 consensus_queue.cc:260] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:10.831875 772 consensus_meta.cc:287] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.590s user 0.003s sys 0.000s
I20260503 07:53:10.831966 772 raft_consensus.cc:2468] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:10.832239 1166 ts_tablet_manager.cc:1434] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.832347 1173 ts_tablet_manager.cc:1929] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.832427 1173 log.cc:1199] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/4f6c9fb96d5a4397b51611254be1a970
I20260503 07:53:10.832492 1166 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.832770 1173 ts_tablet_manager.cc:1950] T 4f6c9fb96d5a4397b51611254be1a970 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:10.832859 1165 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.833009 1165 ts_tablet_manager.cc:1403] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.004s
I20260503 07:53:10.833034 2574 raft_consensus.cc:515] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.833571 2574 leader_election.cc:290] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.834031 1165 raft_consensus.cc:359] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.834245 1165 raft_consensus.cc:385] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.834299 1165 raft_consensus.cc:740] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.834544 1165 consensus_queue.cc:260] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.835340 1165 ts_tablet_manager.cc:1434] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.835623 1165 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:10.842512 760 consensus_meta.cc:287] T 7439917c2a764658bfa8bf62ba67e34f P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.539s user 0.003s sys 0.001s
I20260503 07:53:10.843065 1165 tablet_bootstrap.cc:654] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.844329 1166 tablet_bootstrap.cc:654] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.846817 1165 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.846966 1165 ts_tablet_manager.cc:1403] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
W20260503 07:53:10.847087 751 consensus_meta.cc:287] T fc3ba7562faa48159e7f09c1fbc37d6c P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.538s user 0.001s sys 0.000s
I20260503 07:53:10.847891 1165 raft_consensus.cc:359] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.848078 1165 raft_consensus.cc:385] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.848141 1165 raft_consensus.cc:740] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.848397 1165 consensus_queue.cc:260] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.849030 1165 ts_tablet_manager.cc:1434] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:10.849386 1165 tablet_bootstrap.cc:492] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.852252 1165 tablet_bootstrap.cc:654] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.859390 986 leader_election.cc:304] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:10.860229 1952 raft_consensus.cc:2804] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:10.860332 1952 raft_consensus.cc:697] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:10.860535 1952 consensus_queue.cc:237] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.863359 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.863521 772 raft_consensus.cc:3060] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.864308 2591 raft_consensus.cc:2749] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:10.878448 1175 ts_tablet_manager.cc:1929] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:10.878587 1175 log.cc:1199] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5c30f15ad13340c89df3f5c8d65d63c7
I20260503 07:53:10.879029 1175 ts_tablet_manager.cc:1950] T 5c30f15ad13340c89df3f5c8d65d63c7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:10.882141 2574 consensus_queue.cc:1048] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.902208 2431 consensus_queue.cc:1048] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:10.903172 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1f35f61e9e0d48febc20df62f2cce2e2" } new_table_name: "default.Table_18888b48c9214c79bdf84dbfe9a168de" modify_external_catalogs: true
I20260503 07:53:10.904609 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c12868ba53db4201baf55c80a2d49ca4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.905143 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c12868ba53db4201baf55c80a2d49ca4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.906490 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ec0807d8f4dd447fb9870d3327bd93cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:10.906952 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec0807d8f4dd447fb9870d3327bd93cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:10.911742 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dcbb5010e346fca99dffdbdbb337f4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:10.912707 2431 raft_consensus.cc:493] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.912825 2431 raft_consensus.cc:515] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.913396 2431 leader_election.cc:290] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:10.915489 760 tablet_service.cc:1511] Processing CreateTablet for tablet b38735fd577548b192131a769daa1d78 (DEFAULT_TABLE table=default.Table_1682ce0a78774c818b995cd84ef71c24 [id=8b7aca54adf84e06b871951742378d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.915871 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38735fd577548b192131a769daa1d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.920962 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 157bb83e56234f17b906756c0d70868c (DEFAULT_TABLE table=default.Table_0e624ecc7a044b14861260875b044676 [id=09676ef47a114da286800d43f2b0fa93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.921350 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157bb83e56234f17b906756c0d70868c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.921463 886 tablet_service.cc:1511] Processing CreateTablet for tablet 157bb83e56234f17b906756c0d70868c (DEFAULT_TABLE table=default.Table_0e624ecc7a044b14861260875b044676 [id=09676ef47a114da286800d43f2b0fa93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.921803 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157bb83e56234f17b906756c0d70868c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.930519 2591 raft_consensus.cc:493] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:10.930653 2591 raft_consensus.cc:515] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:10.931241 2591 leader_election.cc:290] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.931970 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:10.932188 778 raft_consensus.cc:2393] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:53:10.932585 2113 raft_consensus.cc:515] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.933213 2113 leader_election.cc:290] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:10.933501 1026 consensus_meta.cc:287] T 00313f32277c4a779c47e9becc89b9b8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent flushing consensus metadata: real 0.675s user 0.015s sys 0.003s
I20260503 07:53:10.934578 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 955) took 3475 ms. Trace:
I20260503 07:53:10.934669 1175 rpcz_store.cc:276] 0503 07:53:07.458917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.460385 (+ 1468us) service_pool.cc:224] Handling call
0503 07:53:10.605914 (+3145529us) ts_tablet_manager.cc:1151] Deleting tablet 5c30f15ad13340c89df3f5c8d65d63c7
0503 07:53:10.605923 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.736505 (+130582us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.878382 (+141877us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.934559 (+ 56177us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3145368}
I20260503 07:53:10.935065 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 956) took 3457 ms. Trace:
I20260503 07:53:10.935141 1175 rpcz_store.cc:276] 0503 07:53:07.477462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.477512 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:10.934949 (+3457437us) ts_tablet_manager.cc:1151] Deleting tablet a328057ceb3640d1a26b773862492f04
0503 07:53:10.934959 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.935048 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3457275}
I20260503 07:53:10.935222 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f31cff599248dd994a7bcee38ef2ab" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:10.935375 778 raft_consensus.cc:3060] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.935446 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 957) took 3450 ms. Trace:
I20260503 07:53:10.935850 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5c30f15ad13340c89df3f5c8d65d63c7 (table default.Table_0e7364b796a041c1a161bdb798b5a566 [id=c702cea458024924addda2925295d7f7]) successfully deleted
W20260503 07:53:10.936242 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet a328057ceb3640d1a26b773862492f04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a328057ceb3640d1a26b773862492f04 already in progress: creating tablet
I20260503 07:53:10.935499 1175 rpcz_store.cc:276] 0503 07:53:07.485046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.485095 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:10.935350 (+3450255us) ts_tablet_manager.cc:1151] Deleting tablet 2df2ed7d2563487aa15fe917b3fcf313
0503 07:53:10.935357 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.935429 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3450098}
I20260503 07:53:10.936753 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 959) took 3442 ms. Trace:
I20260503 07:53:10.936832 1175 rpcz_store.cc:276] 0503 07:53:07.494040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.494088 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:10.936655 (+3442567us) ts_tablet_manager.cc:1151] Deleting tablet acbfff84673541929083cbc13b059398
0503 07:53:10.936664 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.936738 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3442392}
I20260503 07:53:10.937177 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 958) took 3443 ms. Trace:
I20260503 07:53:10.937253 1175 rpcz_store.cc:276] 0503 07:53:07.493920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.494336 (+ 416us) service_pool.cc:224] Handling call
0503 07:53:10.937074 (+3442738us) ts_tablet_manager.cc:1151] Deleting tablet 9aa3759511d942bfbc6e50ea2e2f2777
0503 07:53:10.937085 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.937160 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3442603}
I20260503 07:53:10.937554 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 960) took 3429 ms. Trace:
I20260503 07:53:10.937630 1175 rpcz_store.cc:276] 0503 07:53:07.508351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.508407 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:10.937465 (+3429058us) ts_tablet_manager.cc:1151] Deleting tablet 17b58e042a6442658d95d373409fa25e
0503 07:53:10.937476 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.937541 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3428887}
I20260503 07:53:10.937871 1175 tablet_replica.cc:333] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:10.938081 1175 raft_consensus.cc:2243] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:10.938422 1175 raft_consensus.cc:2272] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:10.938972 2637 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.217s user 0.000s sys 0.000s
W20260503 07:53:10.939249 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2df2ed7d2563487aa15fe917b3fcf313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2ed7d2563487aa15fe917b3fcf313 already in progress: creating tablet
W20260503 07:53:10.939438 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet acbfff84673541929083cbc13b059398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acbfff84673541929083cbc13b059398 already in progress: creating tablet
W20260503 07:53:10.939599 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9aa3759511d942bfbc6e50ea2e2f2777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aa3759511d942bfbc6e50ea2e2f2777 already in progress: creating tablet
W20260503 07:53:10.939749 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 17b58e042a6442658d95d373409fa25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17b58e042a6442658d95d373409fa25e already in progress: creating tablet
I20260503 07:53:10.940131 2608 raft_consensus.cc:515] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.940696 2608 leader_election.cc:290] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:10.942514 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:10.942956 715 leader_election.cc:343] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.944275 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618b858f6e424845b5a6b0010cb2b602" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:10.944371 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:10.944502 1049 raft_consensus.cc:3060] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.944955 854 leader_election.cc:304] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:10.945334 2386 raft_consensus.cc:3060] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:10.951403 1175 ts_tablet_manager.cc:1916] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:10.963157 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:10.964026 986 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.965384 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:10.965678 1171 tablet_bootstrap.cc:492] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.965801 1171 ts_tablet_manager.cc:1403] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.198s user 0.023s sys 0.001s
W20260503 07:53:10.966094 988 leader_election.cc:343] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:10.966564 1171 raft_consensus.cc:359] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.966781 1171 raft_consensus.cc:385] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.966882 1171 raft_consensus.cc:740] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.967130 1171 consensus_queue.cc:260] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.969094 1171 ts_tablet_manager.cc:1434] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:10.969540 1171 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.971189 1171 tablet_bootstrap.cc:654] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.974442 754 tablet_service.cc:1511] Processing CreateTablet for tablet 157bb83e56234f17b906756c0d70868c (DEFAULT_TABLE table=default.Table_0e624ecc7a044b14861260875b044676 [id=09676ef47a114da286800d43f2b0fa93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:10.974807 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157bb83e56234f17b906756c0d70868c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:10.980458 1166 tablet_bootstrap.cc:492] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:10.980638 1166 ts_tablet_manager.cc:1403] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.148s user 0.046s sys 0.083s
I20260503 07:53:10.981305 1166 raft_consensus.cc:359] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.981695 1166 raft_consensus.cc:385] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.981803 1166 raft_consensus.cc:740] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.982046 1166 consensus_queue.cc:260] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.982383 599 master_service.cc:954] ReplaceTablet: received request to replace tablet 2f9a23702aa5493ea8712f904af96755 from {username='slave'} at 127.0.0.1:44308
W20260503 07:53:10.982564 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97f2cf2eaf6441ce970aa71fa0df0dd6 consensus state has no leader
I20260503 07:53:10.982892 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_47281d82f2c84819a8121c1e4d4e3585" } new_table_name: "default.Table_4ee3752f539e48948e29064fb15e2f1f" modify_external_catalogs: true
I20260503 07:53:10.985368 1165 tablet_bootstrap.cc:492] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:10.985553 1165 ts_tablet_manager.cc:1403] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.136s user 0.037s sys 0.085s
I20260503 07:53:10.985708 1166 ts_tablet_manager.cc:1434] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:53:10.985992 1166 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:10.986537 1165 raft_consensus.cc:359] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.986781 1165 raft_consensus.cc:385] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.986901 1165 raft_consensus.cc:740] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.987195 1165 consensus_queue.cc:260] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.987514 1166 tablet_bootstrap.cc:654] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:10.987756 1165 ts_tablet_manager.cc:1434] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:10.989058 1171 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:10.989188 1171 ts_tablet_manager.cc:1403] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20260503 07:53:10.989722 1171 raft_consensus.cc:359] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.989825 1171 raft_consensus.cc:385] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:10.989854 1171 raft_consensus.cc:740] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:10.990036 1171 consensus_queue.cc:260] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:10.990468 1171 ts_tablet_manager.cc:1434] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:10.990717 1171 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:10.990945 1165 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:10.994843 1171 tablet_bootstrap.cc:654] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:11.002444 988 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.002576 988 leader_election.cc:304] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:11.004565 2113 raft_consensus.cc:2749] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:11.004981 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23b8c1768a15487ba9140acd77c4ff7b consensus state has no leader
I20260503 07:53:11.005600 601 master_service.cc:954] ReplaceTablet: received request to replace tablet f2de368e66424e4d9edf7c840ac8071e from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:11.007144 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc68e79b1a043eba15aa64cb99aed04 (DEFAULT_TABLE table=default.Table_b3776feee53c4ed8bf22d4354fd716ab [id=281e689bef45442094fc50b728e5d845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.007701 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 6ede91937218487ea2a0ad7a9e58bbee (DEFAULT_TABLE table=default.Table_bb606273a187473da6be09b9183a8ec1 [id=aadef1efc11842b2ab8f4ce97cc4c789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.008164 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 96f77e858c4e4b6f8d918f6e735ff340 (DEFAULT_TABLE table=default.Table_b2e3381e4c8441d0b9f0bd694a4b6f03 [id=62ed40c7579749dbace13502002987f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.010674 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6ede91937218487ea2a0ad7a9e58bbee (DEFAULT_TABLE table=default.Table_bb606273a187473da6be09b9183a8ec1 [id=aadef1efc11842b2ab8f4ce97cc4c789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.010758 752 tablet_service.cc:1511] Processing CreateTablet for tablet 96f77e858c4e4b6f8d918f6e735ff340 (DEFAULT_TABLE table=default.Table_b2e3381e4c8441d0b9f0bd694a4b6f03 [id=62ed40c7579749dbace13502002987f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.011140 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ede91937218487ea2a0ad7a9e58bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.011083 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6358397453784492849cd35b3ebc70b4 (DEFAULT_TABLE table=default.Table_0fa89bcfce9646958abc5de6041a5bc0 [id=04e4a0ff0b994c2982e09e94e7054b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.011343 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f77e858c4e4b6f8d918f6e735ff340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.010776 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc68e79b1a043eba15aa64cb99aed04 (DEFAULT_TABLE table=default.Table_b3776feee53c4ed8bf22d4354fd716ab [id=281e689bef45442094fc50b728e5d845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.011762 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc68e79b1a043eba15aa64cb99aed04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.015751 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6358397453784492849cd35b3ebc70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.020367 1165 tablet_bootstrap.cc:654] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.020618 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 6358397453784492849cd35b3ebc70b4 (DEFAULT_TABLE table=default.Table_0fa89bcfce9646958abc5de6041a5bc0 [id=04e4a0ff0b994c2982e09e94e7054b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.021034 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc9ff7cf2494634886cdc8543a915c7 (DEFAULT_TABLE table=default.Table_032933754e71413aa0bd9a712e7bcc1b [id=c22b6226cb2f494cabd8a6322ea68af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.021927 743 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc9ff7cf2494634886cdc8543a915c7 (DEFAULT_TABLE table=default.Table_032933754e71413aa0bd9a712e7bcc1b [id=c22b6226cb2f494cabd8a6322ea68af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.022246 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc9ff7cf2494634886cdc8543a915c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.023067 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ca056b819de74bf8b0deed491d863e02" } modify_external_catalogs: true
I20260503 07:53:11.023221 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ca056b819de74bf8b0deed491d863e02" } modify_external_catalogs: true
I20260503 07:53:11.024971 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_80eb2da5ac354508bb67257f45284795"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.025271 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2f9a23702aa5493ea8712f904af96755
I20260503 07:53:11.025640 599 catalog_manager.cc:6741] ReplaceTablet: tablet 2f9a23702aa5493ea8712f904af96755 deleted and replaced by tablet 79d911c4eb994478ba633e5194ddb343
I20260503 07:53:11.025876 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2072505f72ef4481aa77f2c6b8354aaa" } modify_external_catalogs: true
I20260503 07:53:11.026029 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2072505f72ef4481aa77f2c6b8354aaa" } modify_external_catalogs: true
I20260503 07:53:11.026165 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c36456e61be8471387364109939d3dcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.026671 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c36456e61be8471387364109939d3dcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:11.028154 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d93d5f6df3349588b9f1d5e0e24a1db consensus state has no leader
I20260503 07:53:11.028606 2421 raft_consensus.cc:515] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.029196 2421 leader_election.cc:290] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.030586 2565 raft_consensus.cc:515] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.031127 2565 leader_election.cc:290] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:11.031407 2386 raft_consensus.cc:2749] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:11.035435 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 884) took 3229 ms. Trace:
I20260503 07:53:11.035537 1173 rpcz_store.cc:276] 0503 07:53:07.805756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.806593 (+ 837us) service_pool.cc:224] Handling call
0503 07:53:10.462273 (+2655680us) ts_tablet_manager.cc:1151] Deleting tablet 4f6c9fb96d5a4397b51611254be1a970
0503 07:53:10.462283 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.684140 (+221857us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.832294 (+148154us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.035410 (+203116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2655364}
I20260503 07:53:11.036027 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 887) took 3122 ms. Trace:
I20260503 07:53:11.036118 1173 rpcz_store.cc:276] 0503 07:53:07.913163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.913202 (+ 39us) service_pool.cc:224] Handling call
0503 07:53:11.035852 (+3122650us) ts_tablet_manager.cc:1151] Deleting tablet 82f5e16014a34ab9a125d62c72cf2c00
0503 07:53:11.035863 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.036002 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122510}
I20260503 07:53:11.036415 1173 tablet_replica.cc:333] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:11.036587 1173 raft_consensus.cc:2243] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.036733 1173 raft_consensus.cc:2272] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.037237 1173 ts_tablet_manager.cc:1916] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.039569 1165 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:11.039690 1165 ts_tablet_manager.cc:1403] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.003s
W20260503 07:53:11.040288 742 consensus_meta.cc:287] T 8d950f7c08ad40d088668cc696f9a937 P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.734s user 0.002s sys 0.001s
I20260503 07:53:11.040452 1165 raft_consensus.cc:359] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.040596 1165 raft_consensus.cc:385] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.040647 1165 raft_consensus.cc:740] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.040859 1165 consensus_queue.cc:260] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.041301 1165 ts_tablet_manager.cc:1434] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:11.041538 1165 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:11.042783 1165 tablet_bootstrap.cc:654] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.043573 1049 raft_consensus.cc:2468] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:11.044406 1166 tablet_bootstrap.cc:492] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
W20260503 07:53:11.044417 757 consensus_meta.cc:287] T b216e8fdaefa4757b1c0567eae3749ee P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.741s user 0.004s sys 0.000s
I20260503 07:53:11.044508 1166 ts_tablet_manager.cc:1403] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.005s
I20260503 07:53:11.044973 716 leader_election.cc:304] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:11.045140 746 consensus_meta.cc:287] T c239db0cf001482fafbf0fe739385b10 P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.738s user 0.003s sys 0.000s
I20260503 07:53:11.045395 2608 raft_consensus.cc:2804] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.045414 1166 raft_consensus.cc:359] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.045502 2608 raft_consensus.cc:697] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:11.045559 1166 raft_consensus.cc:385] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.045608 1166 raft_consensus.cc:740] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.045620 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 850) took 4828 ms. Trace:
I20260503 07:53:11.045679 1174 rpcz_store.cc:276] 0503 07:53:06.217251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.217452 (+ 201us) service_pool.cc:224] Handling call
0503 07:53:10.600280 (+4382828us) ts_tablet_manager.cc:1151] Deleting tablet 5eb48844c2a04b5e8b6f73b9986127ee
0503 07:53:10.600292 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:10.638889 (+ 38597us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:10.755119 (+116230us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.045609 (+290490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4382635}
I20260503 07:53:11.045783 1166 consensus_queue.cc:260] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.045990 1174 tablet_replica.cc:333] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:11.045711 2608 consensus_queue.cc:237] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.046159 1174 raft_consensus.cc:2243] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.046250 1166 ts_tablet_manager.cc:1434] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:11.046324 1174 raft_consensus.cc:2272] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.046497 1166 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:11.046808 1174 ts_tablet_manager.cc:1916] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.046991 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7af140ce144bc8b2e147dad98ac201" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:11.047148 1049 raft_consensus.cc:3060] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.047950 1166 tablet_bootstrap.cc:654] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.050388 772 raft_consensus.cc:2468] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:53:11.050690 775 consensus_meta.cc:287] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.504s user 0.003s sys 0.000s
I20260503 07:53:11.050755 775 raft_consensus.cc:2468] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:53:11.051023 759 consensus_meta.cc:287] T 0f707cb0257c4d6182ec331a235ba06c P 4a924c2134c54fa0bb164825da53bdd0: Time spent flushing consensus metadata: real 0.746s user 0.000s sys 0.004s
I20260503 07:53:11.053006 1049 raft_consensus.cc:2468] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:11.053349 716 leader_election.cc:304] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:11.053555 2615 raft_consensus.cc:2804] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.053637 2615 raft_consensus.cc:697] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:11.053819 2615 consensus_queue.cc:237] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.053931 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 949c2dc3bcb144578739aec2ea066fdf
I20260503 07:53:11.054517 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f8b6c30a13a249b7a848733abbc1fe9f" } modify_external_catalogs: true
I20260503 07:53:11.054658 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f8b6c30a13a249b7a848733abbc1fe9f" } modify_external_catalogs: true
I20260503 07:53:11.056918 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0bffda3cc5e8484ea1666c788a11a6a3
I20260503 07:53:11.057415 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0319d0a5b2814beebb4b59f9c664b588" } modify_external_catalogs: true
I20260503 07:53:11.057462 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_079c0329f9e24361bd7fa7d067c93fe3" } new_table_name: "default.Table_07f25ab0eda546e388813f8791a71ada" modify_external_catalogs: true
I20260503 07:53:11.057542 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0319d0a5b2814beebb4b59f9c664b588" } modify_external_catalogs: true
I20260503 07:53:11.061224 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b4231da0fcb4e90b1e573fd7aef5f40" } modify_external_catalogs: true
I20260503 07:53:11.061343 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7b4231da0fcb4e90b1e573fd7aef5f40" } modify_external_catalogs: true
I20260503 07:53:11.063212 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_539ec4ae80b54267ad6dc4a0d02e0d08" } new_table_name: "default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256" modify_external_catalogs: true
I20260503 07:53:11.065565 986 leader_election.cc:304] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:11.065796 2421 raft_consensus.cc:2804] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.065892 2421 raft_consensus.cc:697] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:11.065971 986 leader_election.cc:304] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:11.066162 1952 raft_consensus.cc:2804] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.066111 2421 consensus_queue.cc:237] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.066279 1952 raft_consensus.cc:697] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:11.066377 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7af140ce144bc8b2e147dad98ac201" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:11.066502 1952 consensus_queue.cc:237] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:11.068287 715 leader_election.cc:343] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.068432 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b1d6f7f8766843359ad26aac3c60ecbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.068869 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1d6f7f8766843359ad26aac3c60ecbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.071666 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5eb48844c2a04b5e8b6f73b9986127ee (table default.Table_08ac73e23e35413686867661229a09a6 [id=287a9ed55cc547da8a91b2209e99a201]) successfully deleted
I20260503 07:53:11.073627 759 tablet_service.cc:1511] Processing CreateTablet for tablet 074b22e01a334acba2e728a8b0ed4324 (DEFAULT_TABLE table=default.Table_f251ae3be30f4b1a8f888c898d6c17ce [id=7af107c44ef04635aca6725359290414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.074085 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4de67550dbe0435cace68bf31911e476 (DEFAULT_TABLE table=default.Table_1250f3ea00054f5c9b0ad7cf079892d2 [id=fc1b5b577c074b458f0e770f6d915708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.074412 758 tablet_service.cc:1511] Processing CreateTablet for tablet e874f8c0f52040ffb9f211b27da50907 (DEFAULT_TABLE table=default.Table_3a68ed42a6bb4aeaa03637864422abae [id=2bbdaf5045984e0aadc9cab99f45edb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.074717 756 tablet_service.cc:1511] Processing CreateTablet for tablet 19534cfc9f3c44c1b3862e0214366054 (DEFAULT_TABLE table=default.Table_3c016ed3b391460c8b2f27f84115dc5c [id=2810f2eec0fc4ab2881a2f1ffb8f2374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.074717 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 (DEFAULT_TABLE table=default.Table_650313d3ed9447df8706aad925ff5b5b [id=3ba6b937d4294de1b7ac40f29ebad69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.074889 744 tablet_service.cc:1511] Processing CreateTablet for tablet 56f158b7489240449ce8d64d193cccc1 (DEFAULT_TABLE table=default.Table_1314de5d64d948419afb1b3588747142 [id=37ba4da110434c558efa55453e67bb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.075155 745 tablet_service.cc:1511] Processing CreateTablet for tablet 42c82dbdf98947fca0b8aaa9f47f13db (DEFAULT_TABLE table=default.Table_2946eabdeefd44cb8de4aefc235cc906 [id=51d560668ca44003adb4451c0c69b70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.075155 757 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25 (DEFAULT_TABLE table=default.Table_278c6e4b23b94ec4b8f7a502932f7962 [id=8ca0f77d70d644e2bd7b16afe9b51c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.075487 755 tablet_service.cc:1511] Processing CreateTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba (DEFAULT_TABLE table=default.Table_f8b6c30a13a249b7a848733abbc1fe9f [id=7bfcf2298178400696d6b03ef8af59cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.075706 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 949c2dc3bcb144578739aec2ea066fdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.075871 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.076148 741 tablet_service.cc:1511] Processing CreateTablet for tablet bb945c6be9d046dbb795551d5b28c653 (DEFAULT_TABLE table=default.Table_1f6a4395bc1544f0b36f4f37f01aeedd [id=cbebd4876984490784899780d67bcaea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.076391 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9a23702aa5493ea8712f904af96755 with delete_type TABLET_DATA_DELETED (replaced by tablet 79d911c4eb994478ba633e5194ddb343) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.076674 753 tablet_service.cc:1511] Processing CreateTablet for tablet 6c615cb123224ceda51d68d5980a2323 (DEFAULT_TABLE table=default.Table_7b4231da0fcb4e90b1e573fd7aef5f40 [id=baacca859a5f4c39af5eb59c02d26c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.076998 746 tablet_service.cc:1511] Processing CreateTablet for tablet 53a744819d0d419b9e856ae2176b9ab9 (DEFAULT_TABLE table=default.Table_91ace72de407482a9e12864e33af5d91 [id=4c5d5a55f2cf46e49685d9cc3d3d03a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.078539 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 4f6c9fb96d5a4397b51611254be1a970 (table default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]) successfully deleted
W20260503 07:53:11.078747 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 82f5e16014a34ab9a125d62c72cf2c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82f5e16014a34ab9a125d62c72cf2c00 already in progress: creating tablet
W20260503 07:53:11.025581 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80eb2da5ac354508bb67257f45284795 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.079454 1165 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:11.079576 1165 ts_tablet_manager.cc:1403] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260503 07:53:11.079751 882 tablet_service.cc:1511] Processing CreateTablet for tablet 6ede91937218487ea2a0ad7a9e58bbee (DEFAULT_TABLE table=default.Table_bb606273a187473da6be09b9183a8ec1 [id=aadef1efc11842b2ab8f4ce97cc4c789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.080348 879 tablet_service.cc:1511] Processing CreateTablet for tablet 96f77e858c4e4b6f8d918f6e735ff340 (DEFAULT_TABLE table=default.Table_b2e3381e4c8441d0b9f0bd694a4b6f03 [id=62ed40c7579749dbace13502002987f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.080353 1165 raft_consensus.cc:359] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.080511 1165 raft_consensus.cc:385] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.080566 1165 raft_consensus.cc:740] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.080746 1165 consensus_queue.cc:260] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.080826 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6358397453784492849cd35b3ebc70b4 (DEFAULT_TABLE table=default.Table_0fa89bcfce9646958abc5de6041a5bc0 [id=04e4a0ff0b994c2982e09e94e7054b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.081259 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc9ff7cf2494634886cdc8543a915c7 (DEFAULT_TABLE table=default.Table_032933754e71413aa0bd9a712e7bcc1b [id=c22b6226cb2f494cabd8a6322ea68af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.081470 1165 ts_tablet_manager.cc:1434] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:11.081701 890 tablet_service.cc:1511] Processing CreateTablet for tablet f428b63b5dd44bfea1487287965483ab (DEFAULT_TABLE table=default.Table_2b4d0f0707354322996eba01d73d5ea9 [id=17b03840d49243dabfa0250f8ac90363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.081924 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 (DEFAULT_TABLE table=default.Table_650313d3ed9447df8706aad925ff5b5b [id=3ba6b937d4294de1b7ac40f29ebad69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.082135 889 tablet_service.cc:1511] Processing CreateTablet for tablet 074b22e01a334acba2e728a8b0ed4324 (DEFAULT_TABLE table=default.Table_f251ae3be30f4b1a8f888c898d6c17ce [id=7af107c44ef04635aca6725359290414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.082513 884 tablet_service.cc:1511] Processing CreateTablet for tablet 662a418a0fbd4979b08f3a977a14da1d (DEFAULT_TABLE table=default.Table_78050367c48f47a5831411a068239629 [id=9b9e956fe0be4c09bf6b61e351955532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.082937 888 tablet_service.cc:1511] Processing CreateTablet for tablet 53a744819d0d419b9e856ae2176b9ab9 (DEFAULT_TABLE table=default.Table_91ace72de407482a9e12864e33af5d91 [id=4c5d5a55f2cf46e49685d9cc3d3d03a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.083041 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2f95e3ad844bc39593787e38a45bad (DEFAULT_TABLE table=default.Table_2bc82c1725174620b6c53f604e2e9583 [id=9f95d060661c4750bc3ba3f9e4d82aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.083042 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e874f8c0f52040ffb9f211b27da50907 (DEFAULT_TABLE table=default.Table_3a68ed42a6bb4aeaa03637864422abae [id=2bbdaf5045984e0aadc9cab99f45edb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.083222 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9a23702aa5493ea8712f904af96755 with delete_type TABLET_DATA_DELETED (replaced by tablet 79d911c4eb994478ba633e5194ddb343) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.083477 898 tablet_service.cc:1511] Processing CreateTablet for tablet bb945c6be9d046dbb795551d5b28c653 (DEFAULT_TABLE table=default.Table_1f6a4395bc1544f0b36f4f37f01aeedd [id=cbebd4876984490784899780d67bcaea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.083858 887 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25 (DEFAULT_TABLE table=default.Table_278c6e4b23b94ec4b8f7a502932f7962 [id=8ca0f77d70d644e2bd7b16afe9b51c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.084314 880 tablet_service.cc:1511] Processing CreateTablet for tablet 4de67550dbe0435cace68bf31911e476 (DEFAULT_TABLE table=default.Table_1250f3ea00054f5c9b0ad7cf079892d2 [id=fc1b5b577c074b458f0e770f6d915708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.084334 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25 (DEFAULT_TABLE table=default.Table_278c6e4b23b94ec4b8f7a502932f7962 [id=8ca0f77d70d644e2bd7b16afe9b51c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.084666 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 4de67550dbe0435cace68bf31911e476 (DEFAULT_TABLE table=default.Table_1250f3ea00054f5c9b0ad7cf079892d2 [id=fc1b5b577c074b458f0e770f6d915708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.084731 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 (DEFAULT_TABLE table=default.Table_650313d3ed9447df8706aad925ff5b5b [id=3ba6b937d4294de1b7ac40f29ebad69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.085083 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba (DEFAULT_TABLE table=default.Table_f8b6c30a13a249b7a848733abbc1fe9f [id=7bfcf2298178400696d6b03ef8af59cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.085131 894 tablet_service.cc:1511] Processing CreateTablet for tablet e874f8c0f52040ffb9f211b27da50907 (DEFAULT_TABLE table=default.Table_3a68ed42a6bb4aeaa03637864422abae [id=2bbdaf5045984e0aadc9cab99f45edb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.085525 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 949c2dc3bcb144578739aec2ea066fdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.085561 881 tablet_service.cc:1511] Processing CreateTablet for tablet 56f158b7489240449ce8d64d193cccc1 (DEFAULT_TABLE table=default.Table_1314de5d64d948419afb1b3588747142 [id=37ba4da110434c558efa55453e67bb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.085976 883 tablet_service.cc:1511] Processing CreateTablet for tablet 42c82dbdf98947fca0b8aaa9f47f13db (DEFAULT_TABLE table=default.Table_2946eabdeefd44cb8de4aefc235cc906 [id=51d560668ca44003adb4451c0c69b70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.085976 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 19534cfc9f3c44c1b3862e0214366054 (DEFAULT_TABLE table=default.Table_3c016ed3b391460c8b2f27f84115dc5c [id=2810f2eec0fc4ab2881a2f1ffb8f2374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.086396 897 tablet_service.cc:1511] Processing CreateTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba (DEFAULT_TABLE table=default.Table_f8b6c30a13a249b7a848733abbc1fe9f [id=7bfcf2298178400696d6b03ef8af59cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.086512 1019 tablet_service.cc:1511] Processing CreateTablet for tablet bb945c6be9d046dbb795551d5b28c653 (DEFAULT_TABLE table=default.Table_1f6a4395bc1544f0b36f4f37f01aeedd [id=cbebd4876984490784899780d67bcaea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.086706 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 949c2dc3bcb144578739aec2ea066fdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.086908 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.087013 893 tablet_service.cc:1511] Processing CreateTablet for tablet 19534cfc9f3c44c1b3862e0214366054 (DEFAULT_TABLE table=default.Table_3c016ed3b391460c8b2f27f84115dc5c [id=2810f2eec0fc4ab2881a2f1ffb8f2374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.087448 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 6c615cb123224ceda51d68d5980a2323 (DEFAULT_TABLE table=default.Table_7b4231da0fcb4e90b1e573fd7aef5f40 [id=baacca859a5f4c39af5eb59c02d26c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.087613 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 662a418a0fbd4979b08f3a977a14da1d (DEFAULT_TABLE table=default.Table_78050367c48f47a5831411a068239629 [id=9b9e956fe0be4c09bf6b61e351955532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.087941 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 53a744819d0d419b9e856ae2176b9ab9 (DEFAULT_TABLE table=default.Table_91ace72de407482a9e12864e33af5d91 [id=4c5d5a55f2cf46e49685d9cc3d3d03a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.088145 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9a23702aa5493ea8712f904af96755 with delete_type TABLET_DATA_DELETED (replaced by tablet 79d911c4eb994478ba633e5194ddb343) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.088409 778 raft_consensus.cc:2468] T c2f31cff599248dd994a7bcee38ef2ab P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:11.088482 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 56f158b7489240449ce8d64d193cccc1 (DEFAULT_TABLE table=default.Table_1314de5d64d948419afb1b3588747142 [id=37ba4da110434c558efa55453e67bb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.088817 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 42c82dbdf98947fca0b8aaa9f47f13db (DEFAULT_TABLE table=default.Table_2946eabdeefd44cb8de4aefc235cc906 [id=51d560668ca44003adb4451c0c69b70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.087448 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 074b22e01a334acba2e728a8b0ed4324 (DEFAULT_TABLE table=default.Table_f251ae3be30f4b1a8f888c898d6c17ce [id=7af107c44ef04635aca6725359290414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.068888 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 35ca011a011a44ad9447f2d5b19a63ba
I20260503 07:53:11.090544 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ba5e9cfe6b4f24a8f91c571416dae3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:11.090695 775 raft_consensus.cc:3060] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.090627 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_80ba0ddbd798484daa6d731ec40bdf3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.091077 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80ba0ddbd798484daa6d731ec40bdf3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.092089 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6c615cb123224ceda51d68d5980a2323
I20260503 07:53:11.092612 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_daccf1f8872c49f99de2bc0755367705"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.093014 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daccf1f8872c49f99de2bc0755367705 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.093158 775 raft_consensus.cc:2468] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
W20260503 07:53:11.094784 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 001ded76f1894772898cb660e501984d consensus state has no leader
I20260503 07:53:11.095108 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc68e79b1a043eba15aa64cb99aed04 (DEFAULT_TABLE table=default.Table_b3776feee53c4ed8bf22d4354fd716ab [id=281e689bef45442094fc50b728e5d845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.095753 750 tablet_service.cc:1511] Processing CreateTablet for tablet 662a418a0fbd4979b08f3a977a14da1d (DEFAULT_TABLE table=default.Table_78050367c48f47a5831411a068239629 [id=9b9e956fe0be4c09bf6b61e351955532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.100386 1024 tablet_service.cc:1511] Processing CreateTablet for tablet f428b63b5dd44bfea1487287965483ab (DEFAULT_TABLE table=default.Table_2b4d0f0707354322996eba01d73d5ea9 [id=17b03840d49243dabfa0250f8ac90363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.100821 752 tablet_service.cc:1511] Processing CreateTablet for tablet f428b63b5dd44bfea1487287965483ab (DEFAULT_TABLE table=default.Table_2b4d0f0707354322996eba01d73d5ea9 [id=17b03840d49243dabfa0250f8ac90363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.106981 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2f95e3ad844bc39593787e38a45bad (DEFAULT_TABLE table=default.Table_2bc82c1725174620b6c53f604e2e9583 [id=9f95d060661c4750bc3ba3f9e4d82aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.109823 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bffda3cc5e8484ea1666c788a11a6a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.110208 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6c615cb123224ceda51d68d5980a2323 (DEFAULT_TABLE table=default.Table_7b4231da0fcb4e90b1e573fd7aef5f40 [id=baacca859a5f4c39af5eb59c02d26c00]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.111070 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18b9a34f66d342fcbff7f8b8adb28b80 consensus state has no leader
I20260503 07:53:11.113127 2386 raft_consensus.cc:493] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.113245 2386 raft_consensus.cc:515] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.113813 2386 leader_election.cc:290] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:11.115775 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:11.116091 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0a08da2052f5482792c8b3294e9b7332 (table default.Table_ef8abe51f2574f0fb195e588e808102e [id=a8e0e85f02244d0b845242b0d59eedce]). Expected version 1 got 0
I20260503 07:53:11.116348 597 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_db6ceb7013de4160aa0d9c608e618791 [id=62580342c555493caaba1c75cf31eadf]). Expected version 1 got 0
I20260503 07:53:11.118011 986 leader_election.cc:304] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:11.118284 986 leader_election.cc:304] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:11.119225 2577 raft_consensus.cc:2804] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.119328 2577 raft_consensus.cc:697] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:11.119560 2577 consensus_queue.cc:237] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.120028 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_fc2f1060428149818159c2074b32f1f0 [id=f334cc96ca794a41a2fcd3fc170444d4] alter complete (version 1)
I20260503 07:53:11.120591 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.120878 2574 raft_consensus.cc:2804] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.120985 2574 raft_consensus.cc:697] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:11.121197 2574 consensus_queue.cc:237] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.121476 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f31cff599248dd994a7bcee38ef2ab" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:11.121625 913 raft_consensus.cc:3060] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.123601 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_0b15f87be9ea47fbb396e1fb1779685e [id=42229936a86a4dc29d6c778f946c494e] alter complete (version 4)
I20260503 07:53:11.123723 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ede91937218487ea2a0ad7a9e58bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.126721 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.126986 1174 ts_tablet_manager.cc:1929] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:11.127082 1174 log.cc:1199] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5c30f15ad13340c89df3f5c8d65d63c7
I20260503 07:53:11.127380 1174 ts_tablet_manager.cc:1950] T 5c30f15ad13340c89df3f5c8d65d63c7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:11.127601 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c615cb123224ceda51d68d5980a2323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.129951 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074b22e01a334acba2e728a8b0ed4324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.131893 1173 ts_tablet_manager.cc:1929] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260503 07:53:11.131969 1173 log.cc:1199] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/766799446d1a480ca04246b0aec14852
I20260503 07:53:11.132303 1173 ts_tablet_manager.cc:1950] T 766799446d1a480ca04246b0aec14852 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:11.132315 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f77e858c4e4b6f8d918f6e735ff340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.132737 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6358397453784492849cd35b3ebc70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.133090 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc9ff7cf2494634886cdc8543a915c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.133244 1171 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:11.133347 1171 ts_tablet_manager.cc:1403] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.143s user 0.001s sys 0.003s
I20260503 07:53:11.133416 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ede91937218487ea2a0ad7a9e58bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.133775 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc68e79b1a043eba15aa64cb99aed04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.134063 1171 raft_consensus.cc:359] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.134202 1171 raft_consensus.cc:385] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.134243 1171 raft_consensus.cc:740] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.134394 1171 consensus_queue.cc:260] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.137310 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc9ff7cf2494634886cdc8543a915c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.134770 1171 ts_tablet_manager.cc:1434] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:11.140241 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a744819d0d419b9e856ae2176b9ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.141578 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ba5e9cfe6b4f24a8f91c571416dae3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:11.143278 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ca011a011a44ad9447f2d5b19a63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.143726 2431 consensus_queue.cc:1048] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:11.144472 988 leader_election.cc:343] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:11.145308 988 consensus_peers.cc:597] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f6c9fb96d5a4397b51611254be1a970. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:11.146715 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a418a0fbd4979b08f3a977a14da1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.150426 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f158b7489240449ce8d64d193cccc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.135286 600 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_d6eceb09895b43d3a76f41c98c9acf5a [id=2eaba4e8d05245a6bc3e02fad14314d9] alter complete (version 4)
I20260503 07:53:11.154354 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e874f8c0f52040ffb9f211b27da50907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.157755 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428b63b5dd44bfea1487287965483ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.160296 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb945c6be9d046dbb795551d5b28c653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.161666 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.163292 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f77e858c4e4b6f8d918f6e735ff340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.163938 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_2d0e0b117d844dbe92e4ecd0e5d9bfe4 [id=e4b1a8554c72416ababa0c721ec1fd6e] alter complete (version 1)
I20260503 07:53:11.164469 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e874f8c0f52040ffb9f211b27da50907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.166465 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c82dbdf98947fca0b8aaa9f47f13db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.168426 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.169322 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc68e79b1a043eba15aa64cb99aed04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.171152 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_4fa48e379ec44c65b934bd27193a5a43 [id=7388cb975bc54f82b1682be2e66385d7] alter complete (version 1)
I20260503 07:53:11.172273 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6358397453784492849cd35b3ebc70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.172508 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de67550dbe0435cace68bf31911e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.175132 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de67550dbe0435cace68bf31911e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.176467 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ca011a011a44ad9447f2d5b19a63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.178020 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19534cfc9f3c44c1b3862e0214366054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.178558 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_5859483307f54d36a9343787dfc93b4b [id=d18504297995448bb3a4a0edad330588] alter complete (version 1)
I20260503 07:53:11.179353 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_6791ce20ae0e4ec890edbd3788dbe460 [id=48e17ec9593b43d2a02157d5efdf14bd] alter complete (version 1)
I20260503 07:53:11.180625 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19534cfc9f3c44c1b3862e0214366054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.180929 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.184358 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb945c6be9d046dbb795551d5b28c653. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.186372 600 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.2:51725 (request call id 200) took 969 ms (client timeout 1000 ms). Trace:
W20260503 07:53:11.186837 600 rpcz_store.cc:269] 0503 07:53:10.216491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.325403 (+108912us) service_pool.cc:224] Handling call
0503 07:53:10.422242 (+ 96839us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:11.135169 (+712927us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.135174 (+ 5us) write_op.cc:454] Released schema lock
0503 07:53:11.186353 (+ 51179us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:11.113808 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:11.113884 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:11.113889 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:11.113891 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:11.113966 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:11.113975 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:11.113978 (+ 3us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:11.114024 (+ 46us) tablet.cc:701] Row locks acquired
0503 07:53:11.114026 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:11.114052 (+ 26us) write_op.cc:270] Start()
0503 07:53:11.114080 (+ 28us) write_op.cc:276] Timestamp: P: 1777794791114015 usec, L: 0
0503 07:53:11.114085 (+ 5us) op_driver.cc:348] REPLICATION: starting
0503 07:53:11.114274 (+ 189us) log.cc:844] Serialized 356 byte log entry
0503 07:53:11.120895 (+ 6621us) op_driver.cc:464] REPLICATION: finished
0503 07:53:11.121044 (+ 149us) write_op.cc:301] APPLY: starting
0503 07:53:11.121059 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:11.121108 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:11.121135 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:11.121200 (+ 65us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:11.121235 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:11.121245 (+ 10us) write_op.cc:312] APPLY: finished
0503 07:53:11.121308 (+ 63us) log.cc:844] Serialized 23 byte log entry
0503 07:53:11.121361 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.121379 (+ 18us) write_op.cc:454] Released schema lock
0503 07:53:11.121386 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:11.121457 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.121464 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:11.129591 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:11.129685 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:11.129689 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:11.129691 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:11.129777 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:11.129788 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:11.129803 (+ 15us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:11.129857 (+ 54us) tablet.cc:701] Row locks acquired
0503 07:53:11.129860 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:11.129897 (+ 37us) write_op.cc:270] Start()
0503 07:53:11.129958 (+ 61us) write_op.cc:276] Timestamp: P: 1777794791129857 usec, L: 0
0503 07:53:11.129962 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:11.130109 (+ 147us) log.cc:844] Serialized 356 byte log entry
0503 07:53:11.133138 (+ 3029us) op_driver.cc:464] REPLICATION: finished
0503 07:53:11.133260 (+ 122us) write_op.cc:301] APPLY: starting
0503 07:53:11.133272 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:11.133307 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:11.133327 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:11.133367 (+ 40us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:11.133391 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:11.133397 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:11.133452 (+ 55us) log.cc:844] Serialized 23 byte log entry
0503 07:53:11.133496 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.133520 (+ 24us) write_op.cc:454] Released schema lock
0503 07:53:11.133525 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":24,"spinlock_wait_cycles":220260736,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":402,"apply.run_wall_time_us":401,"num_ops":1,"prepare.queue_time_us":729,"prepare.run_cpu_time_us":567,"prepare.run_wall_time_us":566,"raft.queue_time_us":372,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":6781}],["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":303,"apply.run_wall_time_us":302,"num_ops":1,"prepare.queue_time_us":2143,"prepare.run_cpu_time_us":611,"prepare.run_wall_time_us":611,"raft.queue_time_us":145,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"replication_time_us":3154}]]}
I20260503 07:53:11.188367 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c615cb123224ceda51d68d5980a2323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.191768 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 63ce3473d6934165a0b0a3df52638c25 (DEFAULT_TABLE table=default.Table_16195c0c53d241ed9b40dce502a92889 [id=7440684f86504900a3299dc66ffb5dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.192044 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ce3473d6934165a0b0a3df52638c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.192653 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a418a0fbd4979b08f3a977a14da1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.192770 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f158b7489240449ce8d64d193cccc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.196362 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c82dbdf98947fca0b8aaa9f47f13db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.197901 1017 tablet_service.cc:1511] Processing CreateTablet for tablet cb9332453c2242d9a83e4a4e6568720b (DEFAULT_TABLE table=default.Table_e181e483c82548999378acd80b172bfd [id=24af8a99e29a450a87b785276c6add62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.199687 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a744819d0d419b9e856ae2176b9ab9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.190541 596 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.3:37895 (request call id 126) took 1136 ms (client timeout 1000 ms). Trace:
W20260503 07:53:11.199800 596 rpcz_store.cc:269] 0503 07:53:10.053981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.127749 (+ 73768us) service_pool.cc:224] Handling call
0503 07:53:10.226797 (+ 99048us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:11.179243 (+952446us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.179248 (+ 5us) write_op.cc:454] Released schema lock
0503 07:53:11.190518 (+ 11270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:10.983537 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:10.983619 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:10.983623 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:10.983625 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:10.983707 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:10.983715 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:10.983719 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:10.983800 (+ 81us) tablet.cc:701] Row locks acquired
0503 07:53:10.983802 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:10.983827 (+ 25us) write_op.cc:270] Start()
0503 07:53:10.983853 (+ 26us) write_op.cc:276] Timestamp: P: 1777794790983804 usec, L: 0
0503 07:53:10.983856 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:10.983987 (+ 131us) log.cc:844] Serialized 901 byte log entry
0503 07:53:11.001542 (+ 17555us) op_driver.cc:464] REPLICATION: finished
0503 07:53:11.002331 (+ 789us) write_op.cc:301] APPLY: starting
0503 07:53:11.002341 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:11.002369 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:11.002390 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:11.002438 (+ 48us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:11.002461 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:11.002467 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:11.002524 (+ 57us) log.cc:844] Serialized 29 byte log entry
0503 07:53:11.002576 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.002588 (+ 12us) write_op.cc:454] Released schema lock
0503 07:53:11.002593 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:11.002650 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.002654 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:11.109534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:11.109653 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:11.109658 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:11.109662 (+ 4us) tablet.cc:662] Decoding operations
0503 07:53:11.109768 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:11.109782 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:11.109789 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:11.109848 (+ 59us) tablet.cc:701] Row locks acquired
0503 07:53:11.109850 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:11.109885 (+ 35us) write_op.cc:270] Start()
0503 07:53:11.109916 (+ 31us) write_op.cc:276] Timestamp: P: 1777794791109845 usec, L: 0
0503 07:53:11.109919 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:11.110089 (+ 170us) log.cc:844] Serialized 356 byte log entry
0503 07:53:11.117160 (+ 7071us) op_driver.cc:464] REPLICATION: finished
0503 07:53:11.117319 (+ 159us) write_op.cc:301] APPLY: starting
0503 07:53:11.117333 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:11.117365 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:11.117391 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:11.117439 (+ 48us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:11.117473 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:11.117483 (+ 10us) write_op.cc:312] APPLY: finished
0503 07:53:11.117543 (+ 60us) log.cc:844] Serialized 23 byte log entry
0503 07:53:11.117593 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.117607 (+ 14us) write_op.cc:454] Released schema lock
0503 07:53:11.117614 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:11.117681 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.117686 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:11.155632 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:11.155729 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:11.155734 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:11.155736 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:11.155808 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:11.155816 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:11.155820 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:11.155864 (+ 44us) tablet.cc:701] Row locks acquired
0503 07:53:11.155867 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:11.155893 (+ 26us) write_op.cc:270] Start()
0503 07:53:11.155929 (+ 36us) write_op.cc:276] Timestamp: P: 1777794791155852 usec, L: 0
0503 07:53:11.155932 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:11.156053 (+ 121us) log.cc:844] Serialized 356 byte log entry
0503 07:53:11.160839 (+ 4786us) op_driver.cc:464] REPLICATION: finished
0503 07:53:11.161365 (+ 526us) write_op.cc:301] APPLY: starting
0503 07:53:11.161373 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:11.161400 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:11.161420 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:11.161452 (+ 32us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:11.161474 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:11.161480 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:11.161543 (+ 63us) log.cc:844] Serialized 23 byte log entry
0503 07:53:11.161572 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:11.161584 (+ 12us) write_op.cc:454] Released schema lock
0503 07:53:11.161588 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":31,"spinlock_wait_cycles":149177088,"child_traces":[["op",{"apply.queue_time_us":760,"apply.run_cpu_time_us":312,"apply.run_wall_time_us":313,"num_ops":2,"prepare.queue_time_us":361264,"prepare.run_cpu_time_us":520,"prepare.run_wall_time_us":593,"raft.queue_time_us":40,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":17672}],["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":352,"apply.run_wall_time_us":351,"num_ops":1,"prepare.queue_time_us":320,"prepare.run_cpu_time_us":662,"prepare.run_wall_time_us":662,"raft.queue_time_us":1522,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":7186}],["op",{"apply.queue_time_us":501,"apply.run_cpu_time_us":256,"apply.run_wall_time_us":256,"mutex_wait_us":25316,"num_ops":1,"prepare.queue_time_us":26081,"prepare.run_cpu_time_us":500,"prepare.run_wall_time_us":500,"raft.queue_time_us":804,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":4895}]]}
I20260503 07:53:11.206665 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_71186bdc93b245dfa138e23897bdba05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.207455 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074b22e01a334acba2e728a8b0ed4324. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.207770 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71186bdc93b245dfa138e23897bdba05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.207217 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9e72e720c3b648e1a5ca3e5765a300a7" } new_table_name: "default.Table_19ff844fff324e2eb41ed86aee937a33" modify_external_catalogs: true
I20260503 07:53:11.212373 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428b63b5dd44bfea1487287965483ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.213660 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.213816 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c615cb123224ceda51d68d5980a2323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.213796 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_366b3b6108d9462c9b51f0c3ef634dbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.214074 1015 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef54bb09984a529815ea974905eb20 (DEFAULT_TABLE table=default.Table_84316b71af09498f9e9a82cde5c24dff [id=aa9aac1d5aa2421eb987fc75301c6ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.214383 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef54bb09984a529815ea974905eb20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.214345 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_366b3b6108d9462c9b51f0c3ef634dbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.215497 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0490dfca116c457eb695c2c2a3df990b" } new_table_name: "default.Table_eb732ccf487c4052974b1c65720243bd" modify_external_catalogs: true
I20260503 07:53:11.216568 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b87484809fe040a2bd35bf2b9a44344d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.216611 2565 raft_consensus.cc:493] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.216769 2565 raft_consensus.cc:515] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:11.216956 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b87484809fe040a2bd35bf2b9a44344d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.217439 2565 leader_election.cc:290] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:11.218060 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:11.218452 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2f95e3ad844bc39593787e38a45bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.224227 2591 raft_consensus.cc:493] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.224336 2591 raft_consensus.cc:515] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:11.224647 715 leader_election.cc:343] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.224983 2591 leader_election.cc:290] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:11.225183 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.225337 1050 raft_consensus.cc:2468] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:11.225695 716 leader_election.cc:304] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:11.226146 2565 raft_consensus.cc:2804] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:11.226212 2565 raft_consensus.cc:493] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:11.226270 2565 raft_consensus.cc:3060] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.228605 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.229521 2565 raft_consensus.cc:515] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:11.229847 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e36b8bb09d5849cea5ba5b67155b590a consensus state has no leader
I20260503 07:53:11.231662 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:11.231788 1050 raft_consensus.cc:3060] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.234148 1050 raft_consensus.cc:2468] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:11.234535 716 leader_election.cc:304] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:11.234777 2457 raft_consensus.cc:2804] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:11.238447 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b1450c6bc197438fb8f26418c1aae4a5
I20260503 07:53:11.240911 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae4a39d4e3a42db816e592123a6a2e7" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:11.241441 715 leader_election.cc:343] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.241914 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 12b781cbe6df4bbebb788054c9672211 (DEFAULT_TABLE table=default.Table_2be3105c43184a0a8ce206bd0e75f4b8 [id=f892bd80b6ca401a9d21f6efd5bd039f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.242688 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a205b6c56074344ad05df617ea267fd consensus state has no leader
I20260503 07:53:11.244885 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 888) took 3310 ms. Trace:
I20260503 07:53:11.244979 1173 rpcz_store.cc:276] 0503 07:53:07.933940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.933989 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:11.036379 (+3102390us) ts_tablet_manager.cc:1151] Deleting tablet 766799446d1a480ca04246b0aec14852
0503 07:53:11.036386 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.040066 (+ 3680us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.131854 (+ 91788us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.244868 (+113014us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3102218}
I20260503 07:53:11.245440 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 889) took 3298 ms. Trace:
I20260503 07:53:11.245514 1173 rpcz_store.cc:276] 0503 07:53:07.946498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.946543 (+ 45us) service_pool.cc:224] Handling call
0503 07:53:11.245336 (+3298793us) ts_tablet_manager.cc:1151] Deleting tablet 5f7d50c1575341bca6673a3cd887415e
0503 07:53:11.245345 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.245427 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3298651}
I20260503 07:53:11.245738 1173 tablet_replica.cc:333] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:11.245679 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_77e114a37f6a4981b4a113bb290dcfdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.245908 1173 raft_consensus.cc:2243] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.246059 1173 raft_consensus.cc:2272] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:11.246385 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77e114a37f6a4981b4a113bb290dcfdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.246508 1173 ts_tablet_manager.cc:1916] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.247967 913 raft_consensus.cc:2468] T c2f31cff599248dd994a7bcee38ef2ab P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:11.234783 2565 leader_election.cc:290] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:11.250839 597 master_service.cc:954] ReplaceTablet: received request to replace tablet 8c0bcb9ab72a482ca07447ff392ae49d from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:11.253948 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 766799446d1a480ca04246b0aec14852 (table default.Table_07d524476f694b8ea7ce95c0fc005807 [id=c9513d6e491a4250894ed7225db630fe]) successfully deleted
W20260503 07:53:11.254379 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 5f7d50c1575341bca6673a3cd887415e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7d50c1575341bca6673a3cd887415e already in progress: creating tablet
I20260503 07:53:11.270102 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8c0bcb9ab72a482ca07447ff392ae49d
I20260503 07:53:11.270812 597 catalog_manager.cc:6741] ReplaceTablet: tablet 8c0bcb9ab72a482ca07447ff392ae49d deleted and replaced by tablet 0708cababc844e51ab7da2950664c2c5
I20260503 07:53:11.274657 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e306b43052074e12b84b9ee8974a1001" } new_table_name: "default.Table_9888f490b51b4a5c9879ad6c22edcf6f" modify_external_catalogs: true
I20260503 07:53:11.274863 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_02afbc612ef24400bc2f6df2dee7d796"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.275326 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02afbc612ef24400bc2f6df2dee7d796 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:11.276971 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e36b8bb09d5849cea5ba5b67155b590a (table default.Table_eb732ccf487c4052974b1c65720243bd [id=b7439d8936be452d809bdac4fbb6e60d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e36b8bb09d5849cea5ba5b67155b590a consensus state has no leader
I20260503 07:53:11.244251 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.261595 1016 tablet_service.cc:1511] Processing CreateTablet for tablet a24c32e6800245d5bc9d15550b391a87 (DEFAULT_TABLE table=default.Table_a6359260f55a47dfb599fa173a09f0d0 [id=4e38ce667e8f49919ae030e3b9603ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.263506 1021 tablet_service.cc:1511] Processing CreateTablet for tablet f161b32232b7449493fa616794ad07a5 (DEFAULT_TABLE table=default.Table_4f747befb8f140abb67a16b1cbd92762 [id=0b7022caa0f1418ea7742784e6081991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.265091 1024 tablet_service.cc:1511] Processing CreateTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.266935 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 001ded76f1894772898cb660e501984d (DEFAULT_TABLE table=default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256 [id=2b1c73ba2338402da8b009d3b6703fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.268476 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a (DEFAULT_TABLE table=default.Table_eca1c70488b24800b87da036697e2137 [id=cb76c8113f72465f96389589683f7559]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.284507 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8e7f2b756584f329c965e01a3205283 consensus state has no leader
I20260503 07:53:11.270345 1027 tablet_service.cc:1511] Processing CreateTablet for tablet db375404b0a34b6b9310b61182a40e79 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.271528 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5c63f7e6b56a478dab28ce7bcaee545d (DEFAULT_TABLE table=default.Table_cee9ef7a6b20439db5b24767d3b857c1 [id=ae80c053e7974433a619a371f5d3399f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.276547 2577 raft_consensus.cc:493] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.280642 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3c11929da15442d8a1dfad0e11d37a76 (DEFAULT_TABLE table=default.Table_e009ce0a5d9049d1b5f056b835c6f25a [id=7cf5ed2776ca4ce78d3b618643cb7b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.281147 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 91ca948a56a74f958d029dce8fa5762b (DEFAULT_TABLE table=default.Table_39ab2778dd8b40f199440137c1897c4e [id=1991fee9160546c582a9330903e88445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.281507 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f (DEFAULT_TABLE table=default.Table_cffd6579b5f4480c83276fca296d5483 [id=35ce68478bb042b0bf019203c481a6d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.281895 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9332453c2242d9a83e4a4e6568720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.287482 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cffd6579b5f4480c83276fca296d5483" } modify_external_catalogs: true
I20260503 07:53:11.287623 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cffd6579b5f4480c83276fca296d5483" } modify_external_catalogs: true
I20260503 07:53:11.287984 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a0c51bdaabce48edbfa6d0abb9d1b5fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.288611 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0c51bdaabce48edbfa6d0abb9d1b5fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.291118 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad4408db9eb47c9bb925fb66b7d8b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.292563 2646 raft_consensus.cc:493] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.292667 2646 raft_consensus.cc:515] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.293188 2646 leader_election.cc:290] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.295603 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd105ef7a3474fa546b4945ddc875a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.299561 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f161b32232b7449493fa616794ad07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.303467 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ded76f1894772898cb660e501984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.281999 1025 tablet_service.cc:1511] Processing CreateTablet for tablet def68d0327734e68897c930716f1ff59 (DEFAULT_TABLE table=default.Table_a4640dd37e014f91860a4a0647350191 [id=2fe773abf59949cd8113e7a37b31ffba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.307178 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def68d0327734e68897c930716f1ff59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.315461 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ff21c53589e04efb99fd2b4a6f2eef16 (DEFAULT_TABLE table=default.Table_8d9a6df25a9a4a289f66f8ffcbfe546a [id=4942b898128146e5bbeaf50d317f4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.316725 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6201cd5a177e4929bc6eb8d8ce93a292" } modify_external_catalogs: true
I20260503 07:53:11.316993 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6201cd5a177e4929bc6eb8d8ce93a292" } modify_external_catalogs: true
I20260503 07:53:11.318004 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_18888b48c9214c79bdf84dbfe9a168de" } modify_external_catalogs: true
I20260503 07:53:11.318173 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_18888b48c9214c79bdf84dbfe9a168de" } modify_external_catalogs: true
I20260503 07:53:11.318676 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a1a0cf081834482a41254eb49003a57" } modify_external_catalogs: true
I20260503 07:53:11.318802 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9a1a0cf081834482a41254eb49003a57" } modify_external_catalogs: true
I20260503 07:53:11.320820 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fb8eef4fe222404da1bcd56830523881"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.320960 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e50e303a9124c588bb671f5ca64a04c" } new_table_name: "default.Table_f03a50c52b4b4c519d9b157e2d8409dd" modify_external_catalogs: true
W20260503 07:53:11.321483 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb8eef4fe222404da1bcd56830523881 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.322706 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7c59ab3fec2f4ed787f9260a16901b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.322662 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_89444261c7144001b844a9846d28eadf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.323109 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c59ab3fec2f4ed787f9260a16901b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:11.323167 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89444261c7144001b844a9846d28eadf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.324082 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f3b781f9a01a481aa77e60f9a1d8167b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.324152 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ba4ac916a85e49c793f64e171c13382a" } new_table_name: "default.Table_c0213e23de34463b83e939e084f1877f" modify_external_catalogs: true
W20260503 07:53:11.324471 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3b781f9a01a481aa77e60f9a1d8167b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:11.336615 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81b3a0c30b274a2e9a411b9b835f04a2 consensus state has no leader
I20260503 07:53:11.220082 886 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2f95e3ad844bc39593787e38a45bad (DEFAULT_TABLE table=default.Table_2bc82c1725174620b6c53f604e2e9583 [id=9f95d060661c4750bc3ba3f9e4d82aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.353018 881 tablet_service.cc:1511] Processing CreateTablet for tablet 63ce3473d6934165a0b0a3df52638c25 (DEFAULT_TABLE table=default.Table_16195c0c53d241ed9b40dce502a92889 [id=7440684f86504900a3299dc66ffb5dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.366302 2457 raft_consensus.cc:697] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:11.283011 1014 tablet_service.cc:1511] Processing CreateTablet for tablet dab8cc17114146628682a0a8432596d2 (DEFAULT_TABLE table=default.Table_2c686fe8f22a4e96854cc93365235b14 [id=06d131b5e28e461c85524949848df035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.286351 2577 raft_consensus.cc:515] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.367357 2577 leader_election.cc:290] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:11.367087 2457 consensus_queue.cc:237] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.315830 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a44b834b1e44a99c2cd3f9747ca13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.282908 1171 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:11.321349 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 59a311dc5ec244fab0cdd8e5c1d58cee (DEFAULT_TABLE table=default.Table_bacfe879a66646fb88d9daa8623de480 [id=eedb402be60449c3bf606448c6bb7359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.373347 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a311dc5ec244fab0cdd8e5c1d58cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.373994 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab8cc17114146628682a0a8432596d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.376277 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c11929da15442d8a1dfad0e11d37a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.322225 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 78f66be8ef69497898412bdddb824899 (DEFAULT_TABLE table=default.Table_6775d8d897cf4e0bb4f30977e8d640de [id=560e4d32bcaa4f119a49cfd88c46e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.377316 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f66be8ef69497898412bdddb824899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.382218 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3277c39b93c44c1cb91564a7530e3c07 (DEFAULT_TABLE table=default.Table_08e346119e8646e4bc01a72cc216b6ed [id=f4d81c03d40b4d8284f38a407e8da53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.354395 896 tablet_service.cc:1511] Processing CreateTablet for tablet cb9332453c2242d9a83e4a4e6568720b (DEFAULT_TABLE table=default.Table_e181e483c82548999378acd80b172bfd [id=24af8a99e29a450a87b785276c6add62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.354753 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.389430 897 tablet_service.cc:1511] Processing CreateTablet for tablet ff21c53589e04efb99fd2b4a6f2eef16 (DEFAULT_TABLE table=default.Table_8d9a6df25a9a4a289f66f8ffcbfe546a [id=4942b898128146e5bbeaf50d317f4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.354998 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c615cb123224ceda51d68d5980a2323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.355185 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:11.390432 887 tablet_service.cc:1511] Processing CreateTablet for tablet 59a311dc5ec244fab0cdd8e5c1d58cee (DEFAULT_TABLE table=default.Table_bacfe879a66646fb88d9daa8623de480 [id=eedb402be60449c3bf606448c6bb7359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.355340 885 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef54bb09984a529815ea974905eb20 (DEFAULT_TABLE table=default.Table_84316b71af09498f9e9a82cde5c24dff [id=aa9aac1d5aa2421eb987fc75301c6ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.355737 883 tablet_service.cc:1511] Processing CreateTablet for tablet dab8cc17114146628682a0a8432596d2 (DEFAULT_TABLE table=default.Table_2c686fe8f22a4e96854cc93365235b14 [id=06d131b5e28e461c85524949848df035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.356130 889 tablet_service.cc:1511] Processing CreateTablet for tablet 12b781cbe6df4bbebb788054c9672211 (DEFAULT_TABLE table=default.Table_2be3105c43184a0a8ce206bd0e75f4b8 [id=f892bd80b6ca401a9d21f6efd5bd039f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.356544 880 tablet_service.cc:1511] Processing CreateTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.358700 892 tablet_service.cc:1511] Processing CreateTablet for tablet def68d0327734e68897c930716f1ff59 (DEFAULT_TABLE table=default.Table_a4640dd37e014f91860a4a0647350191 [id=2fe773abf59949cd8113e7a37b31ffba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.359086 879 tablet_service.cc:1511] Processing CreateTablet for tablet a24c32e6800245d5bc9d15550b391a87 (DEFAULT_TABLE table=default.Table_a6359260f55a47dfb599fa173a09f0d0 [id=4e38ce667e8f49919ae030e3b9603ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.359454 895 tablet_service.cc:1511] Processing CreateTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f (DEFAULT_TABLE table=default.Table_cffd6579b5f4480c83276fca296d5483 [id=35ce68478bb042b0bf019203c481a6d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.359794 882 tablet_service.cc:1511] Processing CreateTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.360329 894 tablet_service.cc:1511] Processing CreateTablet for tablet f161b32232b7449493fa616794ad07a5 (DEFAULT_TABLE table=default.Table_4f747befb8f140abb67a16b1cbd92762 [id=0b7022caa0f1418ea7742784e6081991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.360736 890 tablet_service.cc:1511] Processing CreateTablet for tablet 001ded76f1894772898cb660e501984d (DEFAULT_TABLE table=default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256 [id=2b1c73ba2338402da8b009d3b6703fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.361155 888 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a (DEFAULT_TABLE table=default.Table_eca1c70488b24800b87da036697e2137 [id=cb76c8113f72465f96389589683f7559]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.361605 898 tablet_service.cc:1511] Processing CreateTablet for tablet db375404b0a34b6b9310b61182a40e79 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.362015 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5c63f7e6b56a478dab28ce7bcaee545d (DEFAULT_TABLE table=default.Table_cee9ef7a6b20439db5b24767d3b857c1 [id=ae80c053e7974433a619a371f5d3399f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.362396 891 tablet_service.cc:1511] Processing CreateTablet for tablet 3c11929da15442d8a1dfad0e11d37a76 (DEFAULT_TABLE table=default.Table_e009ce0a5d9049d1b5f056b835c6f25a [id=7cf5ed2776ca4ce78d3b618643cb7b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.363211 884 tablet_service.cc:1511] Processing CreateTablet for tablet 91ca948a56a74f958d029dce8fa5762b (DEFAULT_TABLE table=default.Table_39ab2778dd8b40f199440137c1897c4e [id=1991fee9160546c582a9330903e88445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.363503 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2f95e3ad844bc39593787e38a45bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.383818 2591 raft_consensus.cc:493] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.407188 2591 raft_consensus.cc:515] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.407845 2591 leader_election.cc:290] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.414649 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9332453c2242d9a83e4a4e6568720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.420737 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd105ef7a3474fa546b4945ddc875a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.423621 1173 ts_tablet_manager.cc:1929] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:11.425411 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c11929da15442d8a1dfad0e11d37a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.427342 2565 raft_consensus.cc:493] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.427547 2565 raft_consensus.cc:515] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.429005 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:11.429574 715 leader_election.cc:343] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.429714 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef54bb09984a529815ea974905eb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.432379 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b781cbe6df4bbebb788054c9672211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.431481 1173 log.cc:1199] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/7eb362fee7bc4f948d3a5b660e9cbd1a
I20260503 07:53:11.335777 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 01c7925b82934b59839a0e8ddf99356d (DEFAULT_TABLE table=default.Table_6201cd5a177e4929bc6eb8d8ce93a292 [id=065415bedc6a4d529e0672fb7521a523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.336366 2431 consensus_queue.cc:1048] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:11.351269 1019 tablet_service.cc:1511] Processing CreateTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 (DEFAULT_TABLE table=default.Table_0319d0a5b2814beebb4b59f9c664b588 [id=292fae8d3418434d99f9343561191233]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.358356 988 consensus_peers.cc:597] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 766799446d1a480ca04246b0aec14852. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:11.434935 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 76607.2us
I20260503 07:53:11.434978 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_db6ceb7013de4160aa0d9c608e618791" } new_table_name: "default.Table_14a08dabe9314680b800b584272ace6b" modify_external_catalogs: true
I20260503 07:53:11.436525 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab8cc17114146628682a0a8432596d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.437680 988 leader_election.cc:343] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.382462 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db375404b0a34b6b9310b61182a40e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.440374 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c63f7e6b56a478dab28ce7bcaee545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.441565 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9bbe84e829814d7fb2d44abbb8fa0a5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.442067 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bbe84e829814d7fb2d44abbb8fa0a5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.443723 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.443864 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.444293 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def68d0327734e68897c930716f1ff59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.444269 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c36456e61be8471387364109939d3dcc" } modify_external_catalogs: true
I20260503 07:53:11.444437 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c36456e61be8471387364109939d3dcc" } modify_external_catalogs: true
I20260503 07:53:11.445147 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7263a5d258e4f8ab413a1619ac611f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.446341 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_977ac44bf2c24650b0c8460ae9d17673" } new_table_name: "default.Table_6b617fae793d4722abdd6533f21f43f6" modify_external_catalogs: true
I20260503 07:53:11.447477 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_747481a5826140bca2e4ed9b148c96bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.447916 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_747481a5826140bca2e4ed9b148c96bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.448261 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24c32e6800245d5bc9d15550b391a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.449983 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f161b32232b7449493fa616794ad07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.451479 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_13da6ea9ff3f422d9a7234c57ba92764"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.451833 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13da6ea9ff3f422d9a7234c57ba92764 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.452257 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c63f7e6b56a478dab28ce7bcaee545d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.453266 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a845e02bdb54952806f90d3f7cd9fb2 consensus state has no leader
I20260503 07:53:11.453832 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad4408db9eb47c9bb925fb66b7d8b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.456270 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ded76f1894772898cb660e501984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.456290 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b781cbe6df4bbebb788054c9672211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.461297 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ca948a56a74f958d029dce8fa5762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.463204 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24c32e6800245d5bc9d15550b391a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.466742 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21c53589e04efb99fd2b4a6f2eef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.467876 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1450c6bc197438fb8f26418c1aae4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.471597 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a44b834b1e44a99c2cd3f9747ca13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.471964 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c7925b82934b59839a0e8ddf99356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.393419 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 6f743fe004124fc5994b9208c78632c1 (DEFAULT_TABLE table=default.Table_d59831d36779464b849511b4d3640641 [id=a7af1ccf67264aba868d3ae91aab559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.401316 1171 tablet_bootstrap.cc:654] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:11.476406 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cda1c9b4239240029bac8ee192ef5cfb consensus state has no leader
I20260503 07:53:11.477063 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a311dc5ec244fab0cdd8e5c1d58cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.479393 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f743fe004124fc5994b9208c78632c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.480293 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7263a5d258e4f8ab413a1619ac611f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.409206 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.483023 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeae993f8894649ac780f266b3b4968 (DEFAULT_TABLE table=default.Table_51d7f64d591047159048f9395ddbf407 [id=ba26e448f9fc4afda401a8faeb01f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.483305 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeae993f8894649ac780f266b3b4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.412729 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.485997 1029 tablet_service.cc:1511] Processing CreateTablet for tablet bd9c20e9065e401881180f6057ce0eb6 (DEFAULT_TABLE table=default.Table_28f22c3e03ec4fd398b5ca4a0944c93a [id=b04a2909de684220b1121265b7c26833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.413825 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.386361 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.487375 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 (DEFAULT_TABLE table=default.Table_00a265bded494e629c023c1199bdb23a [id=cf6452c2f69d47a6a2726270340ea5d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.487571 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db375404b0a34b6b9310b61182a40e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.421609 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.487901 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 2a205b6c56074344ad05df617ea267fd (DEFAULT_TABLE table=default.Table_9e72e720c3b648e1a5ca3e5765a300a7 [id=b946b1b6f9b7487cbf06a6b73a68b075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.490229 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_41739ba8d4404bafad498d6d58f810ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.490696 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41739ba8d4404bafad498d6d58f810ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.491055 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ca948a56a74f958d029dce8fa5762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.486428 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21c53589e04efb99fd2b4a6f2eef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.491731 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4d98077554f141b28214686f206b90b2" } new_table_name: "default.Table_ac27960842d14252b2564f0260833c65" modify_external_catalogs: true
I20260503 07:53:11.493618 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f239e33bc42beb9dad004d5b20c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.494967 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9c20e9065e401881180f6057ce0eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.496343 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:11.498307 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ce3473d6934165a0b0a3df52638c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.498361 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_656557c8d0024422951e151adceb7c32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.498804 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_656557c8d0024422951e151adceb7c32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.504756 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2cd812f25c7a4451a75b9bffc7add74b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.505192 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cd812f25c7a4451a75b9bffc7add74b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.513646 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a205b6c56074344ad05df617ea267fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.514199 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3b10183f49464684acfa54e7d10ccee2
I20260503 07:53:11.514890 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 01c7925b82934b59839a0e8ddf99356d
I20260503 07:53:11.515717 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 23b8c1768a15487ba9140acd77c4ff7b
I20260503 07:53:11.331729 1175 ts_tablet_manager.cc:1929] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:11.516901 1175 log.cc:1199] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/3be0ae78ada34cd88debca569b77d24a
I20260503 07:53:11.517377 1175 ts_tablet_manager.cc:1950] T 3be0ae78ada34cd88debca569b77d24a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:11.517822 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 962) took 3941 ms. Trace:
I20260503 07:53:11.517997 1175 rpcz_store.cc:276] 0503 07:53:07.576289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.576340 (+ 51us) service_pool.cc:224] Handling call
0503 07:53:10.937825 (+3361485us) ts_tablet_manager.cc:1151] Deleting tablet 3be0ae78ada34cd88debca569b77d24a
0503 07:53:10.937836 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.131144 (+193308us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.331676 (+200532us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.517802 (+186126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3361306}
I20260503 07:53:11.518677 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 967) took 3817 ms. Trace:
I20260503 07:53:11.518827 1175 rpcz_store.cc:276] 0503 07:53:07.701690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.701738 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:11.518533 (+3816795us) ts_tablet_manager.cc:1151] Deleting tablet 6b18c4ecb2ca453ea69772cd68244394
0503 07:53:11.518546 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.518659 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3790020}
I20260503 07:53:11.519471 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 968) took 3799 ms. Trace:
I20260503 07:53:11.519604 1175 rpcz_store.cc:276] 0503 07:53:07.720011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.720240 (+ 229us) service_pool.cc:224] Handling call
0503 07:53:11.519350 (+3799110us) ts_tablet_manager.cc:1151] Deleting tablet 7986115ad5ff47cf991009f545f0243e
0503 07:53:11.519361 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.519455 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3790589}
I20260503 07:53:11.520212 1175 tablet_replica.cc:333] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:11.520517 1175 raft_consensus.cc:2243] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:11.520802 1175 pending_rounds.cc:70] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:11.521126 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]) successfully deleted
W20260503 07:53:11.521358 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6b18c4ecb2ca453ea69772cd68244394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b18c4ecb2ca453ea69772cd68244394 already in progress: creating tablet
W20260503 07:53:11.521559 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7986115ad5ff47cf991009f545f0243e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7986115ad5ff47cf991009f545f0243e already in progress: creating tablet
I20260503 07:53:11.526166 2565 leader_election.cc:290] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:11.526670 714 service_pool.cc:136] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items
I20260503 07:53:11.526773 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.528371 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.529543 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.531109 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.532655 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 63a44b834b1e44a99c2cd3f9747ca13f
I20260503 07:53:11.533313 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5c23434f3d8f44e581c2ed73aa045d96
I20260503 07:53:11.532366 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
W20260503 07:53:11.534363 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94ed1a600ee44c1a9f6e292567e85f92 consensus state has no leader
I20260503 07:53:11.533681 714 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.534965 714 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.539306 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffec630db9a430fa3006268b0e28fcd" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:11.539521 771 raft_consensus.cc:2393] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:53:11.540041 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961d0f8f6daa4f359c15743ee42b9a87" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:11.541321 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:11.541543 768 raft_consensus.cc:2468] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:11.542663 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:11.542855 765 raft_consensus.cc:2468] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:11.543181 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773fca453dac452abc723e49b70111b9" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:11.543435 764 raft_consensus.cc:2393] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48acfab19cf04a069d5166d663adb3c3 in current term 1: Already voted for candidate 0c11eb9ffa7845269a6a8000e8ff248f in this term.
I20260503 07:53:11.545102 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428b63b5dd44bfea1487287965483ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.554512 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2f95e3ad844bc39593787e38a45bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.554908 1165 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:11.556335 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 851) took 5338 ms. Trace:
I20260503 07:53:11.565405 1174 rpcz_store.cc:276] 0503 07:53:06.217407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.217448 (+ 41us) service_pool.cc:224] Handling call
0503 07:53:11.045938 (+4828490us) ts_tablet_manager.cc:1151] Deleting tablet 5c30f15ad13340c89df3f5c8d65d63c7
0503 07:53:11.045946 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.103722 (+ 57776us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.126937 (+ 23215us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.556324 (+429387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18,"tablet-delete.queue_time_us":4828300}
I20260503 07:53:11.565938 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 857) took 5219 ms. Trace:
I20260503 07:53:11.566103 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c82dbdf98947fca0b8aaa9f47f13db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.566282 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19534cfc9f3c44c1b3862e0214366054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.568225 1165 tablet_bootstrap.cc:654] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.572068 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a744819d0d419b9e856ae2176b9ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.572417 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc80e46ce94ce8bf4f2cb9962a5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.578258 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e874f8c0f52040ffb9f211b27da50907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.579057 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c615cb123224ceda51d68d5980a2323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.580304 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.584354 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb945c6be9d046dbb795551d5b28c653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.585808 1165 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:11.585943 1165 ts_tablet_manager.cc:1403] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.004s
I20260503 07:53:11.586762 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de67550dbe0435cace68bf31911e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.588313 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ca011a011a44ad9447f2d5b19a63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.588477 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074b22e01a334acba2e728a8b0ed4324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.588732 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f158b7489240449ce8d64d193cccc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.592254 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a418a0fbd4979b08f3a977a14da1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.566030 1174 rpcz_store.cc:276] 0503 07:53:06.346523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.346704 (+ 181us) service_pool.cc:224] Handling call
0503 07:53:11.565789 (+5219085us) ts_tablet_manager.cc:1151] Deleting tablet 46dd100e06ff41be960b265b52d1c607
0503 07:53:11.565803 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.565918 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5218901}
I20260503 07:53:11.592645 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 855) took 5248 ms. Trace:
I20260503 07:53:11.592710 1174 rpcz_store.cc:276] 0503 07:53:06.344437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.388340 (+ 43903us) service_pool.cc:224] Handling call
0503 07:53:11.592519 (+5204179us) ts_tablet_manager.cc:1151] Deleting tablet f53a37806e414f16aa69294c0abad10a
0503 07:53:11.592530 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.592628 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5203696}
I20260503 07:53:11.592996 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 861) took 5161 ms. Trace:
I20260503 07:53:11.593063 1174 rpcz_store.cc:276] 0503 07:53:06.431322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.431373 (+ 51us) service_pool.cc:224] Handling call
0503 07:53:11.592899 (+5161526us) ts_tablet_manager.cc:1151] Deleting tablet 9c04763bb23b4c0f91df21eb0073095f
0503 07:53:11.592907 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.592983 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5161223}
I20260503 07:53:11.593272 1174 tablet_replica.cc:333] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:11.593433 1174 raft_consensus.cc:2243] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.610157 1173 ts_tablet_manager.cc:1950] T 7eb362fee7bc4f948d3a5b660e9cbd1a P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:11.610666 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 891) took 3486 ms. Trace:
I20260503 07:53:11.610814 1173 rpcz_store.cc:276] 0503 07:53:08.124385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.124434 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:11.245681 (+3121247us) ts_tablet_manager.cc:1151] Deleting tablet 7eb362fee7bc4f948d3a5b660e9cbd1a
0503 07:53:11.245687 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.254099 (+ 8412us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.423529 (+169430us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.610643 (+187114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3121011}
I20260503 07:53:11.611269 1173 tablet_replica.cc:333] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:11.611477 1173 raft_consensus.cc:2243] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.611670 1173 raft_consensus.cc:2272] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.612257 1173 ts_tablet_manager.cc:1916] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.615510 918 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.620960 851 leader_election.cc:304] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:11.621224 2591 raft_consensus.cc:3060] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.623719 2591 raft_consensus.cc:2749] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:11.624572 851 leader_election.cc:304] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:11.625176 851 leader_election.cc:304] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:11.625408 2386 raft_consensus.cc:3060] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.627686 2386 raft_consensus.cc:2749] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:11.629904 851 service_pool.cc:136] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items
I20260503 07:53:11.629971 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1046)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1047)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1048)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1049)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1050)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1051)
I20260503 07:53:11.632189 1165 raft_consensus.cc:359] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.632396 1165 raft_consensus.cc:385] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.632452 1165 raft_consensus.cc:740] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.632681 1165 consensus_queue.cc:260] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.633059 2687 raft_consensus.cc:493] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.633203 1165 ts_tablet_manager.cc:1434] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260503 07:53:11.633162 2687 raft_consensus.cc:515] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.633502 1165 tablet_bootstrap.cc:492] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:11.633878 2687 leader_election.cc:290] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:11.633155 2565 raft_consensus.cc:493] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.634580 2565 raft_consensus.cc:515] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.635327 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:11.635376 1165 tablet_bootstrap.cc:654] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.635468 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:11.635844 715 leader_election.cc:343] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:11.636016 715 leader_election.cc:343] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.635378 2565 leader_election.cc:290] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:11.636466 1174 raft_consensus.cc:2272] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.637010 1174 ts_tablet_manager.cc:1916] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.637117 2386 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.637220 2386 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.637743 2386 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.645102 1174 ts_tablet_manager.cc:1929] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:11.646535 882 tablet_service.cc:1511] Processing CreateTablet for tablet 78f66be8ef69497898412bdddb824899 (DEFAULT_TABLE table=default.Table_6775d8d897cf4e0bb4f30977e8d640de [id=560e4d32bcaa4f119a49cfd88c46e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.646643 1174 log.cc:1199] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/36b6147bab7a44b19b4a22addf68961f
I20260503 07:53:11.646951 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f66be8ef69497898412bdddb824899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.647449 1174 ts_tablet_manager.cc:1950] T 36b6147bab7a44b19b4a22addf68961f P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:11.648676 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 864) took 5206 ms. Trace:
I20260503 07:53:11.649540 1174 rpcz_store.cc:276] 0503 07:53:06.441791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.446335 (+ 4544us) service_pool.cc:224] Handling call
0503 07:53:11.593237 (+5146902us) ts_tablet_manager.cc:1151] Deleting tablet 36b6147bab7a44b19b4a22addf68961f
0503 07:53:11.593244 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.640991 (+ 47747us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.645057 (+ 4066us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.648657 (+ 3600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42820,"tablet-delete.queue_time_us":5144580}
I20260503 07:53:11.650575 1174 tablet_replica.cc:333] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:11.651337 1174 raft_consensus.cc:2243] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.651788 887 tablet_service.cc:1511] Processing CreateTablet for tablet 01c7925b82934b59839a0e8ddf99356d (DEFAULT_TABLE table=default.Table_6201cd5a177e4929bc6eb8d8ce93a292 [id=065415bedc6a4d529e0672fb7521a523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.652118 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c7925b82934b59839a0e8ddf99356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.652371 1174 raft_consensus.cc:2272] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.653442 1174 ts_tablet_manager.cc:1916] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.655483 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6f743fe004124fc5994b9208c78632c1 (DEFAULT_TABLE table=default.Table_d59831d36779464b849511b4d3640641 [id=a7af1ccf67264aba868d3ae91aab559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.655777 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f743fe004124fc5994b9208c78632c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.660336 1165 tablet_bootstrap.cc:492] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:11.660020 898 tablet_service.cc:1511] Processing CreateTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 (DEFAULT_TABLE table=default.Table_0319d0a5b2814beebb4b59f9c664b588 [id=292fae8d3418434d99f9343561191233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.660588 1165 ts_tablet_manager.cc:1403] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.007s
I20260503 07:53:11.661211 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1450c6bc197438fb8f26418c1aae4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.661615 1165 raft_consensus.cc:359] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.661870 1165 raft_consensus.cc:385] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.661971 1165 raft_consensus.cc:740] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.662619 1165 consensus_queue.cc:260] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:11.663314 1165 ts_tablet_manager.cc:1434] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:11.663686 1165 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:11.665483 2615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s user 0.000s sys 0.010s
W20260503 07:53:11.665593 2615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s user 0.000s sys 0.010s
I20260503 07:53:11.665663 1165 tablet_bootstrap.cc:654] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.669710 886 tablet_service.cc:1558] Processing DeleteTablet for tablet a117f416c611418a96963db600da1d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.669896 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 057b62a991b74c859045a74df7dc716f with delete_type TABLET_DATA_DELETED (replaced by tablet 6840aeb0532c43738cb868a0fc48f70c) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.670305 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be0ae78ada34cd88debca569b77d24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.670590 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 376e9889ca584931ac1d91a9af2c0689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.670856 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 296541e4c2fc4bc193d6f4cee8e65da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.671027 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce16dd96cf04ae293601108381a2a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.671141 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 61316b7a521e42a59bf955179b080f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.671243 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5deea77f36d540bb8f721657b7e3500e with delete_type TABLET_DATA_DELETED (replaced by tablet ae3fcb4d83f64f6182a78a1a02da39d6) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.671339 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.671588 886 tablet_service.cc:1511] Processing CreateTablet for tablet 3277c39b93c44c1cb91564a7530e3c07 (DEFAULT_TABLE table=default.Table_08e346119e8646e4bc01a72cc216b6ed [id=f4d81c03d40b4d8284f38a407e8da53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.671883 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3277c39b93c44c1cb91564a7530e3c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.674796 894 tablet_service.cc:1511] Processing CreateTablet for tablet d9d53943f50d49cea9828273369235f1 (DEFAULT_TABLE table=default.Table_89197de9e3944b4ebeb6768405dc969d [id=c3aab1ea79bd41f28e5fa876d95f21c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.675101 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d53943f50d49cea9828273369235f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.678375 2591 raft_consensus.cc:2749] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:11.680054 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeae993f8894649ac780f266b3b4968 (DEFAULT_TABLE table=default.Table_51d7f64d591047159048f9395ddbf407 [id=ba26e448f9fc4afda401a8faeb01f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.681267 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeae993f8894649ac780f266b3b4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.683938 883 tablet_service.cc:1511] Processing CreateTablet for tablet bd9c20e9065e401881180f6057ce0eb6 (DEFAULT_TABLE table=default.Table_28f22c3e03ec4fd398b5ca4a0944c93a [id=b04a2909de684220b1121265b7c26833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.684373 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9c20e9065e401881180f6057ce0eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.684542 2457 consensus_queue.cc:1048] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:11.689604 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 (DEFAULT_TABLE table=default.Table_00a265bded494e629c023c1199bdb23a [id=cf6452c2f69d47a6a2726270340ea5d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.689972 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f239e33bc42beb9dad004d5b20c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.693187 751 tablet_service.cc:1511] Processing CreateTablet for tablet 63ce3473d6934165a0b0a3df52638c25 (DEFAULT_TABLE table=default.Table_16195c0c53d241ed9b40dce502a92889 [id=7440684f86504900a3299dc66ffb5dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.693616 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ce3473d6934165a0b0a3df52638c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.695164 743 tablet_service.cc:1511] Processing CreateTablet for tablet cb9332453c2242d9a83e4a4e6568720b (DEFAULT_TABLE table=default.Table_e181e483c82548999378acd80b172bfd [id=24af8a99e29a450a87b785276c6add62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.695464 1174 ts_tablet_manager.cc:1929] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:11.695488 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9332453c2242d9a83e4a4e6568720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.699859 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ca011a011a44ad9447f2d5b19a63ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.700100 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c615cb123224ceda51d68d5980a2323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.700466 758 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef54bb09984a529815ea974905eb20 (DEFAULT_TABLE table=default.Table_84316b71af09498f9e9a82cde5c24dff [id=aa9aac1d5aa2421eb987fc75301c6ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.700811 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef54bb09984a529815ea974905eb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.702380 750 tablet_service.cc:1511] Processing CreateTablet for tablet dab8cc17114146628682a0a8432596d2 (DEFAULT_TABLE table=default.Table_2c686fe8f22a4e96854cc93365235b14 [id=06d131b5e28e461c85524949848df035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.702747 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab8cc17114146628682a0a8432596d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.702853 746 tablet_service.cc:1511] Processing CreateTablet for tablet 12b781cbe6df4bbebb788054c9672211 (DEFAULT_TABLE table=default.Table_2be3105c43184a0a8ce206bd0e75f4b8 [id=f892bd80b6ca401a9d21f6efd5bd039f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.703114 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b781cbe6df4bbebb788054c9672211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.704383 747 tablet_service.cc:1511] Processing CreateTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 (DEFAULT_TABLE table=default.Table_4248601c3f624bd8ba822648871feb03 [id=69ef9f5b104845d7bdc159759a67b944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.704680 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7263a5d258e4f8ab413a1619ac611f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.705020 743 tablet_service.cc:1511] Processing CreateTablet for tablet def68d0327734e68897c930716f1ff59 (DEFAULT_TABLE table=default.Table_a4640dd37e014f91860a4a0647350191 [id=2fe773abf59949cd8113e7a37b31ffba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.705358 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def68d0327734e68897c930716f1ff59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.709276 750 tablet_service.cc:1511] Processing CreateTablet for tablet a24c32e6800245d5bc9d15550b391a87 (DEFAULT_TABLE table=default.Table_a6359260f55a47dfb599fa173a09f0d0 [id=4e38ce667e8f49919ae030e3b9603ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.709601 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24c32e6800245d5bc9d15550b391a87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.711047 715 consensus_peers.cc:597] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:11.711315 882 tablet_service.cc:1511] Processing CreateTablet for tablet 2a205b6c56074344ad05df617ea267fd (DEFAULT_TABLE table=default.Table_9e72e720c3b648e1a5ca3e5765a300a7 [id=b946b1b6f9b7487cbf06a6b73a68b075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.712747 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a205b6c56074344ad05df617ea267fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.713006 747 tablet_service.cc:1511] Processing CreateTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b (DEFAULT_TABLE table=default.Table_aac5c556de2b4e90b839a1466013cd86 [id=757e2d95151e4b428365ff43e22548ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.713371 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad4408db9eb47c9bb925fb66b7d8b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.713377 1165 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:11.715184 1165 ts_tablet_manager.cc:1403] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260503 07:53:11.716038 1165 raft_consensus.cc:359] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.716292 1165 raft_consensus.cc:385] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.716388 1165 raft_consensus.cc:740] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.716647 754 tablet_service.cc:1511] Processing CreateTablet for tablet f161b32232b7449493fa616794ad07a5 (DEFAULT_TABLE table=default.Table_4f747befb8f140abb67a16b1cbd92762 [id=0b7022caa0f1418ea7742784e6081991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.716997 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f161b32232b7449493fa616794ad07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.716629 1165 consensus_queue.cc:260] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.718043 1165 ts_tablet_manager.cc:1434] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:11.718436 1165 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:11.718613 741 tablet_service.cc:1511] Processing CreateTablet for tablet 001ded76f1894772898cb660e501984d (DEFAULT_TABLE table=default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256 [id=2b1c73ba2338402da8b009d3b6703fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.718976 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ded76f1894772898cb660e501984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.723315 743 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a (DEFAULT_TABLE table=default.Table_eca1c70488b24800b87da036697e2137 [id=cb76c8113f72465f96389589683f7559]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.723408 754 tablet_service.cc:1511] Processing CreateTablet for tablet db375404b0a34b6b9310b61182a40e79 (DEFAULT_TABLE table=default.Table_8565e6d58b664553ac2eca8f6809fd77 [id=f99f2a19e57c4e1db74d2784e87ada04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.723568 755 tablet_service.cc:1511] Processing CreateTablet for tablet 5c63f7e6b56a478dab28ce7bcaee545d (DEFAULT_TABLE table=default.Table_cee9ef7a6b20439db5b24767d3b857c1 [id=ae80c053e7974433a619a371f5d3399f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.723654 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd105ef7a3474fa546b4945ddc875a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.723932 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3c11929da15442d8a1dfad0e11d37a76 (DEFAULT_TABLE table=default.Table_e009ce0a5d9049d1b5f056b835c6f25a [id=7cf5ed2776ca4ce78d3b618643cb7b55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.724628 753 tablet_service.cc:1511] Processing CreateTablet for tablet 91ca948a56a74f958d029dce8fa5762b (DEFAULT_TABLE table=default.Table_39ab2778dd8b40f199440137c1897c4e [id=1991fee9160546c582a9330903e88445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.725241 757 tablet_service.cc:1511] Processing CreateTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f (DEFAULT_TABLE table=default.Table_cffd6579b5f4480c83276fca296d5483 [id=35ce68478bb042b0bf019203c481a6d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.725883 742 tablet_service.cc:1511] Processing CreateTablet for tablet ff21c53589e04efb99fd2b4a6f2eef16 (DEFAULT_TABLE table=default.Table_8d9a6df25a9a4a289f66f8ffcbfe546a [id=4942b898128146e5bbeaf50d317f4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.727525 741 tablet_service.cc:1511] Processing CreateTablet for tablet 59a311dc5ec244fab0cdd8e5c1d58cee (DEFAULT_TABLE table=default.Table_bacfe879a66646fb88d9daa8623de480 [id=eedb402be60449c3bf606448c6bb7359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.728259 1174 log.cc:1199] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1bf42130a55744429d2c64ed55671507
I20260503 07:53:11.729641 744 tablet_service.cc:1511] Processing CreateTablet for tablet 01c7925b82934b59839a0e8ddf99356d (DEFAULT_TABLE table=default.Table_6201cd5a177e4929bc6eb8d8ce93a292 [id=065415bedc6a4d529e0672fb7521a523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.730029 1165 tablet_bootstrap.cc:654] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.730369 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6f743fe004124fc5994b9208c78632c1 (DEFAULT_TABLE table=default.Table_d59831d36779464b849511b4d3640641 [id=a7af1ccf67264aba868d3ae91aab559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.730870 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.731096 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.730523 760 tablet_service.cc:1511] Processing CreateTablet for tablet 78f66be8ef69497898412bdddb824899 (DEFAULT_TABLE table=default.Table_6775d8d897cf4e0bb4f30977e8d640de [id=560e4d32bcaa4f119a49cfd88c46e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.731551 752 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.731762 752 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.731952 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c25addae8c94554a83344f07a11362f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.732323 752 tablet_service.cc:1511] Processing CreateTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 (DEFAULT_TABLE table=default.Table_0319d0a5b2814beebb4b59f9c664b588 [id=292fae8d3418434d99f9343561191233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.732971 756 tablet_service.cc:1511] Processing CreateTablet for tablet 3277c39b93c44c1cb91564a7530e3c07 (DEFAULT_TABLE table=default.Table_08e346119e8646e4bc01a72cc216b6ed [id=f4d81c03d40b4d8284f38a407e8da53e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.733664 748 tablet_service.cc:1511] Processing CreateTablet for tablet d9d53943f50d49cea9828273369235f1 (DEFAULT_TABLE table=default.Table_89197de9e3944b4ebeb6768405dc969d [id=c3aab1ea79bd41f28e5fa876d95f21c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.733835 1174 ts_tablet_manager.cc:1950] T 1bf42130a55744429d2c64ed55671507 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:11.731305 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de65c754b47440a914f3f2bdb86059c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.734345 745 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeae993f8894649ac780f266b3b4968 (DEFAULT_TABLE table=default.Table_51d7f64d591047159048f9395ddbf407 [id=ba26e448f9fc4afda401a8faeb01f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.734814 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 865) took 5279 ms. Trace:
I20260503 07:53:11.736853 1174 rpcz_store.cc:276] 0503 07:53:06.455587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.456057 (+ 470us) service_pool.cc:224] Handling call
0503 07:53:11.650517 (+5194460us) ts_tablet_manager.cc:1151] Deleting tablet 1bf42130a55744429d2c64ed55671507
0503 07:53:11.650531 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.685387 (+ 34856us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.695415 (+ 10028us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.734801 (+ 39386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5193683}
I20260503 07:53:11.738132 1174 tablet_replica.cc:333] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:11.739192 1174 raft_consensus.cc:2243] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:11.739506 1174 raft_consensus.cc:2272] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.742719 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ca948a56a74f958d029dce8fa5762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.742951 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c63f7e6b56a478dab28ce7bcaee545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.743103 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c7925b82934b59839a0e8ddf99356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.743908 1174 ts_tablet_manager.cc:1916] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.744272 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c11929da15442d8a1dfad0e11d37a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.744807 882 tablet_service.cc:1511] Processing CreateTablet for tablet bd484b35831d4dafa93385c40c8ab696 (DEFAULT_TABLE table=default.Table_7e721b1e3da6400b9f668b14171f376b [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.748345 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a311dc5ec244fab0cdd8e5c1d58cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.750342 761 tablet_service.cc:1511] Processing CreateTablet for tablet bd9c20e9065e401881180f6057ce0eb6 (DEFAULT_TABLE table=default.Table_28f22c3e03ec4fd398b5ca4a0944c93a [id=b04a2909de684220b1121265b7c26833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.759466 893 tablet_service.cc:1511] Processing CreateTablet for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6 (DEFAULT_TABLE table=default.Table_1d7472fe4c0e4303ab8502ac10ae7498 [id=b8f208de08b54b4980864cdd67ba66e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.760694 1173 ts_tablet_manager.cc:1929] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:11.760717 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd484b35831d4dafa93385c40c8ab696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.761667 1173 log.cc:1199] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/ebec2b05025444ccaf0bf0bb4ab62dae
I20260503 07:53:11.768066 888 tablet_service.cc:1558] Processing DeleteTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.769253 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d with delete_type TABLET_DATA_DELETED (replaced by tablet 0708cababc844e51ab7da2950664c2c5) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:11.770557 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.771418 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3711932af94d4fadb023c1566b6307e5 (DEFAULT_TABLE table=default.Table_80ba0ddbd798484daa6d731ec40bdf3c [id=44f3f28c60ff4e8ba2b31ffc9df0f720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.772802 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3711932af94d4fadb023c1566b6307e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.775705 896 tablet_service.cc:1511] Processing CreateTablet for tablet 484ed73c72274e14a0c6f667bdee93b3 (DEFAULT_TABLE table=default.Table_b1d6f7f8766843359ad26aac3c60ecbf [id=80a89614d3d64ac7bc378158e19a605c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.777027 882 tablet_service.cc:1511] Processing CreateTablet for tablet 87955e94e5c84a5485ac8ec66ff6451e (DEFAULT_TABLE table=default.Table_ec0807d8f4dd447fb9870d3327bd93cc [id=063d5eb757334985acff556c99277fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.780812 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f6d4a870eb2047848f1d4f7f62272c05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.781469 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6d4a870eb2047848f1d4f7f62272c05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.783151 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_962194a1f83f4a40bd8f6a53b4eee740" } new_table_name: "default.Table_cd38962a2bde408a982af1b52836a26a" modify_external_catalogs: true
I20260503 07:53:11.785861 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4c1d216c3b5b4d10b263944d20c92d5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.786408 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c1d216c3b5b4d10b263944d20c92d5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.788612 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1314de5d64d948419afb1b3588747142" } new_table_name: "default.Table_551d9db90d484b22bbdfe4b553402fda" modify_external_catalogs: true
I20260503 07:53:11.789565 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bba9ee7c0bd54a02ab254eb165cce98b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.789948 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bba9ee7c0bd54a02ab254eb165cce98b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.790541 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_16adf807c53c4ed09bdfadfd1d27511e" } new_table_name: "default.Table_cbc0b45dfdc84d508ff6aca7dbeb6764" modify_external_catalogs: true
I20260503 07:53:11.791234 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7ffb7ee3ef9848d2860e3ae82ed1e12b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.791606 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ffb7ee3ef9848d2860e3ae82ed1e12b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.792042 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2923dafec6854f58bcfd56dab4677849"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.792443 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2923dafec6854f58bcfd56dab4677849 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.627266 1028 tablet_service.cc:1511] Processing CreateTablet for tablet bd484b35831d4dafa93385c40c8ab696 (DEFAULT_TABLE table=default.Table_7e721b1e3da6400b9f668b14171f376b [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.627637 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3277c39b93c44c1cb91564a7530e3c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.444128 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d9d53943f50d49cea9828273369235f1 (DEFAULT_TABLE table=default.Table_89197de9e3944b4ebeb6768405dc969d [id=c3aab1ea79bd41f28e5fa876d95f21c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.808441 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d53943f50d49cea9828273369235f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.638255 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.643385 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6 (DEFAULT_TABLE table=default.Table_1d7472fe4c0e4303ab8502ac10ae7498 [id=b8f208de08b54b4980864cdd67ba66e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.644109 1171 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:11.812546 1171 ts_tablet_manager.cc:1403] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.530s user 0.004s sys 0.001s
I20260503 07:53:11.812633 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.813246 1171 raft_consensus.cc:359] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.813385 1171 raft_consensus.cc:385] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:11.813431 1171 raft_consensus.cc:740] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:11.813572 1171 consensus_queue.cc:260] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.813973 1171 ts_tablet_manager.cc:1434] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:53:11.814201 1171 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:11.815461 1171 tablet_bootstrap.cc:654] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:11.816279 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd484b35831d4dafa93385c40c8ab696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.819038 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b78cbc86f75049a9bd25f88deb484788" } new_table_name: "default.Table_eec963b9a845467bab5e73f0f83e9897" modify_external_catalogs: true
I20260503 07:53:11.820477 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5ec65f8fd71c412287af4b000577f35c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.821017 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ec65f8fd71c412287af4b000577f35c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.822865 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2417873f234b26b7fa2c2f0120a86f (DEFAULT_TABLE table=default.Table_15d017bc81f944509caf3605b55506a4 [id=58ccedd067944972895ec0afb28e8bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.823186 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2417873f234b26b7fa2c2f0120a86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.826742 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b3e78c443801484cacc0819e8ac0c7f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.827190 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3e78c443801484cacc0819e8ac0c7f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.826897 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 94ed1a600ee44c1a9f6e292567e85f92 (DEFAULT_TABLE table=default.Table_4d98077554f141b28214686f206b90b2 [id=208d417062024607bd8e02dd4fca6ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.829111 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e382ffd461ec4ef6a80f5c29c062747a (DEFAULT_TABLE table=default.Table_870965ffd55d465c9e6d769178dd9516 [id=d89f7483b886457ca8b4126f4dbe536f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.829916 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ed1a600ee44c1a9f6e292567e85f92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.831442 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5e540b4e5a046e78af3e61858e1fc42 consensus state has no leader
I20260503 07:53:11.831635 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d2f9d4b323284e6e8f172a04e35be881 (DEFAULT_TABLE table=default.Table_12ec486261344161bd8fcd5894291c74 [id=14dfa830ea4e45ebbe1f24f6df8c4e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.831775 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6e7c2c4846b846de92b7b4650492d1ea" } modify_external_catalogs: true
I20260503 07:53:11.831912 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6e7c2c4846b846de92b7b4650492d1ea" } modify_external_catalogs: true
I20260503 07:53:11.644600 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.646196 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d with delete_type TABLET_DATA_DELETED (replaced by tablet 0708cababc844e51ab7da2950664c2c5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.832432 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b10183f49464684acfa54e7d10ccee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.832549 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 01c7925b82934b59839a0e8ddf99356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.832652 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:11.832854 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 05dd6ab85112477c9f5c6ea99589f030 (DEFAULT_TABLE table=default.Table_27a4722aa409479eb2e6afb23df82d22 [id=9cd18a34113b48dbb77398c82a2adf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.833107 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dd6ab85112477c9f5c6ea99589f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.833751 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e16586cf2a0e4c1095d850164447734a (DEFAULT_TABLE table=default.Table_daccf1f8872c49f99de2bc0755367705 [id=98a18d73771b4203a3310b388b7721c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.834012 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16586cf2a0e4c1095d850164447734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.660535 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3711932af94d4fadb023c1566b6307e5 (DEFAULT_TABLE table=default.Table_80ba0ddbd798484daa6d731ec40bdf3c [id=44f3f28c60ff4e8ba2b31ffc9df0f720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.835983 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3711932af94d4fadb023c1566b6307e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.838685 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f9d4b323284e6e8f172a04e35be881. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.661103 988 leader_election.cc:343] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.840272 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e382ffd461ec4ef6a80f5c29c062747a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.840247 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 179142us
I20260503 07:53:11.843947 2646 raft_consensus.cc:493] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.844055 2646 raft_consensus.cc:515] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.844674 2646 leader_election.cc:290] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.845518 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe55ee95698445c85753782b8b651b0 (DEFAULT_TABLE table=default.Table_86b5945e96354692b1e82b9786a64113 [id=560c4b32bde04160bda0cfecdd61a81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.845760 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe55ee95698445c85753782b8b651b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.846645 2591 raft_consensus.cc:493] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.846766 2591 raft_consensus.cc:515] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.847762 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 (DEFAULT_TABLE table=default.Table_b73e814e84a84ab2a3c4234d82d96659 [id=728a6a9a274240f0b7a863d873beb19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.848022 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b0b38c0024cf2ba0ff3d13f1d9276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.851048 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b9fdcdcde6b2490a81b1cbfa679b4834" } modify_external_catalogs: true
I20260503 07:53:11.851254 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b9fdcdcde6b2490a81b1cbfa679b4834" } modify_external_catalogs: true
I20260503 07:53:11.852615 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8a88ad9c45e946f797289227f8a1defc" } modify_external_catalogs: true
I20260503 07:53:11.852754 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8a88ad9c45e946f797289227f8a1defc" } modify_external_catalogs: true
W20260503 07:53:11.853281 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56f158b7489240449ce8d64d193cccc1 consensus state has no leader
W20260503 07:53:11.853561 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 899976aadc9d4ae8be4dc245cfb00cac consensus state has no leader
I20260503 07:53:11.854449 1175 pending_rounds.cc:77] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847462897430528 op_type: NO_OP noop_request { }
I20260503 07:53:11.854562 1175 raft_consensus.cc:2889] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:11.854652 1175 raft_consensus.cc:2272] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:11.855257 1175 ts_tablet_manager.cc:1916] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:11.858410 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:11.666226 2421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s user 0.004s sys 0.006s
I20260503 07:53:11.858565 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:11.858625 2421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s user 0.004s sys 0.006s
I20260503 07:53:11.858829 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bed04d8fa68f45ae95027851c14c20cb (DEFAULT_TABLE table=default.Table_ceab487f54e44095871c32ab5c84ac23 [id=f8c6f86947c046bc887f094cd090d84e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.859093 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed04d8fa68f45ae95027851c14c20cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:11.666287 2574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s user 0.000s sys 0.010s
W20260503 07:53:11.860384 2574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s user 0.000s sys 0.010s
I20260503 07:53:11.860688 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_871580894503440db95b41b028601fae" } modify_external_catalogs: true
I20260503 07:53:11.860875 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_871580894503440db95b41b028601fae" } modify_external_catalogs: true
I20260503 07:53:11.667462 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 484ed73c72274e14a0c6f667bdee93b3 (DEFAULT_TABLE table=default.Table_b1d6f7f8766843359ad26aac3c60ecbf [id=80a89614d3d64ac7bc378158e19a605c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.667779 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 87955e94e5c84a5485ac8ec66ff6451e (DEFAULT_TABLE table=default.Table_ec0807d8f4dd447fb9870d3327bd93cc [id=063d5eb757334985acff556c99277fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.861541 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ed73c72274e14a0c6f667bdee93b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.670295 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 633809586e6047c9946bb54b97a5b6e1 (DEFAULT_TABLE table=default.Table_c12868ba53db4201baf55c80a2d49ca4 [id=ca04197c9079423fbc7397e3a0fd4c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.861807 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a043996e2db248e59da337f4eb243320" } new_table_name: "default.Table_c4135cff65ad477085e4794cc3ae37e7" modify_external_catalogs: true
I20260503 07:53:11.673702 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 79cd91c2757c48198aa2067683a7329c (DEFAULT_TABLE table=default.Table_112d3a0905e347eb8349ca00511849f1 [id=33a30c1aca674de58ab6bb34c6589346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.862176 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87955e94e5c84a5485ac8ec66ff6451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.677313 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.677521 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:11.677819 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:11.681773 1952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s user 0.045s sys 0.069s
W20260503 07:53:11.863039 1952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s user 0.045s sys 0.069s
I20260503 07:53:11.683049 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 600b411548fc4031a8a3dece4e3c579d (DEFAULT_TABLE table=default.Table_09b279a4b8654d5e9ddb5aae42a2d480 [id=c951114101524e1eb42c52db6c452002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.863025 1051 raft_consensus.cc:2468] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:11.863255 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5e9d50a71c1a4bf799de34af1064597d
I20260503 07:53:11.687891 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 121822fdec204c40b0c5d953674b9977 (DEFAULT_TABLE table=default.Table_dbcd0c3837fc45e7a8779f49d790e9f0 [id=04dd80e635b34b5db07abadc2cbe31bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.863003 1048 raft_consensus.cc:2468] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:11.655733 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 471d979edca2476bb5787319a442603a (DEFAULT_TABLE table=default.Table_8a88ad9c45e946f797289227f8a1defc [id=7b335186af9c4346b5f93632a75d8998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.778326 1014 tablet_service.cc:1511] Processing CreateTablet for tablet eabfceb115aa4e78a4cb78ae081d0f59 (DEFAULT_TABLE table=default.Table_5470a2dd25b944ab9ebcb89d71140c03 [id=dec1e8c73c554181865c51c2052c8ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.778393 2113 raft_consensus.cc:493] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.778913 1017 tablet_service.cc:1511] Processing CreateTablet for tablet ac06a8f3dd204c4396e0f6cf95c9e54a (DEFAULT_TABLE table=default.Table_6fc180ce0ac64713b8d194543bd1e19c [id=c061281fd5b945e2abb7e91d80a6f461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.791832 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 (DEFAULT_TABLE table=default.Table_1a31915dab804360889f9e08e8eb20bd [id=17ed0866123f4974a7b532c55a72255b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.863713 2113 raft_consensus.cc:515] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:11.863869 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b" } modify_external_catalogs: true
I20260503 07:53:11.864045 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4b6d9c3b7fcb4f21b3d5b561d750ac6b" } modify_external_catalogs: true
I20260503 07:53:11.864276 2113 leader_election.cc:290] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:11.864464 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f77cc1370a434961ae9138cbb8c39d7b consensus state has no leader
I20260503 07:53:11.866104 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_36da2c59317c4f3bb4c2b3b203f298b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:11.866662 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36da2c59317c4f3bb4c2b3b203f298b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.867285 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 48c66e254a0a4c21a5d8dfd54a37b089 (DEFAULT_TABLE table=default.Table_8eb570874fa640a1bcfca8fccf8b9ecb [id=51f32915723c4f89866de8c99aca02e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.869304 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1885dda594c1f9c1039111af4ce9b (DEFAULT_TABLE table=default.Table_3811f4c1bc364be0bd601ca29c32140f [id=55bbc9fb8905404abd9fe4fb6621c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.870081 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d30ad713a05b41dd814d5787de7cff2f (DEFAULT_TABLE table=default.Table_6b08393d6dc448cb83b53551d377ee44 [id=28444fe333dc46cdacc546bf64e34c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.871213 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 51204502f2ff403e9e074d8a1b847aeb (DEFAULT_TABLE table=default.Table_aa13ddecf6574581b4989e7c33515014 [id=8ff2e5d64c6e42be87d24a22146b4f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.876749 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e20b84490a354310b510a82b139bc773 (DEFAULT_TABLE table=default.Table_5eb67445b84f47009db70743ef0767ab [id=a2c2b322f764459a921413e6eff24e75]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.888283 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17b547a24cfa4478a90d3035a59a3381 consensus state has no leader
I20260503 07:53:11.889130 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 314f539af5e44f048ff42619fcda1943
W20260503 07:53:11.881402 988 consensus_peers.cc:597] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:11.904844 2577 consensus_queue.cc:1048] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:11.907709 2577 consensus_queue.cc:1048] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:11.882296 1171 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:11.885100 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633809586e6047c9946bb54b97a5b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.914286 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121822fdec204c40b0c5d953674b9977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.891127 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 7f523d718ae8475390f78cf2af6758da (DEFAULT_TABLE table=default.Table_c24b8806a2994e039df3e7eccf6ce8e5 [id=57a6761487c8401484b470a0ae814b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.914549 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c66e254a0a4c21a5d8dfd54a37b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.914768 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79cd91c2757c48198aa2067683a7329c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.914898 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600b411548fc4031a8a3dece4e3c579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.920974 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471d979edca2476bb5787319a442603a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.921200 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabfceb115aa4e78a4cb78ae081d0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.926637 892 tablet_service.cc:1511] Processing CreateTablet for tablet 79cd91c2757c48198aa2067683a7329c (DEFAULT_TABLE table=default.Table_112d3a0905e347eb8349ca00511849f1 [id=33a30c1aca674de58ab6bb34c6589346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.928578 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac06a8f3dd204c4396e0f6cf95c9e54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.928756 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 17db30b1109845d783ade7c4860a3d0d (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.929103 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db30b1109845d783ade7c4860a3d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.932103 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 6076544a93644c69b3a9a8bb890bd1ef (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.932512 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6076544a93644c69b3a9a8bb890bd1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.934229 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbf179398734e63a0f92b0d60030276 (DEFAULT_TABLE table=default.Table_6b850b1ebc7545aa8ba22c0d794201b7 [id=d48bd45960de409dad0b9c75951049d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.934568 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbf179398734e63a0f92b0d60030276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.936372 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1885dda594c1f9c1039111af4ce9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.938941 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a7ea9b7a798a444eba3e65f32a7f7480 (DEFAULT_TABLE table=default.Table_77ad9b6ea12644dcab768e70974699c2 [id=0385edbce3734297afb7f047f893c584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.892727 895 tablet_service.cc:1511] Processing CreateTablet for tablet 633809586e6047c9946bb54b97a5b6e1 (DEFAULT_TABLE table=default.Table_c12868ba53db4201baf55c80a2d49ca4 [id=ca04197c9079423fbc7397e3a0fd4c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.965214 2591 leader_election.cc:290] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:11.967762 880 tablet_service.cc:1511] Processing CreateTablet for tablet eabfceb115aa4e78a4cb78ae081d0f59 (DEFAULT_TABLE table=default.Table_5470a2dd25b944ab9ebcb89d71140c03 [id=dec1e8c73c554181865c51c2052c8ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.972422 897 tablet_service.cc:1511] Processing CreateTablet for tablet 471d979edca2476bb5787319a442603a (DEFAULT_TABLE table=default.Table_8a88ad9c45e946f797289227f8a1defc [id=7b335186af9c4346b5f93632a75d8998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.972918 885 tablet_service.cc:1511] Processing CreateTablet for tablet 600b411548fc4031a8a3dece4e3c579d (DEFAULT_TABLE table=default.Table_09b279a4b8654d5e9ddb5aae42a2d480 [id=c951114101524e1eb42c52db6c452002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.962913 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ed73c72274e14a0c6f667bdee93b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.973866 884 tablet_service.cc:1511] Processing CreateTablet for tablet 121822fdec204c40b0c5d953674b9977 (DEFAULT_TABLE table=default.Table_dbcd0c3837fc45e7a8779f49d790e9f0 [id=04dd80e635b34b5db07abadc2cbe31bd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:11.979166 854 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:11.982872 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87955e94e5c84a5485ac8ec66ff6451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.983114 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471d979edca2476bb5787319a442603a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.984036 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabfceb115aa4e78a4cb78ae081d0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.984601 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633809586e6047c9946bb54b97a5b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.988420 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79cd91c2757c48198aa2067683a7329c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.992926 881 tablet_service.cc:1511] Processing CreateTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 (DEFAULT_TABLE table=default.Table_1a31915dab804360889f9e08e8eb20bd [id=17ed0866123f4974a7b532c55a72255b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.993309 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fdc7738d1e4df6aed3a85c4cee3f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.994381 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600b411548fc4031a8a3dece4e3c579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.004382 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121822fdec204c40b0c5d953674b9977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.005635 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 56d5a84f62f446c488a7e02be814a26c
I20260503 07:53:12.007166 888 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2417873f234b26b7fa2c2f0120a86f (DEFAULT_TABLE table=default.Table_15d017bc81f944509caf3605b55506a4 [id=58ccedd067944972895ec0afb28e8bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.007478 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 471d979edca2476bb5787319a442603a
I20260503 07:53:12.007738 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2417873f234b26b7fa2c2f0120a86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.014575 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet bda89822863d4f70bc6f115dc2f808c8
I20260503 07:53:12.018810 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 2 got 0
I20260503 07:53:12.019529 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d38c214d66b4e5eae6ee88e7b29f1de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:11.750583 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a44b834b1e44a99c2cd3f9747ca13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.754393 741 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 (DEFAULT_TABLE table=default.Table_00a265bded494e629c023c1199bdb23a [id=cf6452c2f69d47a6a2726270340ea5d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.022917 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d38c214d66b4e5eae6ee88e7b29f1de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.023041 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f239e33bc42beb9dad004d5b20c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.020251 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_15308a97428e45e8ba696da09885250b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.024407 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15308a97428e45e8ba696da09885250b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.026096 1174 ts_tablet_manager.cc:1929] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:12.026212 1174 log.cc:1199] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/6a2a1079ce0e4e6da9779ccd401e98f9
I20260503 07:53:12.026643 1174 ts_tablet_manager.cc:1950] T 6a2a1079ce0e4e6da9779ccd401e98f9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:12.027024 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 868) took 5473 ms. Trace:
I20260503 07:53:11.755656 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2a205b6c56074344ad05df617ea267fd (DEFAULT_TABLE table=default.Table_9e72e720c3b648e1a5ca3e5765a300a7 [id=b946b1b6f9b7487cbf06a6b73a68b075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.027103 1174 rpcz_store.cc:276] 0503 07:53:06.553098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.553449 (+ 351us) service_pool.cc:224] Handling call
0503 07:53:11.738086 (+5184637us) ts_tablet_manager.cc:1151] Deleting tablet 6a2a1079ce0e4e6da9779ccd401e98f9
0503 07:53:11.738096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.766321 (+ 28225us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.026046 (+259725us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.026973 (+ 927us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5184454}
I20260503 07:53:12.027273 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5d7ddac49c474eacb06291a067c7aa8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:12.027472 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a205b6c56074344ad05df617ea267fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.027503 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 870) took 5359 ms. Trace:
I20260503 07:53:12.027570 1174 rpcz_store.cc:276] 0503 07:53:06.667659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.667712 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:12.027378 (+5359666us) ts_tablet_manager.cc:1151] Deleting tablet 437d8b148ade443790f5c42c7d955f48
0503 07:53:12.027387 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.027483 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5359389}
W20260503 07:53:12.027688 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d7ddac49c474eacb06291a067c7aa8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.027930 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 869) took 5361 ms. Trace:
I20260503 07:53:12.028000 1174 rpcz_store.cc:276] 0503 07:53:06.666951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.683541 (+ 16590us) service_pool.cc:224] Handling call
0503 07:53:12.027796 (+5344255us) ts_tablet_manager.cc:1151] Deleting tablet 30c917e1bc514bcbb859340f9ef99f3b
0503 07:53:12.027807 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.027904 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5311496}
I20260503 07:53:12.028613 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3277c39b93c44c1cb91564a7530e3c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.029093 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 875) took 5067 ms. Trace:
I20260503 07:53:12.029233 1174 rpcz_store.cc:276] 0503 07:53:06.961843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:06.962939 (+ 1096us) service_pool.cc:224] Handling call
0503 07:53:12.028958 (+5066019us) ts_tablet_manager.cc:1151] Deleting tablet 6ae4a8f39d67459dbb80c72947ae7005
0503 07:53:12.028968 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.029077 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5065804}
I20260503 07:53:12.029666 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 878) took 5011 ms. Trace:
I20260503 07:53:12.029793 1174 rpcz_store.cc:276] 0503 07:53:07.017820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.017878 (+ 58us) service_pool.cc:224] Handling call
0503 07:53:12.029544 (+5011666us) ts_tablet_manager.cc:1151] Deleting tablet 0a269a12729549469f86e184e2ed7e86
0503 07:53:12.029556 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.029652 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5011469}
I20260503 07:53:12.030217 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 877) took 5012 ms. Trace:
I20260503 07:53:12.030469 1174 rpcz_store.cc:276] 0503 07:53:07.017677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.018419 (+ 742us) service_pool.cc:224] Handling call
0503 07:53:12.030111 (+5011692us) ts_tablet_manager.cc:1151] Deleting tablet cec0b36fdcf64042bc87446977b9dcca
0503 07:53:12.030119 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.030199 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5008862}
I20260503 07:53:12.030882 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 880) took 4985 ms. Trace:
I20260503 07:53:12.031041 1174 rpcz_store.cc:276] 0503 07:53:07.045205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.045273 (+ 68us) service_pool.cc:224] Handling call
0503 07:53:12.030777 (+4985504us) ts_tablet_manager.cc:1151] Deleting tablet 0e47796d8f924117bcc5dcc5cf958874
0503 07:53:12.030785 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.030867 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4985280}
I20260503 07:53:12.031425 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 883) took 4942 ms. Trace:
I20260503 07:53:12.031540 1174 rpcz_store.cc:276] 0503 07:53:07.089361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.108224 (+ 18863us) service_pool.cc:224] Handling call
0503 07:53:12.031332 (+4923108us) ts_tablet_manager.cc:1151] Deleting tablet 801e48526d634222875678f56ce00cfe
0503 07:53:12.031339 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.031412 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4922897}
I20260503 07:53:12.031910 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 886) took 4902 ms. Trace:
I20260503 07:53:12.032074 1174 rpcz_store.cc:276] 0503 07:53:07.128975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.129018 (+ 43us) service_pool.cc:224] Handling call
0503 07:53:12.031792 (+4902774us) ts_tablet_manager.cc:1151] Deleting tablet 0a67c4565c4c4c35bb54cd047258be07
0503 07:53:12.031799 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.031897 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4902589}
I20260503 07:53:11.777529 743 tablet_service.cc:1511] Processing CreateTablet for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6 (DEFAULT_TABLE table=default.Table_1d7472fe4c0e4303ab8502ac10ae7498 [id=b8f208de08b54b4980864cdd67ba66e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.032513 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f2cf2eaf6441ce970aa71fa0df0dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.034502 741 tablet_service.cc:1511] Processing CreateTablet for tablet 87955e94e5c84a5485ac8ec66ff6451e (DEFAULT_TABLE table=default.Table_ec0807d8f4dd447fb9870d3327bd93cc [id=063d5eb757334985acff556c99277fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.034802 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87955e94e5c84a5485ac8ec66ff6451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.036267 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21c53589e04efb99fd2b4a6f2eef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.036520 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f66be8ef69497898412bdddb824899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.037964 757 tablet_service.cc:1511] Processing CreateTablet for tablet 633809586e6047c9946bb54b97a5b6e1 (DEFAULT_TABLE table=default.Table_c12868ba53db4201baf55c80a2d49ca4 [id=ca04197c9079423fbc7397e3a0fd4c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.038277 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633809586e6047c9946bb54b97a5b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.038983 743 tablet_service.cc:1511] Processing CreateTablet for tablet 79cd91c2757c48198aa2067683a7329c (DEFAULT_TABLE table=default.Table_112d3a0905e347eb8349ca00511849f1 [id=33a30c1aca674de58ab6bb34c6589346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.039372 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79cd91c2757c48198aa2067683a7329c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.040272 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1450c6bc197438fb8f26418c1aae4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.040220 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_999649b0095b4f6398aec84b22845edf" } new_table_name: "default.Table_1b9fc0d8b3e74016af52770b9afcadba" modify_external_catalogs: true
I20260503 07:53:12.041651 755 tablet_service.cc:1511] Processing CreateTablet for tablet 600b411548fc4031a8a3dece4e3c579d (DEFAULT_TABLE table=default.Table_09b279a4b8654d5e9ddb5aae42a2d480 [id=c951114101524e1eb42c52db6c452002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.041983 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600b411548fc4031a8a3dece4e3c579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.793654 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b1450c6bc197438fb8f26418c1aae4a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:11.535916 714 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46968 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 997)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 998)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1002)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1003)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1004)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1005)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1006)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1007)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1008)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1009)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1010)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1012)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1013)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1015)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1017)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1019)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1032)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1033)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1035)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046)
I20260503 07:53:11.861521 2457 raft_consensus.cc:493] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:11.862646 2690 consensus_queue.cc:1048] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.044936 2457 raft_consensus.cc:515] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:11.863766 716 leader_election.cc:343] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:11.875376 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d with delete_type TABLET_DATA_DELETED (replaced by tablet 0708cababc844e51ab7da2950664c2c5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.045174 716 leader_election.cc:304] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:11.878209 2608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s user 0.003s sys 0.009s
I20260503 07:53:12.045405 2565 raft_consensus.cc:2749] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:12.045459 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 181687us
I20260503 07:53:12.045661 716 leader_election.cc:304] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.045881 2565 raft_consensus.cc:2804] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:12.045951 2565 raft_consensus.cc:493] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:12.045991 716 leader_election.cc:304] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:11.965581 1165 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:12.046306 1165 ts_tablet_manager.cc:1403] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.328s user 0.016s sys 0.032s
W20260503 07:53:11.978011 715 consensus_peers.cc:597] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:12.045425 2608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s user 0.003s sys 0.009s
I20260503 07:53:12.045185 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeae993f8894649ac780f266b3b4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.047096 592 catalog_manager.cc:5671] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:12.047397 1174 tablet_replica.cc:333] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:12.047610 1174 raft_consensus.cc:2243] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:12.047798 1174 raft_consensus.cc:2272] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.048399 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f743fe004124fc5994b9208c78632c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.051782 893 tablet_service.cc:1511] Processing CreateTablet for tablet ac06a8f3dd204c4396e0f6cf95c9e54a (DEFAULT_TABLE table=default.Table_6fc180ce0ac64713b8d194543bd1e19c [id=c061281fd5b945e2abb7e91d80a6f461]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.051187 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e210e9e635b6449e9d48f3520120ac97 consensus state has no leader
I20260503 07:53:12.055431 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:12.009711 747 tablet_service.cc:1511] Processing CreateTablet for tablet 484ed73c72274e14a0c6f667bdee93b3 (DEFAULT_TABLE table=default.Table_b1d6f7f8766843359ad26aac3c60ecbf [id=80a89614d3d64ac7bc378158e19a605c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.759289 750 tablet_service.cc:1511] Processing CreateTablet for tablet bd484b35831d4dafa93385c40c8ab696 (DEFAULT_TABLE table=default.Table_7e721b1e3da6400b9f668b14171f376b [id=362e0f41e20d4f74bcc451256745d5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.044535 746 tablet_service.cc:1511] Processing CreateTablet for tablet 121822fdec204c40b0c5d953674b9977 (DEFAULT_TABLE table=default.Table_dbcd0c3837fc45e7a8779f49d790e9f0 [id=04dd80e635b34b5db07abadc2cbe31bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.046018 2565 raft_consensus.cc:3060] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:11.997251 744 tablet_service.cc:1511] Processing CreateTablet for tablet 3711932af94d4fadb023c1566b6307e5 (DEFAULT_TABLE table=default.Table_80ba0ddbd798484daa6d731ec40bdf3c [id=44f3f28c60ff4e8ba2b31ffc9df0f720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.056962 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8ad6cc39d6d049649adff267c37d808f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.058355 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ad6cc39d6d049649adff267c37d808f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:11.939205 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5528f495ce534d989a0e370549c8f528 (DEFAULT_TABLE table=default.Table_80eb2da5ac354508bb67257f45284795 [id=59a3a0b1245a48ab8df6a3b4133ac6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.944363 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 04d4e35fd9e444b2ac1df70568e7928c (DEFAULT_TABLE table=default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.944677 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fdc7738d1e4df6aed3a85c4cee3f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:11.946666 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 (DEFAULT_TABLE table=default.Table_c36456e61be8471387364109939d3dcc [id=8647f634ac7743b88d5c1a88388f50c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.951710 1024 tablet_service.cc:1511] Processing CreateTablet for tablet fe6cf63b7e3949d6b5854e5b47b9071e (DEFAULT_TABLE table=default.Table_003603bc65c441bb8dc35a78daf67dff [id=8ca200f7e65e48758ddc3f89e51e0065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:11.920974 1171 ts_tablet_manager.cc:1403] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.007s
I20260503 07:53:12.060969 1171 raft_consensus.cc:359] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.061159 1171 raft_consensus.cc:385] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.061215 1171 raft_consensus.cc:740] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.061398 1171 consensus_queue.cc:260] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.016873 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d489414214b041739b23e7e1c1cdec12 (DEFAULT_TABLE table=default.Table_28bca3d5b54a4c9fa87e96f0ff6ab6e2 [id=7bb7c2d4e5bd4405a97cc3dce84dfe92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.017340 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 (DEFAULT_TABLE table=default.Table_914d5e7cae5146b78cb18e6e57795d15 [id=077a23e89ad84e68a440250b623f46a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.061918 1171 ts_tablet_manager.cc:1434] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:12.061798 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ea9b7a798a444eba3e65f32a7f7480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.016873 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a401317bf551401990260fa0419fd924 (DEFAULT_TABLE table=default.Table_2037b66d5de74f39bdb3761dc0ec5729 [id=fa8dcd07127c429d81e390fdb05307d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.062415 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d4e35fd9e444b2ac1df70568e7928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.062623 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401317bf551401990260fa0419fd924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.062795 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528f495ce534d989a0e370549c8f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.062741 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c7766fda640c49a2afed2609e29794d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.063318 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7766fda640c49a2afed2609e29794d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.064658 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489414214b041739b23e7e1c1cdec12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.064672 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_253eaeecc7a64835a66c6d4b0d0d1265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:12.064860 1171 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:12.065109 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_253eaeecc7a64835a66c6d4b0d0d1265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.066318 1171 tablet_bootstrap.cc:654] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:12.066735 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_92bee268b15c4d1d83e558a015ad1d99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.067152 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92bee268b15c4d1d83e558a015ad1d99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.067312 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994d9de9bf5b4dfa9157f84ccd59e294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.068871 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4e50c697b3d540baa679fe0efe2c6f66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.069326 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e50c697b3d540baa679fe0efe2c6f66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.070999 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c0213e23de34463b83e939e084f1877f" } new_table_name: "default.Table_59450820dd794914919442bb4ff92ab4" modify_external_catalogs: true
I20260503 07:53:12.072120 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5c5cb92d3b904b77bcac954dae67f1fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:12.072304 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23434f3d8f44e581c2ed73aa045d96. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.072561 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c5cb92d3b904b77bcac954dae67f1fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.072716 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6cf63b7e3949d6b5854e5b47b9071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.074113 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_112d3a0905e347eb8349ca00511849f1" } new_table_name: "default.Table_e6d239c0edef4e3a91278c0702ab5e44" modify_external_catalogs: true
I20260503 07:53:12.074558 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac06a8f3dd204c4396e0f6cf95c9e54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.075397 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb0a4f9c639f4edc917ea62eddfcdd04" } new_table_name: "default.Table_a6b99f7f8c134c4a818cec0d97eeaf93" modify_external_catalogs: true
I20260503 07:53:12.077956 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1ae4a39d4e3a42db816e592123a6a2e7 (table default.Table_a6a85043cd814a5d8d17300cc43be157 [id=c5d1c3d4bc32495a9966899ba145e3cb]). Expected version 3 got 0
I20260503 07:53:12.078259 592 catalog_manager.cc:5671] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:12.078639 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:12.079010 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet df60413555764bcab464b18c6a3370ce (table default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a [id=80c5584e658b4237a6580fd0d0a05a0d]). Expected version 1 got 0
I20260503 07:53:12.079226 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_c0213e23de34463b83e939e084f1877f [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 2 got 0
I20260503 07:53:12.079434 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 9a7af140ce144bc8b2e147dad98ac201 (table default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd]). Expected version 2 got 0
I20260503 07:53:12.017769 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d9269dd6a9af493a8452b7f657355933 (DEFAULT_TABLE table=default.Table_07967b4e81bd431e86edc76d6da158de [id=678c5f801ca849d8858ec5f4107cef3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.084021 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9269dd6a9af493a8452b7f657355933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.022207 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9685434c3b4c898a254b09fefde69b (DEFAULT_TABLE table=default.Table_6243db5cd8c343a090334a84b493bf40 [id=cce2c80420f14c63b9d8a0b99248ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.052320 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a129cc3aa6dd403bb3f420f9028046ab (DEFAULT_TABLE table=default.Table_83f3ee8f642e44b4b9b58e951c9f7300 [id=aff7710048fe49afa30429f71011001a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.080127 592 catalog_manager.cc:5671] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:12.111497 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb8d47da511422d9665326520d35601" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.113550 2591 raft_consensus.cc:493] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.113678 2591 raft_consensus.cc:515] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.114220 2591 leader_election.cc:290] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.110149 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5963a9665ae24475a6510b9aa2541706" } modify_external_catalogs: true
I20260503 07:53:12.116258 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5963a9665ae24475a6510b9aa2541706" } modify_external_catalogs: true
I20260503 07:53:12.111107 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d91a5ae8b64743dcb9114fd581458903" } modify_external_catalogs: true
I20260503 07:53:12.117772 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d91a5ae8b64743dcb9114fd581458903" } modify_external_catalogs: true
I20260503 07:53:12.118103 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7336c1df59754cd58c0c290b84fc0d7a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.110671 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e1a4953c942149fd9a76143ba3632364" } new_table_name: "default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1" modify_external_catalogs: true
I20260503 07:53:12.120452 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:12.122186 592 catalog_manager.cc:5671] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:12.130983 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d624a887085f4e13a8cfadaaefd51833"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.134351 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d624a887085f4e13a8cfadaaefd51833 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.135689 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf]). Expected version 2 got 0
W20260503 07:53:12.152323 1166 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.104s user 0.075s sys 0.154s
W20260503 07:53:12.152483 1166 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.104s user 0.075s sys 0.154s
I20260503 07:53:12.154615 2386 raft_consensus.cc:493] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.154749 2386 raft_consensus.cc:515] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.155372 2386 leader_election.cc:290] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:12.157049 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79cd91c2757c48198aa2067683a7329c consensus state has no leader
W20260503 07:53:12.161960 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 183974us
I20260503 07:53:12.162321 751 tablet_service.cc:1511] Processing CreateTablet for tablet 471d979edca2476bb5787319a442603a (DEFAULT_TABLE table=default.Table_8a88ad9c45e946f797289227f8a1defc [id=7b335186af9c4346b5f93632a75d8998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.162863 1174 ts_tablet_manager.cc:1916] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.167495 2457 leader_election.cc:290] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:12.169286 2421 consensus_queue.cc:1048] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.169938 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9685434c3b4c898a254b09fefde69b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.171572 988 leader_election.cc:343] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.168638 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.172253 1020 tablet_service.cc:1511] Processing CreateTablet for tablet f9972b0e56524fdbbd85e7431a312d9f (DEFAULT_TABLE table=default.Table_4a226e0c25d2475b97321d18bf53e6d1 [id=e7bed8e7277541f1bcd76d5cd0139d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.172595 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9972b0e56524fdbbd85e7431a312d9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.172629 715 leader_election.cc:343] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:12.173126 911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s user 0.016s sys 0.045s
W20260503 07:53:12.173211 911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s user 0.016s sys 0.045s
W20260503 07:53:12.173332 988 consensus_peers.cc:597] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:12.173787 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 (DEFAULT_TABLE table=default.Table_4e0954b14b3b420a9aebc96e192e0859 [id=3b3a0333a6f44fd893f3ae9b5a01570c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.174069 988 consensus_peers.cc:597] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:12.174197 2565 raft_consensus.cc:515] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.174304 2577 consensus_queue.cc:1048] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:12.174831 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 122020us
I20260503 07:53:12.175845 2565 leader_election.cc:290] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:12.176095 2457 raft_consensus.cc:2804] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:12.176160 2457 raft_consensus.cc:493] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:12.176254 2457 raft_consensus.cc:3060] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:12.176700 854 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: b5bdaa3dd3a844d8b57def2b9faa03d8
W20260503 07:53:12.176884 854 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:12.177356 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f523d718ae8475390f78cf2af6758da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.177395 988 leader_election.cc:343] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.177904 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b84490a354310b510a82b139bc773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.178428 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a129cc3aa6dd403bb3f420f9028046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.178622 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30ad713a05b41dd814d5787de7cff2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.178702 2457 raft_consensus.cc:515] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:12.179116 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51204502f2ff403e9e074d8a1b847aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.179284 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd484b35831d4dafa93385c40c8ab696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.179486 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ed73c72274e14a0c6f667bdee93b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.180128 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:12.180317 1048 raft_consensus.cc:2468] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:12.180598 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121822fdec204c40b0c5d953674b9977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.181077 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3711932af94d4fadb023c1566b6307e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.181618 2457 leader_election.cc:290] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:12.184613 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:12.185026 715 leader_election.cc:343] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:12.185789 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e51911038c2d44f9a5c5aebdbcb5946e consensus state has no leader
I20260503 07:53:12.186249 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9648cf6a6c774c05a427a5c1344bfb77
I20260503 07:53:12.186693 1028 tablet_service.cc:1511] Processing CreateTablet for tablet fad603dd15f545a999b6e45bcc20bafc (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.194044 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4ba5e9cfe6b4f24a8f91c571416dae3 consensus state has no leader
I20260503 07:53:12.202812 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet b56ee573586b49d596592c32c509969f
I20260503 07:53:12.208048 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8b3be761059d4713947809373de2bd5d" } modify_external_catalogs: true
I20260503 07:53:12.208314 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8b3be761059d4713947809373de2bd5d" } modify_external_catalogs: true
I20260503 07:53:12.210759 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4ad45235559c41a89c55250d5bf4577b" } modify_external_catalogs: true
I20260503 07:53:12.210915 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4ad45235559c41a89c55250d5bf4577b" } modify_external_catalogs: true
I20260503 07:53:12.222224 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 79d911c4eb994478ba633e5194ddb343 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.222957 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 07:53:12.221807 2710 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:12.223876 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6a85043cd814a5d8d17300cc43be157" } modify_external_catalogs: true
I20260503 07:53:12.224025 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6a85043cd814a5d8d17300cc43be157" } modify_external_catalogs: true
I20260503 07:53:12.225040 1023 tablet_service.cc:1511] Processing CreateTablet for tablet cc933a07094146b1ad0c2949188c3470 (DEFAULT_TABLE table=default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.227826 1026 tablet_service.cc:1511] Processing CreateTablet for tablet e93d2f3321bb4a018c1798eeef92abac (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.233803 715 consensus_peers.cc:597] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:12.244611 2704 raft_consensus.cc:493] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.244737 2704 raft_consensus.cc:515] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.245285 2704 leader_election.cc:290] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.245621 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bcb50750ce5b4b47bc4a79e45df1d2aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.246243 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcb50750ce5b4b47bc4a79e45df1d2aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.247519 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6e5283673660476eb689d41ef0daa2d0
I20260503 07:53:12.253419 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad603dd15f545a999b6e45bcc20bafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.253589 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d911c4eb994478ba633e5194ddb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.253933 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc933a07094146b1ad0c2949188c3470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.250022 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c9c4f91172e64186b6c083959ecc2b32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.255946 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9c4f91172e64186b6c083959ecc2b32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.257221 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_210fa78803ca498faf76d6ae8dfc3e1a" } new_table_name: "default.Table_a5fb280f25774d6c9d4dc45c968726f6" modify_external_catalogs: true
I20260503 07:53:12.258030 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12c2f3cbf74edc9caf98853272c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.258656 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_54f67bdae2284d7e8da41e63d8f74ba0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.259198 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f67bdae2284d7e8da41e63d8f74ba0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.261650 1171 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:12.261843 1171 ts_tablet_manager.cc:1403] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.007s
I20260503 07:53:12.263129 1171 raft_consensus.cc:359] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.272936 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9b0edcd3617b4c73a419b382492a23aa
I20260503 07:53:12.273144 1175 ts_tablet_manager.cc:1929] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:12.276279 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93d2f3321bb4a018c1798eeef92abac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.277704 882 tablet_service.cc:1511] Processing CreateTablet for tablet e382ffd461ec4ef6a80f5c29c062747a (DEFAULT_TABLE table=default.Table_870965ffd55d465c9e6d769178dd9516 [id=d89f7483b886457ca8b4126f4dbe536f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.278116 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e51911038c2d44f9a5c5aebdbcb5946e (table default.Table_a6b99f7f8c134c4a818cec0d97eeaf93 [id=71d63e61e2fa4966b5d55b50cb3b7546], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e51911038c2d44f9a5c5aebdbcb5946e consensus state has no leader
I20260503 07:53:12.278832 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471d979edca2476bb5787319a442603a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.279084 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db375404b0a34b6b9310b61182a40e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.279664 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9c20e9065e401881180f6057ce0eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.280186 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d53943f50d49cea9828273369235f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.293793 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1017) took 1083 ms. Trace:
I20260503 07:53:12.301339 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b10183f49464684acfa54e7d10ccee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:12.311503 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48d3b5589aeb4d8399c415b361cacf2f consensus state has no leader
I20260503 07:53:12.319090 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_628de4684f604a43b78f012131ac17aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.319830 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_628de4684f604a43b78f012131ac17aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.320478 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8bb00152ef6245dbb9401fb10277a5d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.320992 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bb00152ef6245dbb9401fb10277a5d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.322268 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8e07bd717fe1461494b19abec87c60c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.322793 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e07bd717fe1461494b19abec87c60c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.332154 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1ae4a39d4e3a42db816e592123a6a2e7
I20260503 07:53:12.335583 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_48488b7948bf4e2ea071f418c80ec3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.336156 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48488b7948bf4e2ea071f418c80ec3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.340497 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1463c35f4b2842478f204ed142920e74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.341080 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1463c35f4b2842478f204ed142920e74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.344228 1171 raft_consensus.cc:385] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.344327 1171 raft_consensus.cc:740] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.344528 1171 consensus_queue.cc:260] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.347011 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_656557c8d0024422951e151adceb7c32" } new_table_name: "default.Table_2c645d37f74a43af81f917d309bd0cd8" modify_external_catalogs: true
I20260503 07:53:12.349890 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_154420e661fb4056a6fccefb241138d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.350363 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_154420e661fb4056a6fccefb241138d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.350477 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e9d50a71c1a4bf799de34af1064597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.350654 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 314f539af5e44f048ff42619fcda1943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.351002 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b0c31cc44bea459081697fa3b17bb403 (DEFAULT_TABLE table=default.Table_13da6ea9ff3f422d9a7234c57ba92764 [id=67b0b0b7c0954efb9597c715d26be13e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.351404 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c31cc44bea459081697fa3b17bb403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.358673 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ceab487f54e44095871c32ab5c84ac23" } new_table_name: "default.Table_8efe5c86e89a476c9dc786cf2576fac9" modify_external_catalogs: true
I20260503 07:53:12.366447 1171 ts_tablet_manager.cc:1434] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.104s user 0.001s sys 0.001s
I20260503 07:53:12.367158 1171 tablet_bootstrap.cc:492] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:12.372594 1015 tablet_service.cc:1511] Processing CreateTablet for tablet f87aab6151d34bb7b0efb00f5cfdf64e (DEFAULT_TABLE table=default.Table_747481a5826140bca2e4ed9b148c96bb [id=f53b4ea9a1c84be4bb1f2aec743aba68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.373009 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87aab6151d34bb7b0efb00f5cfdf64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.273504 1175 log.cc:1199] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:12.374608 1171 tablet_bootstrap.cc:654] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:12.301980 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:12.370189 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 01c7925b82934b59839a0e8ddf99356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:12.368788 911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:38265 (request call id 626) took 1222 ms. Trace:
W20260503 07:53:12.375792 715 leader_election.cc:343] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.376727 1016 tablet_service.cc:1511] Processing CreateTablet for tablet aba38ebd9cdc4c0b927806d25d803b87 (DEFAULT_TABLE table=default.Table_f3b781f9a01a481aa77e60f9a1d8167b [id=538675a2fe6b419090d467d8b08244ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.377031 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba38ebd9cdc4c0b927806d25d803b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.380005 895 tablet_service.cc:1511] Processing CreateTablet for tablet 05dd6ab85112477c9f5c6ea99589f030 (DEFAULT_TABLE table=default.Table_27a4722aa409479eb2e6afb23df82d22 [id=9cd18a34113b48dbb77398c82a2adf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.382740 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1015) took 1173 ms. Trace:
I20260503 07:53:12.384426 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:12.388280 893 tablet_service.cc:1511] Processing CreateTablet for tablet e16586cf2a0e4c1095d850164447734a (DEFAULT_TABLE table=default.Table_daccf1f8872c49f99de2bc0755367705 [id=98a18d73771b4203a3310b388b7721c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.389099 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3a68ed42a6bb4aeaa03637864422abae" } new_table_name: "default.Table_311e012895b8474cabf84f8bd17e1fa7" modify_external_catalogs: true
I20260503 07:53:12.390226 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0699c531f06940a28824fa3f5a425d6f" } modify_external_catalogs: true
I20260503 07:53:12.390388 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0699c531f06940a28824fa3f5a425d6f" } modify_external_catalogs: true
I20260503 07:53:12.392679 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de (DEFAULT_TABLE table=default.Table_7c59ab3fec2f4ed787f9260a16901b85 [id=7b10bd6b69dc46ffbd4e48d62aec01de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.392807 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d5a84f62f446c488a7e02be814a26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.392964 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 471d979edca2476bb5787319a442603a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.393023 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8774ffc66c854bcd8d8f394b9bc8a0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.393216 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3fcabe72ad45feb71819ee22240c2e (DEFAULT_TABLE table=default.Table_77e114a37f6a4981b4a113bb290dcfdd [id=72f5acd8c7514c33a259661e1e2e4dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.393507 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3fcabe72ad45feb71819ee22240c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.396082 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bde1352924a446178bff9a5fae5564f2" } new_table_name: "default.Table_24ab8c76d8c04aadae9a96d6a9cb4c27" modify_external_catalogs: true
I20260503 07:53:12.398000 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6f24fda1c420d96ab75621d8015e4 (DEFAULT_TABLE table=default.Table_a0c51bdaabce48edbfa6d0abb9d1b5fc [id=fcee9c6410284246b9687cb2bb6f184e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.404838 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2bc82c1725174620b6c53f604e2e9583" } modify_external_catalogs: true
I20260503 07:53:12.405030 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2bc82c1725174620b6c53f604e2e9583" } modify_external_catalogs: true
I20260503 07:53:12.416946 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6f24fda1c420d96ab75621d8015e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.416904 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet bda89822863d4f70bc6f115dc2f808c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.417266 1017 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ea60ce7a14842b6cdab25e9f0d150 (DEFAULT_TABLE table=default.Table_71186bdc93b245dfa138e23897bdba05 [id=2eb015e5ab4a47c996f24a1aa4adc268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.417606 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ea60ce7a14842b6cdab25e9f0d150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.423307 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 3d52b85a5cd74d2385814258399ca2d2 (DEFAULT_TABLE table=default.Table_b87484809fe040a2bd35bf2b9a44344d [id=543a2ecec75b4b769b39427ff6196f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.423307 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c7af8a51b1de45b2a3cc539770e1b3dd (DEFAULT_TABLE table=default.Table_366b3b6108d9462c9b51f0c3ef634dbc [id=4e484bba1e654dd180dc6770eee34cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.424723 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d52b85a5cd74d2385814258399ca2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.426236 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7af8a51b1de45b2a3cc539770e1b3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.427819 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a4797d5bc24e4b65b75ef83907efdba7 (DEFAULT_TABLE table=default.Table_41739ba8d4404bafad498d6d58f810ec [id=0acca61592e54dfa9a4ee3a9deb313d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.428115 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4797d5bc24e4b65b75ef83907efdba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.432109 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e49ae08f607b4c01950a4c2e9c04e701"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:12.432566 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f7b0ba340aa94ea78c2a0982d65e129f (DEFAULT_TABLE table=default.Table_02afbc612ef24400bc2f6df2dee7d796 [id=985d8a73178745128f1c92dc85793684]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.432811 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e49ae08f607b4c01950a4c2e9c04e701 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.432934 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b0ba340aa94ea78c2a0982d65e129f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.436928 1029 tablet_service.cc:1511] Processing CreateTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 (DEFAULT_TABLE table=default.Table_89444261c7144001b844a9846d28eadf [id=517b9c969c9c42858e00a31ce6224e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.437239 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbede2c323a420b8a0ca2434d4ad5b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.440452 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c5691fe1fb1c476287c90f2ab4ff786b has no consensus state
I20260503 07:53:12.441025 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 14b67fc66ebf40a6b726a76ed813fb24 (DEFAULT_TABLE table=default.Table_9bbe84e829814d7fb2d44abbb8fa0a5a [id=4050ca030274435a9df51ec81f4b40b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.441345 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b67fc66ebf40a6b726a76ed813fb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.444916 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 0708cababc844e51ab7da2950664c2c5 (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.445433 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708cababc844e51ab7da2950664c2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.447449 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 00535762e832485c987b735c7d6d0671 (DEFAULT_TABLE table=default.Table_fb8eef4fe222404da1bcd56830523881 [id=7d8f1a3e725146cd8e833ef42dd67459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.447965 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00535762e832485c987b735c7d6d0671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.451486 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.451649 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet b56ee573586b49d596592c32c509969f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.451753 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e5283673660476eb689d41ef0daa2d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.451844 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b0edcd3617b4c73a419b382492a23aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.451946 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.453300 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_563b0138e42c4e4e88a20822813ce1aa" } modify_external_catalogs: true
I20260503 07:53:12.453493 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_563b0138e42c4e4e88a20822813ce1aa" } modify_external_catalogs: true
I20260503 07:53:12.457264 2386 raft_consensus.cc:493] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.460526 1175 ts_tablet_manager.cc:1950] T 29fe06a56f70487ea7c479b107d83d8b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:12.460970 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bed04d8fa68f45ae95027851c14c20cb consensus state has no leader
I20260503 07:53:12.464826 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 969) took 4744 ms. Trace:
I20260503 07:53:12.468263 1175 rpcz_store.cc:276] 0503 07:53:07.720161 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.721303 (+ 1142us) service_pool.cc:224] Handling call
0503 07:53:11.520140 (+3798837us) ts_tablet_manager.cc:1151] Deleting tablet 29fe06a56f70487ea7c479b107d83d8b
0503 07:53:11.520151 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.050095 (+529944us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.272918 (+222823us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.464809 (+191891us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3757723}
I20260503 07:53:12.470876 1175 tablet_replica.cc:333] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:12.470985 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 29fe06a56f70487ea7c479b107d83d8b (table default.Table_87eaff35bf554a20a9dbff384c14205b [id=bb994ffd4e35451e9cd661bf4bc3217a]) successfully deleted
I20260503 07:53:12.471557 1175 raft_consensus.cc:2243] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:12.471737 1175 raft_consensus.cc:2272] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.475091 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4d1026e4b5543358358b803c5854c5b" } modify_external_catalogs: true
I20260503 07:53:12.475273 1175 ts_tablet_manager.cc:1916] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.475262 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4d1026e4b5543358358b803c5854c5b" } modify_external_catalogs: true
I20260503 07:53:12.480331 1171 tablet_bootstrap.cc:492] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:12.480451 1171 ts_tablet_manager.cc:1403] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.113s user 0.002s sys 0.001s
I20260503 07:53:12.480501 892 tablet_service.cc:1511] Processing CreateTablet for tablet 48c66e254a0a4c21a5d8dfd54a37b089 (DEFAULT_TABLE table=default.Table_8eb570874fa640a1bcfca8fccf8b9ecb [id=51f32915723c4f89866de8c99aca02e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.481312 1171 raft_consensus.cc:359] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.481477 1171 raft_consensus.cc:385] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.481540 1171 raft_consensus.cc:740] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.484586 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_24b516f2c05c4191af1ebc827eafb9f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.485105 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24b516f2c05c4191af1ebc827eafb9f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.487809 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:12.492152 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e874f8c0f52040ffb9f211b27da50907 consensus state has no leader
I20260503 07:53:12.494388 879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1004) took 1285 ms. Trace:
I20260503 07:53:12.497411 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_73824774ba964016a8a3b4848d08c96e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.497887 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73824774ba964016a8a3b4848d08c96e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:12.503363 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c985db4e8c1d4435b9d3eab3a950f6b4 consensus state has no leader
I20260503 07:53:12.505844 1171 consensus_queue.cc:260] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.507177 1174 ts_tablet_manager.cc:1929] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:12.507296 1171 ts_tablet_manager.cc:1434] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260503 07:53:12.507503 1174 log.cc:1199] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/aef746161e6b446ab0d299d37e2151ea
I20260503 07:53:12.509366 1174 ts_tablet_manager.cc:1950] T aef746161e6b446ab0d299d37e2151ea P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:12.511816 988 consensus_peers.cc:597] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:12.512084 988 leader_election.cc:343] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.513408 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_839fac2b5d174a708e3cda5fdd780baa" } new_table_name: "default.Table_c5300b43ff77477facb847acdd2a86aa" modify_external_catalogs: true
I20260503 07:53:12.519622 1166 tablet_bootstrap.cc:492] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:12.519763 1166 ts_tablet_manager.cc:1403] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 1.473s user 0.075s sys 0.156s
I20260503 07:53:12.521054 896 tablet_service.cc:1511] Processing CreateTablet for tablet bed04d8fa68f45ae95027851c14c20cb (DEFAULT_TABLE table=default.Table_ceab487f54e44095871c32ab5c84ac23 [id=f8c6f86947c046bc887f094cd090d84e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.521673 889 rpcz_store.cc:276] 0503 07:53:11.209844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.679818 (+469974us) service_pool.cc:224] Handling call
0503 07:53:11.680352 (+ 534us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.680387 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.160087 (+479700us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.293629 (+133542us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.293772 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.522106 889 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1885dda594c1f9c1039111af4ce9b (DEFAULT_TABLE table=default.Table_3811f4c1bc364be0bd601ca29c32140f [id=55bbc9fb8905404abd9fe4fb6621c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.522377 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e382ffd461ec4ef6a80f5c29c062747a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.524106 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:12.524474 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:12.524688 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 3 got 0
I20260503 07:53:12.524914 599 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:12.527844 760 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1018) took 1321 ms. Trace:
I20260503 07:53:12.528540 592 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_eb390da88f1447448a900b2aa205b223 [id=ff32cf0130ba49fbbe5d93a0507bdc80] alter complete (version 3)
I20260503 07:53:12.529420 1165 raft_consensus.cc:359] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.529577 1165 raft_consensus.cc:385] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.529628 1165 raft_consensus.cc:740] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.529785 1165 consensus_queue.cc:260] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.527379 758 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1001) took 1406 ms. Trace:
I20260503 07:53:12.527915 760 rpcz_store.cc:276] 0503 07:53:11.205980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.729338 (+523358us) service_pool.cc:224] Handling call
0503 07:53:11.731797 (+ 2459us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.732205 (+ 408us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.048046 (+315841us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.339741 (+291695us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.527831 (+188090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.530725 760 tablet_service.cc:1511] Processing CreateTablet for tablet eabfceb115aa4e78a4cb78ae081d0f59 (DEFAULT_TABLE table=default.Table_5470a2dd25b944ab9ebcb89d71140c03 [id=dec1e8c73c554181865c51c2052c8ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.530303 758 rpcz_store.cc:276] 0503 07:53:11.120763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.700303 (+579540us) service_pool.cc:224] Handling call
0503 07:53:11.700675 (+ 372us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.700697 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:11.879884 (+179187us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.280512 (+400628us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.527362 (+246850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.531551 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.531838 758 tablet_service.cc:1511] Processing CreateTablet for tablet 05dd6ab85112477c9f5c6ea99589f030 (DEFAULT_TABLE table=default.Table_27a4722aa409479eb2e6afb23df82d22 [id=9cd18a34113b48dbb77398c82a2adf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.532236 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16586cf2a0e4c1095d850164447734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.534343 1165 ts_tablet_manager.cc:1434] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.488s user 0.002s sys 0.000s
I20260503 07:53:12.538204 745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1030) took 1331 ms. Trace:
I20260503 07:53:12.538280 745 rpcz_store.cc:276] 0503 07:53:11.206745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.734162 (+527417us) service_pool.cc:224] Handling call
0503 07:53:11.734548 (+ 386us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.734570 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.278615 (+544045us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.347347 (+ 68732us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.538190 (+190843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.538625 743 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1042) took 1012 ms. Trace:
I20260503 07:53:12.538688 743 rpcz_store.cc:276] 0503 07:53:11.525831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.038768 (+512937us) service_pool.cc:224] Handling call
0503 07:53:12.039205 (+ 437us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.039223 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.042492 (+ 3269us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.347925 (+305433us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.538611 (+190686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.539011 757 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1041) took 1013 ms. Trace:
I20260503 07:53:12.539072 757 rpcz_store.cc:276] 0503 07:53:11.525759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.037763 (+512004us) service_pool.cc:224] Handling call
0503 07:53:12.038143 (+ 380us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.038165 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.297778 (+259613us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.358216 (+ 60438us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.539000 (+180784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.539407 741 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1040) took 1013 ms. Trace:
I20260503 07:53:12.539467 741 rpcz_store.cc:276] 0503 07:53:11.525566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.034314 (+508748us) service_pool.cc:224] Handling call
0503 07:53:12.034646 (+ 332us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.034665 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.350233 (+315568us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.365259 (+ 15026us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.539394 (+174135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.539780 756 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1028) took 1333 ms. Trace:
I20260503 07:53:12.539860 756 rpcz_store.cc:276] 0503 07:53:11.206625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.732785 (+526160us) service_pool.cc:224] Handling call
0503 07:53:11.733228 (+ 443us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.733252 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.031727 (+298475us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.367516 (+335789us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.539769 (+172253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.540237 752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1027) took 1333 ms. Trace:
I20260503 07:53:12.540308 752 rpcz_store.cc:276] 0503 07:53:11.206553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.732111 (+525558us) service_pool.cc:224] Handling call
0503 07:53:11.732548 (+ 437us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.732570 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.043398 (+310828us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.372544 (+329146us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.540224 (+167680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.540597 2591 raft_consensus.cc:493] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.540812 755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1043) took 1014 ms. Trace:
I20260503 07:53:12.540892 755 rpcz_store.cc:276] 0503 07:53:11.525956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.041492 (+515536us) service_pool.cc:224] Handling call
0503 07:53:12.041867 (+ 375us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.041884 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.284574 (+242690us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.380549 (+ 95975us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.540800 (+160251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.541260 753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1014) took 1384 ms. Trace:
I20260503 07:53:12.541324 753 rpcz_store.cc:276] 0503 07:53:11.156319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.724465 (+568146us) service_pool.cc:224] Handling call
0503 07:53:11.724829 (+ 364us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.724849 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.034864 (+310015us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.380431 (+345567us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.541248 (+160817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.541697 747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1039) took 1017 ms. Trace:
I20260503 07:53:12.541757 747 rpcz_store.cc:276] 0503 07:53:11.523816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.009498 (+485682us) service_pool.cc:224] Handling call
0503 07:53:12.057049 (+ 47551us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.057095 (+ 46us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.282090 (+224995us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.480234 (+198144us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.541685 (+ 61451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.542080 754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1011) took 1402 ms. Trace:
I20260503 07:53:12.542148 754 rpcz_store.cc:276] 0503 07:53:11.139207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.723229 (+584022us) service_pool.cc:224] Handling call
0503 07:53:11.723546 (+ 317us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.723592 (+ 46us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.345431 (+621839us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.491443 (+146012us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.542070 (+ 50627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.543346 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_599ffdae4ad6419799d2d72fb73675f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.543846 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599ffdae4ad6419799d2d72fb73675f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.545876 1166 raft_consensus.cc:359] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.547863 746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1044) took 1021 ms. Trace:
I20260503 07:53:12.547982 746 rpcz_store.cc:276] 0503 07:53:11.526041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.044354 (+518313us) service_pool.cc:224] Handling call
0503 07:53:12.056636 (+ 12282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.056681 (+ 45us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.531380 (+474699us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.547284 (+ 15904us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.547849 (+ 565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.549600 759 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1020) took 1343 ms. Trace:
I20260503 07:53:12.549674 759 rpcz_store.cc:276] 0503 07:53:11.206098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.730158 (+524060us) service_pool.cc:224] Handling call
0503 07:53:11.730590 (+ 432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.730613 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.496007 (+765394us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.549469 (+ 53462us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.549583 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.550238 742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1016) took 1344 ms. Trace:
I20260503 07:53:12.550321 742 rpcz_store.cc:276] 0503 07:53:11.205803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.725700 (+519897us) service_pool.cc:224] Handling call
0503 07:53:11.726242 (+ 542us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.726261 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.369443 (+643182us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.497948 (+128505us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.550224 (+ 52276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8674}
I20260503 07:53:12.552923 757 tablet_service.cc:1511] Processing CreateTablet for tablet e16586cf2a0e4c1095d850164447734a (DEFAULT_TABLE table=default.Table_daccf1f8872c49f99de2bc0755367705 [id=98a18d73771b4203a3310b388b7721c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.553292 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16586cf2a0e4c1095d850164447734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.554785 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1885dda594c1f9c1039111af4ce9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.554841 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1016) took 1170 ms. Trace:
I20260503 07:53:12.554795 2591 raft_consensus.cc:515] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:12.556494 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe55ee95698445c85753782b8b651b0 (DEFAULT_TABLE table=default.Table_86b5945e96354692b1e82b9786a64113 [id=560c4b32bde04160bda0cfecdd61a81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.556792 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe55ee95698445c85753782b8b651b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.557093 854 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:12.557392 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1019) took 1172 ms. Trace:
I20260503 07:53:12.557451 897 tablet_service.cc:1511] Processing CreateTablet for tablet 94ed1a600ee44c1a9f6e292567e85f92 (DEFAULT_TABLE table=default.Table_4d98077554f141b28214686f206b90b2 [id=208d417062024607bd8e02dd4fca6ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.557538 891 rpcz_store.cc:276] 0503 07:53:11.209980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.689457 (+479477us) service_pool.cc:224] Handling call
0503 07:53:11.689833 (+ 376us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.689855 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.081743 (+391888us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.374794 (+293051us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.382709 (+ 7915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.557881 2591 leader_election.cc:290] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:12.558086 885 tablet_service.cc:1511] Processing CreateTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 (DEFAULT_TABLE table=default.Table_b73e814e84a84ab2a3c4234d82d96659 [id=728a6a9a274240f0b7a863d873beb19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.558055 2386 raft_consensus.cc:515] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.558127 891 tablet_service.cc:1511] Processing CreateTablet for tablet 51204502f2ff403e9e074d8a1b847aeb (DEFAULT_TABLE table=default.Table_aa13ddecf6574581b4989e7c33515014 [id=8ff2e5d64c6e42be87d24a22146b4f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.558893 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.559048 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.559381 745 tablet_service.cc:1511] Processing CreateTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 (DEFAULT_TABLE table=default.Table_b73e814e84a84ab2a3c4234d82d96659 [id=728a6a9a274240f0b7a863d873beb19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.559720 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b0b38c0024cf2ba0ff3d13f1d9276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.561174 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5ba5f770a448465491160fc72f66a830 (table default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616]). Expected version 1 got 0
I20260503 07:53:12.561173 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c631d3da8f4ec29690c548097a454b" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:12.561345 1049 raft_consensus.cc:3060] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:12.561395 741 tablet_service.cc:1511] Processing CreateTablet for tablet 48c66e254a0a4c21a5d8dfd54a37b089 (DEFAULT_TABLE table=default.Table_8eb570874fa640a1bcfca8fccf8b9ecb [id=51f32915723c4f89866de8c99aca02e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.561427 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b269ee59036d4c2f866b6b2bf45c35cf" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:12.561534 1048 raft_consensus.cc:3060] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:12.561662 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c66e254a0a4c21a5d8dfd54a37b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.557369 894 rpcz_store.cc:276] 0503 07:53:11.209791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.674615 (+464824us) service_pool.cc:224] Handling call
0503 07:53:11.674965 (+ 350us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.674986 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.156001 (+481015us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.363753 (+207752us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.380762 (+ 17009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.564509 743 tablet_service.cc:1511] Processing CreateTablet for tablet 7f523d718ae8475390f78cf2af6758da (DEFAULT_TABLE table=default.Table_c24b8806a2994e039df3e7eccf6ce8e5 [id=57a6761487c8401484b470a0ae814b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.564846 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f523d718ae8475390f78cf2af6758da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.568475 753 tablet_service.cc:1511] Processing CreateTablet for tablet bed04d8fa68f45ae95027851c14c20cb (DEFAULT_TABLE table=default.Table_ceab487f54e44095871c32ab5c84ac23 [id=f8c6f86947c046bc887f094cd090d84e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.568769 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed04d8fa68f45ae95027851c14c20cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.570884 2708 raft_consensus.cc:493] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.571017 2708 raft_consensus.cc:515] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.571585 2708 leader_election.cc:290] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:12.572542 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4e0954b14b3b420a9aebc96e192e0859" } modify_external_catalogs: true
I20260503 07:53:12.572573 747 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1885dda594c1f9c1039111af4ce9b (DEFAULT_TABLE table=default.Table_3811f4c1bc364be0bd601ca29c32140f [id=55bbc9fb8905404abd9fe4fb6621c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.572729 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4e0954b14b3b420a9aebc96e192e0859" } modify_external_catalogs: true
I20260503 07:53:12.572845 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1885dda594c1f9c1039111af4ce9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.574241 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_768f2bbd81ba4c42a44e594809b502c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.574720 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768f2bbd81ba4c42a44e594809b502c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.575727 716 leader_election.cc:304] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.576280 2608 raft_consensus.cc:2804] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:12.576359 2608 raft_consensus.cc:493] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:12.576428 2608 raft_consensus.cc:3060] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:12.576503 755 tablet_service.cc:1511] Processing CreateTablet for tablet d30ad713a05b41dd814d5787de7cff2f (DEFAULT_TABLE table=default.Table_6b08393d6dc448cb83b53551d377ee44 [id=28444fe333dc46cdacc546bf64e34c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.576812 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30ad713a05b41dd814d5787de7cff2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.579303 2608 raft_consensus.cc:515] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.580479 756 tablet_service.cc:1511] Processing CreateTablet for tablet 51204502f2ff403e9e074d8a1b847aeb (DEFAULT_TABLE table=default.Table_aa13ddecf6574581b4989e7c33515014 [id=8ff2e5d64c6e42be87d24a22146b4f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.580767 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51204502f2ff403e9e074d8a1b847aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.583815 2708 consensus_queue.cc:1048] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.584275 752 tablet_service.cc:1511] Processing CreateTablet for tablet e20b84490a354310b510a82b139bc773 (DEFAULT_TABLE table=default.Table_5eb67445b84f47009db70743ef0767ab [id=a2c2b322f764459a921413e6eff24e75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.584554 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b84490a354310b510a82b139bc773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.585667 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1005) took 1279 ms. Trace:
I20260503 07:53:12.585777 898 rpcz_store.cc:276] 0503 07:53:11.209162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.659827 (+450665us) service_pool.cc:224] Handling call
0503 07:53:11.660605 (+ 778us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.660630 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.369796 (+709166us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.479221 (+109425us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.488224 (+ 9003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.585688 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1003) took 1262 ms. Trace:
I20260503 07:53:12.587131 887 rpcz_store.cc:276] 0503 07:53:11.209055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.651598 (+442543us) service_pool.cc:224] Handling call
0503 07:53:11.651960 (+ 362us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.651979 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.209423 (+557444us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.373717 (+164294us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.471319 (+ 97602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.588951 2708 consensus_queue.cc:1048] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.589264 742 tablet_service.cc:1511] Processing CreateTablet for tablet 17db30b1109845d783ade7c4860a3d0d (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.589342 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e53d2641455c498bb608719816f52f01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:12.589533 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db30b1109845d783ade7c4860a3d0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.589779 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e53d2641455c498bb608719816f52f01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.592576 744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1038) took 1068 ms. Trace:
I20260503 07:53:12.592645 744 rpcz_store.cc:276] 0503 07:53:11.523749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.997011 (+473262us) service_pool.cc:224] Handling call
0503 07:53:12.167733 (+170722us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.167760 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.491763 (+324003us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.592436 (+100673us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.592561 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.592943 744 tablet_service.cc:1511] Processing CreateTablet for tablet 6076544a93644c69b3a9a8bb890bd1ef (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.593132 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:12.591320 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 78952.6us
W20260503 07:53:12.595985 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc3ba7562faa48159e7f09c1fbc37d6c consensus state has no leader
I20260503 07:53:12.597369 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbf179398734e63a0f92b0d60030276 (DEFAULT_TABLE table=default.Table_6b850b1ebc7545aa8ba22c0d794201b7 [id=d48bd45960de409dad0b9c75951049d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.598866 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e04055e3ddf94ea08fd1570c20730d94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.599315 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e04055e3ddf94ea08fd1570c20730d94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.604264 1049 raft_consensus.cc:2468] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:12.604414 761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1031) took 1397 ms. Trace:
I20260503 07:53:12.604528 761 rpcz_store.cc:276] 0503 07:53:11.206831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.750141 (+543310us) service_pool.cc:224] Handling call
0503 07:53:12.023125 (+272984us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.023145 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.482197 (+459052us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.506789 (+ 24592us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.604398 (+ 97609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8412}
I20260503 07:53:12.611114 757 tablet_service.cc:1511] Processing CreateTablet for tablet a7ea9b7a798a444eba3e65f32a7f7480 (DEFAULT_TABLE table=default.Table_77ad9b6ea12644dcab768e70974699c2 [id=0385edbce3734297afb7f047f893c584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.617859 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5c25b29188224fbe98ee8c6f6b7b956b
I20260503 07:53:12.618518 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_50c245acca104d69a65c531ca977cb1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.619043 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50c245acca104d69a65c531ca977cb1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.621083 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5d2f95e3ad844bc39593787e38a45bad
I20260503 07:53:12.621747 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_82323a14647f400dbb8478aa5bf61765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.622231 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82323a14647f400dbb8478aa5bf61765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.624825 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 3 got 0
I20260503 07:53:12.625061 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (table default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683]). Expected version 1 got 0
I20260503 07:53:12.625422 599 catalog_manager.cc:5671] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:12.626767 1166 raft_consensus.cc:385] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.626860 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1018) took 1170 ms. Trace:
I20260503 07:53:12.626986 880 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe55ee95698445c85753782b8b651b0 (DEFAULT_TABLE table=default.Table_86b5945e96354692b1e82b9786a64113 [id=560c4b32bde04160bda0cfecdd61a81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.627281 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 23b8c1768a15487ba9140acd77c4ff7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:12.629480 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a44b834b1e44a99c2cd3f9747ca13f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:12.630167 886 rpcz_store.cc:276] 0503 07:53:11.209737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.671410 (+461673us) service_pool.cc:224] Handling call
0503 07:53:11.671742 (+ 332us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.671765 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.146110 (+474345us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.347993 (+201883us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.382725 (+ 34732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.634603 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 70243e24ae17460f9d3e20720a9bfa53
I20260503 07:53:12.639217 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 9a7af140ce144bc8b2e147dad98ac201 (table default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd]). Expected version 2 got 0
I20260503 07:53:12.639581 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:12.641191 1048 raft_consensus.cc:2468] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:12.642388 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet df60413555764bcab464b18c6a3370ce (table default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a [id=80c5584e658b4237a6580fd0d0a05a0d]). Expected version 1 got 0
I20260503 07:53:12.643913 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1038) took 1122 ms. Trace:
I20260503 07:53:12.611591 746 tablet_service.cc:1511] Processing CreateTablet for tablet 04d4e35fd9e444b2ac1df70568e7928c (DEFAULT_TABLE table=default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.611811 761 tablet_service.cc:1511] Processing CreateTablet for tablet 5528f495ce534d989a0e370549c8f528 (DEFAULT_TABLE table=default.Table_80eb2da5ac354508bb67257f45284795 [id=59a3a0b1245a48ab8df6a3b4133ac6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.612617 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7336c1df59754cd58c0c290b84fc0d7a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:12.644587 778 raft_consensus.cc:2468] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:12.612805 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb8d47da511422d9665326520d35601" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:12.644840 775 raft_consensus.cc:2468] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:12.614207 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 (DEFAULT_TABLE table=default.Table_c36456e61be8471387364109939d3dcc [id=8647f634ac7743b88d5c1a88388f50c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.617036 743 tablet_service.cc:1511] Processing CreateTablet for tablet fe6cf63b7e3949d6b5854e5b47b9071e (DEFAULT_TABLE table=default.Table_003603bc65c441bb8dc35a78daf67dff [id=8ca200f7e65e48758ddc3f89e51e0065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.620553 752 tablet_service.cc:1511] Processing CreateTablet for tablet d489414214b041739b23e7e1c1cdec12 (DEFAULT_TABLE table=default.Table_28bca3d5b54a4c9fa87e96f0ff6ab6e2 [id=7bb7c2d4e5bd4405a97cc3dce84dfe92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.621322 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6076544a93644c69b3a9a8bb890bd1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.648489 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489414214b041739b23e7e1c1cdec12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.642654 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89fd388c703543638201c6d69055cb8b" } new_table_name: "default.Table_2c111e251d854bf1a12ad2cd232fb20b" modify_external_catalogs: true
I20260503 07:53:12.646647 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fad603dd15f545a999b6e45bcc20bafc
I20260503 07:53:12.652282 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbf179398734e63a0f92b0d60030276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.653095 599 catalog_manager.cc:5671] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:12.653539 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 2 got 0
I20260503 07:53:12.655748 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528f495ce534d989a0e370549c8f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.656586 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d4e35fd9e444b2ac1df70568e7928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.656713 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.657033 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 29fe06a56f70487ea7c479b107d83d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.658087 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.658392 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de65c754b47440a914f3f2bdb86059c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.653913 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0195509e330240618611fc0d78414554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.661923 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0195509e330240618611fc0d78414554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.667901 744 tablet_service.cc:1511] Processing CreateTablet for tablet fad603dd15f545a999b6e45bcc20bafc (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.667964 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3d38c214d66b4e5eae6ee88e7b29f1de" } new_table_name: "default.Table_93743494d55645b6a031d2577bb414fa" modify_external_catalogs: true
I20260503 07:53:12.671295 1171 tablet_bootstrap.cc:492] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:12.670307 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.672646 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2b12c2f3cbf74edc9caf98853272c8b4
I20260503 07:53:12.673202 1171 tablet_bootstrap.cc:654] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:12.675840 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c66e254a0a4c21a5d8dfd54a37b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.677421 2577 consensus_queue.cc:1048] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.682065 2577 consensus_queue.cc:1048] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.683372 2386 leader_election.cc:290] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.626561 911 rpcz_store.cc:276] 0503 07:53:11.145865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.145908 (+ 43us) service_pool.cc:224] Handling call
0503 07:53:11.145994 (+ 86us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:53:11.146120 (+ 126us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:53:11.146123 (+ 3us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:53:11.146302 (+ 179us) log.cc:844] Serialized 26 byte log entry
0503 07:53:12.173293 (+1026991us) raft_consensus.cc:1645] Marking committed up to 0
0503 07:53:12.173306 (+ 13us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:53:12.173340 (+ 34us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:53:12.368727 (+195387us) raft_consensus.cc:1685] finished
0503 07:53:12.368730 (+ 3us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:53:12.368770 (+ 40us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11483,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":66,"thread_start_us":1026903,"threads_started":1,"wal-append.queue_time_us":1184227}
I20260503 07:53:12.685292 986 leader_election.cc:304] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.685425 887 tablet_service.cc:1511] Processing CreateTablet for tablet 17db30b1109845d783ade7c4860a3d0d (DEFAULT_TABLE table=default.Table_a0ee731928df4482a308e4cbc95906ac [id=5ae27b893acb42e2b23287e58f9dadcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.685674 890 tablet_service.cc:1511] Processing CreateTablet for tablet d2f9d4b323284e6e8f172a04e35be881 (DEFAULT_TABLE table=default.Table_12ec486261344161bd8fcd5894291c74 [id=14dfa830ea4e45ebbe1f24f6df8c4e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.685809 2577 raft_consensus.cc:2804] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:12.685881 2577 raft_consensus.cc:493] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:12.685940 2577 raft_consensus.cc:3060] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:12.686025 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1031) took 1006 ms. Trace:
I20260503 07:53:12.686208 879 rpcz_store.cc:276] 0503 07:53:11.209110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.655118 (+446008us) service_pool.cc:224] Handling call
0503 07:53:11.655637 (+ 519us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.655658 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.238300 (+582642us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.492355 (+254055us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.494375 (+ 2020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.687109 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7f523d718ae8475390f78cf2af6758da (DEFAULT_TABLE table=default.Table_c24b8806a2994e039df3e7eccf6ce8e5 [id=57a6761487c8401484b470a0ae814b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.687381 883 rpcz_store.cc:276] 0503 07:53:11.209900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.683733 (+473833us) service_pool.cc:224] Handling call
0503 07:53:11.684214 (+ 481us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.684238 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.051145 (+366907us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.363927 (+312782us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.380652 (+ 16725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.687827 1166 raft_consensus.cc:740] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.688696 2577 raft_consensus.cc:515] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.688952 2704 raft_consensus.cc:493] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.689069 2704 raft_consensus.cc:515] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.689538 2704 leader_election.cc:290] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.689680 881 tablet_service.cc:1511] Processing CreateTablet for tablet 6076544a93644c69b3a9a8bb890bd1ef (DEFAULT_TABLE table=default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.690308 2577 leader_election.cc:290] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.690246 886 tablet_service.cc:1511] Processing CreateTablet for tablet 5528f495ce534d989a0e370549c8f528 (DEFAULT_TABLE table=default.Table_80eb2da5ac354508bb67257f45284795 [id=59a3a0b1245a48ab8df6a3b4133ac6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.693295 986 leader_election.cc:304] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.693661 2577 raft_consensus.cc:2764] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260503 07:53:12.693681 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f4fac070ce05432a81a7eb6efaee5edc" } new_table_name: "default.Table_2a2ba7d05cde4a33b4863edf9176611b" modify_external_catalogs: true
I20260503 07:53:12.694219 2577 consensus_queue.cc:1048] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.699769 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.700139 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.700572 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522 (DEFAULT_TABLE table=default.Table_3d38c214d66b4e5eae6ee88e7b29f1de [id=1f191aa0170c4877ac26446aa5c41d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.700973 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.700903 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c2a8057297cc4a16813a545fc2b947d4 (DEFAULT_TABLE table=default.Table_b3e78c443801484cacc0819e8ac0c7f0 [id=b59749fd3f0143bd94e616388c2bb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.701474 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a8057297cc4a16813a545fc2b947d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.630549 747 tablet_service.cc:1511] Processing CreateTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 (DEFAULT_TABLE table=default.Table_914d5e7cae5146b78cb18e6e57795d15 [id=077a23e89ad84e68a440250b623f46a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.633701 753 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9685434c3b4c898a254b09fefde69b (DEFAULT_TABLE table=default.Table_6243db5cd8c343a090334a84b493bf40 [id=cce2c80420f14c63b9d8a0b99248ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.640916 741 tablet_service.cc:1511] Processing CreateTablet for tablet f9972b0e56524fdbbd85e7431a312d9f (DEFAULT_TABLE table=default.Table_4a226e0c25d2475b97321d18bf53e6d1 [id=e7bed8e7277541f1bcd76d5cd0139d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.706489 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe55ee95698445c85753782b8b651b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.641911 754 tablet_service.cc:1511] Processing CreateTablet for tablet a129cc3aa6dd403bb3f420f9028046ab (DEFAULT_TABLE table=default.Table_83f3ee8f642e44b4b9b58e951c9f7300 [id=aff7710048fe49afa30429f71011001a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.706844 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbf179398734e63a0f92b0d60030276 (DEFAULT_TABLE table=default.Table_6b850b1ebc7545aa8ba22c0d794201b7 [id=d48bd45960de409dad0b9c75951049d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.642238 755 tablet_service.cc:1511] Processing CreateTablet for tablet d9269dd6a9af493a8452b7f657355933 (DEFAULT_TABLE table=default.Table_07967b4e81bd431e86edc76d6da158de [id=678c5f801ca849d8858ec5f4107cef3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.643630 742 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 (DEFAULT_TABLE table=default.Table_4e0954b14b3b420a9aebc96e192e0859 [id=3b3a0333a6f44fd893f3ae9b5a01570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.690033 882 rpcz_store.cc:276] 0503 07:53:11.521083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.193494 (+672411us) service_pool.cc:224] Handling call
0503 07:53:12.277908 (+ 84414us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.277946 (+ 38us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.549014 (+271068us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.643715 (+ 94701us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.643891 (+ 176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.671479 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6cf63b7e3949d6b5854e5b47b9071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.708153 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabfceb115aa4e78a4cb78ae081d0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.709031 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8787cb7c35ba4884a630ad89181b7728" } new_table_name: "default.Table_48c1743be4724061a60d812f3158090d" modify_external_catalogs: true
I20260503 07:53:12.711154 1017 tablet_service.cc:1511] Processing CreateTablet for tablet ad4fd383b31f46e3b02ab5356c791b57 (DEFAULT_TABLE table=default.Table_bba9ee7c0bd54a02ab254eb165cce98b [id=dfa2bd2e77e64385979fdd447e3cb403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.711493 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4fd383b31f46e3b02ab5356c791b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.712394 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dd6ab85112477c9f5c6ea99589f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.715123 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.715209 2715 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:12.715677 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f66af40676bd48ba90d4291de161d54f (DEFAULT_TABLE table=default.Table_5ec65f8fd71c412287af4b000577f35c [id=e18dbaf727e74e349717cd1b459a80bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.715811 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d2f95e3ad844bc39593787e38a45bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.715935 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66af40676bd48ba90d4291de161d54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.716070 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.716439 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet fad603dd15f545a999b6e45bcc20bafc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.717347 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2824974ab454c84172ec3d27e5aa5 (DEFAULT_TABLE table=default.Table_2cd812f25c7a4451a75b9bffc7add74b [id=630ecf139a494362ab56f948e28d6a8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.717656 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2824974ab454c84172ec3d27e5aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.719506 884 rpcz_store.cc:276] 0503 07:53:11.487474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.939382 (+451908us) service_pool.cc:224] Handling call
0503 07:53:11.974219 (+ 34837us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.974239 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.359978 (+385739us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.494000 (+134022us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.494121 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.719939 884 tablet_service.cc:1511] Processing CreateTablet for tablet fe6cf63b7e3949d6b5854e5b47b9071e (DEFAULT_TABLE table=default.Table_003603bc65c441bb8dc35a78daf67dff [id=8ca200f7e65e48758ddc3f89e51e0065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.720335 879 tablet_service.cc:1511] Processing CreateTablet for tablet a7ea9b7a798a444eba3e65f32a7f7480 (DEFAULT_TABLE table=default.Table_77ad9b6ea12644dcab768e70974699c2 [id=0385edbce3734297afb7f047f893c584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.721350 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e9d50a71c1a4bf799de34af1064597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.721565 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 314f539af5e44f048ff42619fcda1943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.721864 758 tablet_service.cc:1511] Processing CreateTablet for tablet b0c31cc44bea459081697fa3b17bb403 (DEFAULT_TABLE table=default.Table_13da6ea9ff3f422d9a7234c57ba92764 [id=67b0b0b7c0954efb9597c715d26be13e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.722220 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c31cc44bea459081697fa3b17bb403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.722255 1173 ts_tablet_manager.cc:1950] T ebec2b05025444ccaf0bf0bb4ab62dae P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:12.722536 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 893) took 4596 ms. Trace:
I20260503 07:53:12.722604 1173 rpcz_store.cc:276] 0503 07:53:08.126442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.126496 (+ 54us) service_pool.cc:224] Handling call
0503 07:53:11.611216 (+3484720us) ts_tablet_manager.cc:1151] Deleting tablet ebec2b05025444ccaf0bf0bb4ab62dae
0503 07:53:11.611227 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:11.694030 (+ 82803us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:11.760639 (+ 66609us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.722523 (+961884us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3484533}
I20260503 07:53:12.722919 1173 tablet_replica.cc:333] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:12.723098 1173 raft_consensus.cc:2243] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:12.723206 1173 raft_consensus.cc:2272] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.723660 1173 ts_tablet_manager.cc:1916] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.723876 2608 leader_election.cc:290] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:12.727098 758 tablet_service.cc:1511] Processing CreateTablet for tablet f87aab6151d34bb7b0efb00f5cfdf64e (DEFAULT_TABLE table=default.Table_747481a5826140bca2e4ed9b148c96bb [id=f53b4ea9a1c84be4bb1f2aec743aba68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.731024 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5c30f15ad13340c89df3f5c8d65d63c7 (table default.Table_0e7364b796a041c1a161bdb798b5a566 [id=c702cea458024924addda2925295d7f7]) successfully deleted
W20260503 07:53:12.731652 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 46dd100e06ff41be960b265b52d1c607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dd100e06ff41be960b265b52d1c607 already in progress: creating tablet
W20260503 07:53:12.732577 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f53a37806e414f16aa69294c0abad10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53a37806e414f16aa69294c0abad10a already in progress: creating tablet
W20260503 07:53:12.733222 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9c04763bb23b4c0f91df21eb0073095f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c04763bb23b4c0f91df21eb0073095f already in progress: creating tablet
I20260503 07:53:12.735392 1171 tablet_bootstrap.cc:492] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:12.735534 1171 ts_tablet_manager.cc:1403] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s
I20260503 07:53:12.736339 1171 raft_consensus.cc:359] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.736541 1171 raft_consensus.cc:385] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.736598 1171 raft_consensus.cc:740] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.737015 1171 consensus_queue.cc:260] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:12.741712 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3375914e0d14e709d3e81787bb7f0bc consensus state has no leader
I20260503 07:53:12.750723 1016 tablet_service.cc:1511] Processing CreateTablet for tablet c5691fe1fb1c476287c90f2ab4ff786b (DEFAULT_TABLE table=default.Table_2c645d37f74a43af81f917d309bd0cd8 [id=9649963741d74a7f9530255d4ced8e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.751291 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5691fe1fb1c476287c90f2ab4ff786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.753973 1166 consensus_queue.cc:260] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.754544 1166 ts_tablet_manager.cc:1434] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.235s user 0.001s sys 0.001s
I20260503 07:53:12.754833 1166 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:12.755585 883 tablet_service.cc:1511] Processing CreateTablet for tablet 04d4e35fd9e444b2ac1df70568e7928c (DEFAULT_TABLE table=default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.759475 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 36b6147bab7a44b19b4a22addf68961f (table default.Table_6c6fb8982f384ff7ac013f3de178378a [id=3d888bf2f21f4ebe977dc94daf24a8bc]) successfully deleted
I20260503 07:53:12.678192 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:12.681663 761 tablet_service.cc:1511] Processing CreateTablet for tablet 79d911c4eb994478ba633e5194ddb343 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.684607 759 tablet_service.cc:1511] Processing CreateTablet for tablet cc933a07094146b1ad0c2949188c3470 (DEFAULT_TABLE table=default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.696671 746 tablet_service.cc:1511] Processing CreateTablet for tablet e93d2f3321bb4a018c1798eeef92abac (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.762028 854 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: e16d225dde3247d1b61a03cf14b21d63
W20260503 07:53:12.762189 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 55723.7us
I20260503 07:53:12.762748 909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:12.763036 1175 ts_tablet_manager.cc:1929] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260503 07:53:12.697201 716 leader_election.cc:343] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.704526 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 890) took 5472 ms. Trace:
I20260503 07:53:12.704680 750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1034) took 1493 ms. Trace:
I20260503 07:53:12.763278 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:12.763293 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 66098.3us
I20260503 07:53:12.763319 750 rpcz_store.cc:276] 0503 07:53:11.211424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.759133 (+547709us) service_pool.cc:224] Handling call
0503 07:53:12.056351 (+297218us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.056375 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.484224 (+427849us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.507431 (+ 23207us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.704668 (+197237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834}
I20260503 07:53:12.763546 716 leader_election.cc:304] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.763830 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0708cababc844e51ab7da2950664c2c5 (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.763940 716 leader_election.cc:304] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.763293 1174 rpcz_store.cc:276] 0503 07:53:07.232539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.236235 (+ 3696us) service_pool.cc:224] Handling call
0503 07:53:12.044779 (+4808544us) ts_tablet_manager.cc:1151] Deleting tablet aef746161e6b446ab0d299d37e2151ea
0503 07:53:12.044788 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.502168 (+457380us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.507095 (+ 4927us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.704510 (+197415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4619567}
I20260503 07:53:12.764266 2708 raft_consensus.cc:2804] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:12.764349 2709 raft_consensus.cc:2804] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:12.764381 2708 raft_consensus.cc:697] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:12.764434 2709 raft_consensus.cc:697] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:12.764458 1174 tablet_replica.cc:333] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:12.764622 1174 raft_consensus.cc:2243] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:12.764592 2709 consensus_queue.cc:237] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:12.764755 1174 raft_consensus.cc:2272] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.765260 1174 ts_tablet_manager.cc:1916] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.764592 2708 consensus_queue.cc:237] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.766057 894 tablet_service.cc:1511] Processing CreateTablet for tablet e20b84490a354310b510a82b139bc773 (DEFAULT_TABLE table=default.Table_5eb67445b84f47009db70743ef0767ab [id=a2c2b322f764459a921413e6eff24e75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.704802 748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1029) took 1498 ms. Trace:
I20260503 07:53:12.766280 748 rpcz_store.cc:276] 0503 07:53:11.206685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.733497 (+526812us) service_pool.cc:224] Handling call
0503 07:53:11.733853 (+ 356us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:11.733870 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.492136 (+758266us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.521349 (+ 29213us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.704792 (+183443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.766788 748 tablet_service.cc:1511] Processing CreateTablet for tablet aba38ebd9cdc4c0b927806d25d803b87 (DEFAULT_TABLE table=default.Table_f3b781f9a01a481aa77e60f9a1d8167b [id=538675a2fe6b419090d467d8b08244ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.705288 1165 tablet_bootstrap.cc:492] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:12.728396 760 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1046) took 1202 ms. Trace:
W20260503 07:53:12.767624 851 service_pool.cc:136] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items
I20260503 07:53:12.767522 760 rpcz_store.cc:276] 0503 07:53:11.526243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.530522 (+1004279us) service_pool.cc:224] Handling call
0503 07:53:12.704856 (+174334us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.704887 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.710923 (+ 6036us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.728267 (+ 17344us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.728383 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.768319 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d5a84f62f446c488a7e02be814a26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.767699 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1064)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1065)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1066)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1067)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1068)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1069)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1070)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1071)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1072)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1073)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1074)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
I20260503 07:53:12.769196 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1bf42130a55744429d2c64ed55671507 (table default.Table_b64bdadb494f4a1d891b00d815f6bd1f [id=e51beedee3de425899d8e131b58e7b0a]) successfully deleted
I20260503 07:53:12.769613 760 tablet_service.cc:1511] Processing CreateTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de (DEFAULT_TABLE table=default.Table_7c59ab3fec2f4ed787f9260a16901b85 [id=7b10bd6b69dc46ffbd4e48d62aec01de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.769189 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1064)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1065)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1066)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1067)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1068)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1069)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1070)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1071)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1072)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1073)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1074)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
I20260503 07:53:12.728582 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9972b0e56524fdbbd85e7431a312d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.770961 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708cababc844e51ab7da2950664c2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.770489 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1064)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1065)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1066)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1067)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1068)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1069)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1070)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1071)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1072)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1073)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1074)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
I20260503 07:53:12.773110 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23434f3d8f44e581c2ed73aa045d96 (DEFAULT_TABLE table=default.Table_c36456e61be8471387364109939d3dcc [id=8647f634ac7743b88d5c1a88388f50c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.778962 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 471d979edca2476bb5787319a442603a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:12.765802 715 leader_election.cc:343] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:12.781716 715 leader_election.cc:343] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:12.781831 715 leader_election.cc:304] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:12.782522 2690 raft_consensus.cc:2749] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:12.779158 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba38ebd9cdc4c0b927806d25d803b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.783813 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fad9f90b3ee34de9b2d5c689b8e20608"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.784341 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fad9f90b3ee34de9b2d5c689b8e20608 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.780552 1165 tablet_bootstrap.cc:654] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:12.787070 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d2aa55fb8d042e0ad24bcc25ddcf522 consensus state has no leader
W20260503 07:53:12.787473 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52f0f9d823134a7e87f3f4b6af7211a3 consensus state has no leader
I20260503 07:53:12.790171 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e25655dbf11749b3887a71e4b6f5aa17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.790712 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e25655dbf11749b3887a71e4b6f5aa17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.792034 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_04db65b076f54c28b6b7712c3f86c5e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.792718 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04db65b076f54c28b6b7712c3f86c5e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.794948 1174 ts_tablet_manager.cc:1929] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:12.797744 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3d89f1787e5a40f48708c777ff164671" } new_table_name: "default.Table_1f3645e996e04ee4ab3731d4cfc21ef3" modify_external_catalogs: true
I20260503 07:53:12.804448 1174 log.cc:1199] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/8ffec630db9a430fa3006268b0e28fcd
I20260503 07:53:12.804843 1174 ts_tablet_manager.cc:1950] T 8ffec630db9a430fa3006268b0e28fcd P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:12.805305 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 898) took 5349 ms. Trace:
I20260503 07:53:12.805683 2386 raft_consensus.cc:493] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.805843 2386 raft_consensus.cc:515] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:12.806581 2386 leader_election.cc:290] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:12.807577 854 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:12.810910 1174 rpcz_store.cc:276] 0503 07:53:07.456109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.456166 (+ 57us) service_pool.cc:224] Handling call
0503 07:53:12.764400 (+5308234us) ts_tablet_manager.cc:1151] Deleting tablet 8ffec630db9a430fa3006268b0e28fcd
0503 07:53:12.764408 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.781363 (+ 16955us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.794903 (+ 13540us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.805291 (+ 10388us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5307697}
I20260503 07:53:12.811506 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 899) took 5337 ms. Trace:
I20260503 07:53:12.811636 1174 rpcz_store.cc:276] 0503 07:53:07.474491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.474548 (+ 57us) service_pool.cc:224] Handling call
0503 07:53:12.811389 (+5336841us) ts_tablet_manager.cc:1151] Deleting tablet a328057ceb3640d1a26b773862492f04
0503 07:53:12.811398 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.811490 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5336665}
I20260503 07:53:12.812016 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 900) took 5333 ms. Trace:
I20260503 07:53:12.812275 1174 rpcz_store.cc:276] 0503 07:53:07.479049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.479096 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:12.811918 (+5332822us) ts_tablet_manager.cc:1151] Deleting tablet 2df2ed7d2563487aa15fe917b3fcf313
0503 07:53:12.811927 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.812000 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5332557}
I20260503 07:53:12.812907 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 902) took 5320 ms. Trace:
I20260503 07:53:12.813019 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1044) took 1078 ms. Trace:
I20260503 07:53:12.813516 1174 rpcz_store.cc:276] 0503 07:53:07.492468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.496389 (+ 3921us) service_pool.cc:224] Handling call
0503 07:53:12.812812 (+5316423us) ts_tablet_manager.cc:1151] Deleting tablet acbfff84673541929083cbc13b059398
0503 07:53:12.812821 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.812887 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5316249}
I20260503 07:53:12.814252 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 901) took 5321 ms. Trace:
I20260503 07:53:12.814878 1174 rpcz_store.cc:276] 0503 07:53:07.492351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.496634 (+ 4283us) service_pool.cc:224] Handling call
0503 07:53:12.814147 (+5317513us) ts_tablet_manager.cc:1151] Deleting tablet 9aa3759511d942bfbc6e50ea2e2f2777
0503 07:53:12.814156 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.814238 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5317405}
W20260503 07:53:12.815620 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 consensus state has no leader
I20260503 07:53:12.801394 748 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3fcabe72ad45feb71819ee22240c2e (DEFAULT_TABLE table=default.Table_77e114a37f6a4981b4a113bb290dcfdd [id=72f5acd8c7514c33a259661e1e2e4dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.628738 745 tablet_service.cc:1511] Processing CreateTablet for tablet a401317bf551401990260fa0419fd924 (DEFAULT_TABLE table=default.Table_2037b66d5de74f39bdb3761dc0ec5729 [id=fa8dcd07127c429d81e390fdb05307d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.803221 750 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6f24fda1c420d96ab75621d8015e4 (DEFAULT_TABLE table=default.Table_a0c51bdaabce48edbfa6d0abb9d1b5fc [id=fcee9c6410284246b9687cb2bb6f184e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.807821 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8774ffc66c854bcd8d8f394b9bc8a0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.819027 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401317bf551401990260fa0419fd924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.821806 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6f24fda1c420d96ab75621d8015e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.821813 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0" } modify_external_catalogs: true
I20260503 07:53:12.822010 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e37aad1c31b4ea4bc47ec7bcabac6a0" } modify_external_catalogs: true
I20260503 07:53:12.816056 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.816306 909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:12.822294 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51204502f2ff403e9e074d8a1b847aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.824281 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3fcabe72ad45feb71819ee22240c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.824335 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256" } modify_external_catalogs: true
I20260503 07:53:12.824489 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256" } modify_external_catalogs: true
I20260503 07:53:12.825935 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d4e35fd9e444b2ac1df70568e7928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.830143 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ed1a600ee44c1a9f6e292567e85f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.830405 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db30b1109845d783ade7c4860a3d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.830749 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b84490a354310b510a82b139bc773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.830938 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b0b38c0024cf2ba0ff3d13f1d9276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.831136 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6cf63b7e3949d6b5854e5b47b9071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.831393 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dd6ab85112477c9f5c6ea99589f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.831657 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23434f3d8f44e581c2ed73aa045d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.831830 1173 ts_tablet_manager.cc:1929] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:12.832024 1173 log.cc:1199] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:12.832077 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbf179398734e63a0f92b0d60030276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.832423 1173 ts_tablet_manager.cc:1950] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:12.834420 750 tablet_service.cc:1558] Processing DeleteTablet for tablet bda89822863d4f70bc6f115dc2f808c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.834118 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6076544a93644c69b3a9a8bb890bd1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.837322 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 894) took 4710 ms. Trace:
I20260503 07:53:12.839143 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aac5c556de2b4e90b839a1466013cd86" } modify_external_catalogs: true
I20260503 07:53:12.839357 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aac5c556de2b4e90b839a1466013cd86" } modify_external_catalogs: true
I20260503 07:53:12.789564 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3152281bf44946a4ae806f253ecd85" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:12.840878 1050 raft_consensus.cc:3060] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:12.794706 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5d55b39bcf4195a55edce71e37aa0a (DEFAULT_TABLE table=default.Table_5d7ddac49c474eacb06291a067c7aa8f [id=e2395e1f7dbb49018f744f933033297d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.843051 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5d55b39bcf4195a55edce71e37aa0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.843489 1173 rpcz_store.cc:276] 0503 07:53:08.127107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.127156 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:12.722884 (+4595728us) ts_tablet_manager.cc:1151] Deleting tablet e16d225dde3247d1b61a03cf14b21d63
0503 07:53:12.722891 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.828900 (+106009us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.831784 (+ 2884us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.837276 (+ 5492us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4595555}
I20260503 07:53:12.843791 1173 tablet_replica.cc:333] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:12.840371 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f9d4b323284e6e8f172a04e35be881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.824677 893 rpcz_store.cc:276] 0503 07:53:11.629031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.380573 (+751542us) service_pool.cc:224] Handling call
0503 07:53:12.388451 (+ 7878us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.388476 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.564113 (+175637us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.707072 (+142959us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.707214 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.844350 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ea9b7a798a444eba3e65f32a7f7480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.844924 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f523d718ae8475390f78cf2af6758da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.795281 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 759f0cc8b2c4440fa2830087ffe38d8f (DEFAULT_TABLE table=default.Table_f6d4a870eb2047848f1d4f7f62272c05 [id=3d96ed696d7546a6a97a0b7ac923a432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.795982 2421 raft_consensus.cc:493] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.848389 2421 raft_consensus.cc:515] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.848565 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759f0cc8b2c4440fa2830087ffe38d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.848989 2421 leader_election.cc:290] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.850301 1173 raft_consensus.cc:2243] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:12.850554 1173 raft_consensus.cc:2272] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.851209 1173 ts_tablet_manager.cc:1916] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.799602 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.853818 1175 log.cc:1199] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/4f6c9fb96d5a4397b51611254be1a970
I20260503 07:53:12.853827 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89444261c7144001b844a9846d28eadf" } modify_external_catalogs: true
I20260503 07:53:12.854046 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_89444261c7144001b844a9846d28eadf" } modify_external_catalogs: true
I20260503 07:53:12.854334 1175 ts_tablet_manager.cc:1950] T 4f6c9fb96d5a4397b51611254be1a970 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:12.854691 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 970) took 5048 ms. Trace:
I20260503 07:53:12.854794 1175 rpcz_store.cc:276] 0503 07:53:07.806164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.806323 (+ 159us) service_pool.cc:224] Handling call
0503 07:53:12.470835 (+4664512us) ts_tablet_manager.cc:1151] Deleting tablet 4f6c9fb96d5a4397b51611254be1a970
0503 07:53:12.470843 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.662663 (+191820us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.762977 (+100314us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.854676 (+ 91699us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4664274}
I20260503 07:53:12.855242 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 973) took 4965 ms. Trace:
I20260503 07:53:12.855358 1175 rpcz_store.cc:276] 0503 07:53:07.889687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.889734 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:12.855153 (+4965419us) ts_tablet_manager.cc:1151] Deleting tablet 3be0ae78ada34cd88debca569b77d24a
0503 07:53:12.855162 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.855226 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4955443}
I20260503 07:53:12.855710 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 974) took 4941 ms. Trace:
I20260503 07:53:12.855821 1175 rpcz_store.cc:276] 0503 07:53:07.914198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.914326 (+ 128us) service_pool.cc:224] Handling call
0503 07:53:12.855610 (+4941284us) ts_tablet_manager.cc:1151] Deleting tablet 82f5e16014a34ab9a125d62c72cf2c00
0503 07:53:12.855618 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.855695 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4941140}
I20260503 07:53:12.856142 1175 tablet_replica.cc:333] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:12.856410 1175 raft_consensus.cc:2243] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:12.856721 1175 raft_consensus.cc:2272] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.773521 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1064)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1065)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1066)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1067)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1068)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1069)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1070)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1071)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1072)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1073)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1074)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
I20260503 07:53:12.857614 893 tablet_service.cc:1511] Processing CreateTablet for tablet d489414214b041739b23e7e1c1cdec12 (DEFAULT_TABLE table=default.Table_28bca3d5b54a4c9fa87e96f0ff6ab6e2 [id=7bb7c2d4e5bd4405a97cc3dce84dfe92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.862614 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_128e633d864f4d9bac761565fd8d18ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.863219 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_128e633d864f4d9bac761565fd8d18ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:12.864897 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6 consensus state has no leader
I20260503 07:53:12.865267 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed04d8fa68f45ae95027851c14c20cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.865839 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528f495ce534d989a0e370549c8f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.869634 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e63ee58b76a24cdc9b701f44aad4d707
I20260503 07:53:12.875115 883 tablet_service.cc:1511] Processing CreateTablet for tablet a401317bf551401990260fa0419fd924 (DEFAULT_TABLE table=default.Table_2037b66d5de74f39bdb3761dc0ec5729 [id=fa8dcd07127c429d81e390fdb05307d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.877014 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c24b8806a2994e039df3e7eccf6ce8e5" } modify_external_catalogs: true
I20260503 07:53:12.877213 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c24b8806a2994e039df3e7eccf6ce8e5" } modify_external_catalogs: true
I20260503 07:53:12.877741 2386 raft_consensus.cc:493] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.877904 2386 raft_consensus.cc:515] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.878603 2386 leader_election.cc:290] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.878815 1166 tablet_bootstrap.cc:654] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:12.880216 854 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:12.888849 1175 ts_tablet_manager.cc:1916] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.889375 1050 raft_consensus.cc:2468] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:12.857394 2700 raft_consensus.cc:493] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.889629 2700 raft_consensus.cc:515] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.890501 2700 leader_election.cc:290] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.891069 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a6bd577980624ffeaf6eff8a9c1120f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.891682 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6bd577980624ffeaf6eff8a9c1120f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.903324 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 6a2a1079ce0e4e6da9779ccd401e98f9 (table default.Table_4e725c831ebf41f09d1bfa49fa3570be [id=13495e62b3a2443480b02bdc1d474cb6]) successfully deleted
W20260503 07:53:12.903760 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 437d8b148ade443790f5c42c7d955f48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437d8b148ade443790f5c42c7d955f48 already in progress: creating tablet
I20260503 07:53:12.905121 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87ef1230f42d4b7799cc13d03622ec6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.905696 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87ef1230f42d4b7799cc13d03622ec6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.905755 2700 raft_consensus.cc:493] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.905879 2700 raft_consensus.cc:515] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.906597 2700 leader_election.cc:290] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:12.907181 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 30c917e1bc514bcbb859340f9ef99f3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c917e1bc514bcbb859340f9ef99f3b already in progress: creating tablet
W20260503 07:53:12.907572 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6ae4a8f39d67459dbb80c72947ae7005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae4a8f39d67459dbb80c72947ae7005 already in progress: creating tablet
I20260503 07:53:12.835032 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ea9b7a798a444eba3e65f32a7f7480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.912520 750 tablet_service.cc:1511] Processing CreateTablet for tablet 14b67fc66ebf40a6b726a76ed813fb24 (DEFAULT_TABLE table=default.Table_9bbe84e829814d7fb2d44abbb8fa0a5a [id=4050ca030274435a9df51ec81f4b40b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.912971 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b67fc66ebf40a6b726a76ed813fb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.729105 751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46968 (request call id 1045) took 1202 ms. Trace:
I20260503 07:53:12.916261 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93d2f3321bb4a018c1798eeef92abac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.916258 751 rpcz_store.cc:276] 0503 07:53:11.526155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.045306 (+519151us) service_pool.cc:224] Handling call
0503 07:53:12.198912 (+153606us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.198960 (+ 48us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.360901 (+161941us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.506872 (+145971us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.729088 (+222216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.916770 751 tablet_service.cc:1511] Processing CreateTablet for tablet 00535762e832485c987b735c7d6d0671 (DEFAULT_TABLE table=default.Table_fb8eef4fe222404da1bcd56830523881 [id=7d8f1a3e725146cd8e833ef42dd67459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.917044 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00535762e832485c987b735c7d6d0671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.920101 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 4f6c9fb96d5a4397b51611254be1a970 (table default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]) successfully deleted
I20260503 07:53:12.845670 745 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ea60ce7a14842b6cdab25e9f0d150 (DEFAULT_TABLE table=default.Table_71186bdc93b245dfa138e23897bdba05 [id=2eb015e5ab4a47c996f24a1aa4adc268]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:12.920454 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3be0ae78ada34cd88debca569b77d24a because the tablet was not found. No further retry: Not found: Tablet not found: 3be0ae78ada34cd88debca569b77d24a
I20260503 07:53:12.920639 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ea60ce7a14842b6cdab25e9f0d150. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.920686 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 82f5e16014a34ab9a125d62c72cf2c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82f5e16014a34ab9a125d62c72cf2c00 already in progress: creating tablet
I20260503 07:53:12.920890 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad603dd15f545a999b6e45bcc20bafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.920993 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.850410 760 tablet_service.cc:1511] Processing CreateTablet for tablet 3d52b85a5cd74d2385814258399ca2d2 (DEFAULT_TABLE table=default.Table_b87484809fe040a2bd35bf2b9a44344d [id=543a2ecec75b4b769b39427ff6196f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.921101 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea2727074984065bc603363e2b62cb8 (DEFAULT_TABLE table=default.Table_15308a97428e45e8ba696da09885250b [id=e1ed2a0e4091462289ea5d157e4e01ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.921291 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d52b85a5cd74d2385814258399ca2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.922560 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 0516484f0ffd41b383f20a7bad1cb72c (DEFAULT_TABLE table=default.Table_4c1d216c3b5b4d10b263944d20c92d5a [id=2a2747efc75744cd9f324da9768ac006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.815651 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 903) took 5309 ms. Trace:
I20260503 07:53:12.924239 1174 rpcz_store.cc:276] 0503 07:53:07.506672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.506717 (+ 45us) service_pool.cc:224] Handling call
0503 07:53:12.815561 (+5308844us) ts_tablet_manager.cc:1151] Deleting tablet 17b58e042a6442658d95d373409fa25e
0503 07:53:12.815568 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.815637 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5308676}
I20260503 07:53:12.924400 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d911c4eb994478ba633e5194ddb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.924520 1174 tablet_replica.cc:333] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:12.924685 1174 raft_consensus.cc:2243] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:12.924829 1174 raft_consensus.cc:2272] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.925323 1174 ts_tablet_manager.cc:1916] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:12.926616 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d4b95589e7ea46c792a7f069992951a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.927166 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4b95589e7ea46c792a7f069992951a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.928534 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23434f3d8f44e581c2ed73aa045d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.929145 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d68d813a0dbc41d092cf879d68d6ef5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.929595 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d68d813a0dbc41d092cf879d68d6ef5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.932473 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a129cc3aa6dd403bb3f420f9028046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.934525 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d7b1b9c33424c509c2224c3d4266ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.934916 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d7b1b9c33424c509c2224c3d4266ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.935899 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87aab6151d34bb7b0efb00f5cfdf64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.936411 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9269dd6a9af493a8452b7f657355933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.884965 741 tablet_service.cc:1511] Processing CreateTablet for tablet c7af8a51b1de45b2a3cc539770e1b3dd (DEFAULT_TABLE table=default.Table_366b3b6108d9462c9b51f0c3ef634dbc [id=4e484bba1e654dd180dc6770eee34cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.885936 1165 tablet_bootstrap.cc:492] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:12.940414 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7af8a51b1de45b2a3cc539770e1b3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.940517 1165 ts_tablet_manager.cc:1403] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.235s user 0.002s sys 0.012s
I20260503 07:53:12.941275 1165 raft_consensus.cc:359] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.941424 1165 raft_consensus.cc:385] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:12.941469 1165 raft_consensus.cc:740] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:12.941650 1165 consensus_queue.cc:260] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.942123 1165 ts_tablet_manager.cc:1434] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:12.942631 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994d9de9bf5b4dfa9157f84ccd59e294. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.945010 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0a269a12729549469f86e184e2ed7e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a269a12729549469f86e184e2ed7e86 already in progress: creating tablet
W20260503 07:53:12.945371 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet cec0b36fdcf64042bc87446977b9dcca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cec0b36fdcf64042bc87446977b9dcca already in progress: creating tablet
W20260503 07:53:12.945693 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0e47796d8f924117bcc5dcc5cf958874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e47796d8f924117bcc5dcc5cf958874 already in progress: creating tablet
W20260503 07:53:12.946018 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 801e48526d634222875678f56ce00cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801e48526d634222875678f56ce00cfe already in progress: creating tablet
W20260503 07:53:12.947211 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0a67c4565c4c4c35bb54cd047258be07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a67c4565c4c4c35bb54cd047258be07 already in progress: creating tablet
I20260503 07:53:12.947947 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.948598 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc933a07094146b1ad0c2949188c3470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.952332 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12c2f3cbf74edc9caf98853272c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.954015 2741 consensus_queue.cc:1048] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:12.957063 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2727074984065bc603363e2b62cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.959719 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9685434c3b4c898a254b09fefde69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.962055 1171 ts_tablet_manager.cc:1434] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.226s user 0.003s sys 0.000s
I20260503 07:53:12.963366 1171 tablet_bootstrap.cc:492] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:12.964843 1171 tablet_bootstrap.cc:654] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:12.965001 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1051) took 1054 ms. Trace:
I20260503 07:53:12.965349 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0516484f0ffd41b383f20a7bad1cb72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.965728 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e5283673660476eb689d41ef0daa2d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.965971 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b0edcd3617b4c73a419b382492a23aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:12.969388 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 001ded76f1894772898cb660e501984d
I20260503 07:53:12.969455 1175 ts_tablet_manager.cc:1929] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260503 07:53:12.969616 1175 log.cc:1199] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/766799446d1a480ca04246b0aec14852
I20260503 07:53:12.970075 1175 ts_tablet_manager.cc:1950] T 766799446d1a480ca04246b0aec14852 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:12.970060 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_86b5945e96354692b1e82b9786a64113" } new_table_name: "default.Table_6f4c0a8ba06a4e8eb3c82b0c093000e2" modify_external_catalogs: true
I20260503 07:53:12.970515 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 975) took 5035 ms. Trace:
I20260503 07:53:12.970669 1175 rpcz_store.cc:276] 0503 07:53:07.934842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.934891 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:12.856103 (+4921212us) ts_tablet_manager.cc:1151] Deleting tablet 766799446d1a480ca04246b0aec14852
0503 07:53:12.856113 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.916700 (+ 60587us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.969401 (+ 52701us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.970497 (+ 1096us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4921061}
I20260503 07:53:12.971458 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 976) took 5024 ms. Trace:
I20260503 07:53:12.971612 1175 rpcz_store.cc:276] 0503 07:53:07.947190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.947239 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:12.971264 (+5024025us) ts_tablet_manager.cc:1151] Deleting tablet 5f7d50c1575341bca6673a3cd887415e
0503 07:53:12.971275 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.971420 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5023840}
I20260503 07:53:12.972052 1175 tablet_replica.cc:333] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:12.972393 1175 raft_consensus.cc:2243] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:12.972445 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dad4408db9eb47c9bb925fb66b7d8b8b
I20260503 07:53:12.972726 1175 raft_consensus.cc:2272] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:12.973176 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_456974f93b2c49cd8e91e745926dc00d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:12.973659 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_456974f93b2c49cd8e91e745926dc00d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:12.982515 1033 tablet_service.cc:1511] Processing CreateTablet for tablet af91a12968604fc795239b1141f9fa10 (DEFAULT_TABLE table=default.Table_7ffb7ee3ef9848d2860e3ae82ed1e12b [id=e3b71e5427154b3a89f1df4784e69198]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.982903 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af91a12968604fc795239b1141f9fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.983788 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.984112 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 001ded76f1894772898cb660e501984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:12.888221 748 tablet_service.cc:1511] Processing CreateTablet for tablet a4797d5bc24e4b65b75ef83907efdba7 (DEFAULT_TABLE table=default.Table_41739ba8d4404bafad498d6d58f810ec [id=0acca61592e54dfa9a4ee3a9deb313d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.890789 716 leader_election.cc:304] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:12.895857 715 consensus_peers.cc:597] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:12.988659 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 92836us
W20260503 07:53:12.988795 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 98038.6us
I20260503 07:53:12.989368 2565 raft_consensus.cc:2804] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:12.989502 2565 raft_consensus.cc:697] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:12.989753 2565 consensus_queue.cc:237] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.995047 2386 raft_consensus.cc:493] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:12.995211 2386 raft_consensus.cc:515] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:12.995749 2386 leader_election.cc:290] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:12.996734 907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.900147 743 tablet_service.cc:1511] Processing CreateTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 (DEFAULT_TABLE table=default.Table_89444261c7144001b844a9846d28eadf [id=517b9c969c9c42858e00a31ce6224e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.997980 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbede2c323a420b8a0ca2434d4ad5b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:12.998036 715 consensus_peers.cc:597] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:12.998622 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1037) took 1382 ms. Trace:
I20260503 07:53:12.998767 897 rpcz_store.cc:276] 0503 07:53:11.512671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.142569 (+629898us) service_pool.cc:224] Handling call
0503 07:53:12.557696 (+415127us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.557726 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.892651 (+334925us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.895061 (+ 2410us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.895193 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.999294 897 tablet_service.cc:1511] Processing CreateTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 (DEFAULT_TABLE table=default.Table_914d5e7cae5146b78cb18e6e57795d15 [id=077a23e89ad84e68a440250b623f46a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.999655 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1048) took 1316 ms. Trace:
I20260503 07:53:12.999810 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:12.999814 885 rpcz_store.cc:276] 0503 07:53:11.629266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.387573 (+758307us) service_pool.cc:224] Handling call
0503 07:53:12.558294 (+170721us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.558311 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.899824 (+341513us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.945824 (+ 46000us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.946027 (+ 203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:12.890636 752 tablet_service.cc:1511] Processing CreateTablet for tablet f7b0ba340aa94ea78c2a0982d65e129f (DEFAULT_TABLE table=default.Table_02afbc612ef24400bc2f6df2dee7d796 [id=985d8a73178745128f1c92dc85793684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.000142 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489414214b041739b23e7e1c1cdec12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.970363 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522 (DEFAULT_TABLE table=default.Table_3d38c214d66b4e5eae6ee88e7b29f1de [id=1f191aa0170c4877ac26446aa5c41d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.973078 1174 ts_tablet_manager.cc:1929] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:13.000437 1174 log.cc:1199] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3be0ae78ada34cd88debca569b77d24a
I20260503 07:53:13.000516 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b0ba340aa94ea78c2a0982d65e129f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.000509 885 tablet_service.cc:1511] Processing CreateTablet for tablet d9269dd6a9af493a8452b7f657355933 (DEFAULT_TABLE table=default.Table_07967b4e81bd431e86edc76d6da158de [id=678c5f801ca849d8858ec5f4107cef3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.000823 1174 ts_tablet_manager.cc:1950] T 3be0ae78ada34cd88debca569b77d24a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:13.000841 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9269dd6a9af493a8452b7f657355933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.975353 745 tablet_service.cc:1511] Processing CreateTablet for tablet c2a8057297cc4a16813a545fc2b947d4 (DEFAULT_TABLE table=default.Table_b3e78c443801484cacc0819e8ac0c7f0 [id=b59749fd3f0143bd94e616388c2bb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.975531 1165 tablet_bootstrap.cc:492] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:13.002569 1165 tablet_bootstrap.cc:654] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:12.977749 756 tablet_service.cc:1511] Processing CreateTablet for tablet ad4fd383b31f46e3b02ab5356c791b57 (DEFAULT_TABLE table=default.Table_bba9ee7c0bd54a02ab254eb165cce98b [id=dfa2bd2e77e64385979fdd447e3cb403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.999382 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1043) took 1370 ms. Trace:
I20260503 07:53:13.005599 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.006278 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4fd383b31f46e3b02ab5356c791b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.008148 1175 ts_tablet_manager.cc:1916] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.019822 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4797d5bc24e4b65b75ef83907efdba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:12.980604 744 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2824974ab454c84172ec3d27e5aa5 (DEFAULT_TABLE table=default.Table_2cd812f25c7a4451a75b9bffc7add74b [id=630ecf139a494362ab56f948e28d6a8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.982048 754 tablet_service.cc:1511] Processing CreateTablet for tablet f66af40676bd48ba90d4291de161d54f (DEFAULT_TABLE table=default.Table_5ec65f8fd71c412287af4b000577f35c [id=e18dbaf727e74e349717cd1b459a80bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.984329 755 tablet_service.cc:1511] Processing CreateTablet for tablet 0516484f0ffd41b383f20a7bad1cb72c (DEFAULT_TABLE table=default.Table_4c1d216c3b5b4d10b263944d20c92d5a [id=2a2747efc75744cd9f324da9768ac006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.948117 747 tablet_service.cc:1558] Processing DeleteTablet for tablet b56ee573586b49d596592c32c509969f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.026806 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 7cead0c0237b4360bc84c661deaf7dd9 (DEFAULT_TABLE table=default.Table_36da2c59317c4f3bb4c2b3b203f298b7 [id=62773f34d971442b89b2bb86e127109f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:12.967653 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:13.030591 988 leader_election.cc:343] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:13.030858 988 leader_election.cc:343] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.044241 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 904) took 5489 ms. Trace:
I20260503 07:53:13.044358 1174 rpcz_store.cc:276] 0503 07:53:07.555192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.555248 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:12.924483 (+5369235us) ts_tablet_manager.cc:1151] Deleting tablet 3be0ae78ada34cd88debca569b77d24a
0503 07:53:12.924491 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.927966 (+ 3475us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.973032 (+ 45066us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.044217 (+ 71185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5369025}
I20260503 07:53:13.044973 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a8057297cc4a16813a545fc2b947d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.045142 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 907) took 5343 ms. Trace:
I20260503 07:53:13.045223 1174 rpcz_store.cc:276] 0503 07:53:07.701463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.701528 (+ 65us) service_pool.cc:224] Handling call
0503 07:53:13.044587 (+5343059us) ts_tablet_manager.cc:1151] Deleting tablet 6b18c4ecb2ca453ea69772cd68244394
0503 07:53:13.045025 (+ 438us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.045125 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957696,"tablet-delete.queue_time_us":5342844}
I20260503 07:53:13.045517 1174 tablet_replica.cc:333] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:13.045656 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2824974ab454c84172ec3d27e5aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.048688 2577 consensus_queue.cc:1048] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:13.048780 2704 consensus_queue.cc:1048] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:13.049746 986 consensus_peers.cc:597] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bf42130a55744429d2c64ed55671507. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:13.052211 988 leader_election.cc:343] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:13.052554 988 leader_election.cc:343] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.054518 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 766799446d1a480ca04246b0aec14852 (table default.Table_07d524476f694b8ea7ce95c0fc005807 [id=c9513d6e491a4250894ed7225db630fe]) successfully deleted
W20260503 07:53:13.054963 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5f7d50c1575341bca6673a3cd887415e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7d50c1575341bca6673a3cd887415e already in progress: creating tablet
W20260503 07:53:13.055781 986 consensus_peers.cc:597] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: SHUTDOWN. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:13.057519 2719 consensus_queue.cc:1048] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:53:13.062217 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66af40676bd48ba90d4291de161d54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.062944 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0516484f0ffd41b383f20a7bad1cb72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.063928 1174 raft_consensus.cc:2243] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:13.064105 1174 raft_consensus.cc:2272] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.064723 1174 ts_tablet_manager.cc:1916] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.073705 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1045) took 1322 ms. Trace:
I20260503 07:53:13.077517 889 rpcz_store.cc:276] 0503 07:53:11.629421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.521906 (+892485us) service_pool.cc:224] Handling call
0503 07:53:12.522256 (+ 350us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.522274 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.584763 (+ 62489us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.683419 (+ 98656us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.683611 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.004503 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1068)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1069)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1070)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1071)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1072)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1073)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1074)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
I20260503 07:53:13.080231 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a7ad2250a3414aa5167d54c2c90941" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.080538 895 rpcz_store.cc:276] 0503 07:53:11.628962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.379774 (+750812us) service_pool.cc:224] Handling call
0503 07:53:12.380403 (+ 629us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.382926 (+ 2523us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.996770 (+613844us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.999226 (+ 2456us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.999349 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.081255 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994d9de9bf5b4dfa9157f84ccd59e294. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.081393 854 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:13.091864 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1042) took 1500 ms. Trace:
I20260503 07:53:13.097055 1175 ts_tablet_manager.cc:1929] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:13.099538 1175 log.cc:1199] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:13.100006 1175 ts_tablet_manager.cc:1950] T e662fd10883b401c8f0d4a45735e2639 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:13.100397 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cead0c0237b4360bc84c661deaf7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.107220 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 300fb1d2d29a48f98d9458c3a2dd0aff (DEFAULT_TABLE table=default.Table_2923dafec6854f58bcfd56dab4677849 [id=85d6930da22e4782b4cca110f86d2b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.107635 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300fb1d2d29a48f98d9458c3a2dd0aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.113147 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 978) took 5090 ms. Trace:
I20260503 07:53:13.115195 2740 consensus_queue.cc:1048] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:13.120620 880 rpcz_store.cc:276] 0503 07:53:11.629086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.380880 (+751794us) service_pool.cc:224] Handling call
0503 07:53:12.627169 (+246289us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.627196 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.894945 (+267749us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:12.951065 (+ 56120us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:12.951215 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.115252 1175 rpcz_store.cc:276] 0503 07:53:08.022475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.022525 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:12.971993 (+4949468us) ts_tablet_manager.cc:1151] Deleting tablet e662fd10883b401c8f0d4a45735e2639
0503 07:53:12.972001 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.042634 (+ 70633us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.097000 (+ 54366us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.113124 (+ 16124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4949304}
I20260503 07:53:13.121673 1175 tablet_replica.cc:333] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:13.122622 1175 raft_consensus.cc:2243] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:13.128239 986 leader_election.cc:304] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.130162 2709 raft_consensus.cc:493] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.130348 2709 raft_consensus.cc:515] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.117241 1171 tablet_bootstrap.cc:492] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.133267 1171 ts_tablet_manager.cc:1403] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.171s user 0.005s sys 0.000s
I20260503 07:53:13.135193 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e662fd10883b401c8f0d4a45735e2639 (table default.Table_9b18605b4adc4e3a80ea92cc4be7f484 [id=04f2fc2b32524124b168e59b80670c7e]) successfully deleted
I20260503 07:53:13.136770 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1054) took 1072 ms. Trace:
I20260503 07:53:13.136888 885 tablet_service.cc:1511] Processing CreateTablet for tablet a129cc3aa6dd403bb3f420f9028046ab (DEFAULT_TABLE table=default.Table_83f3ee8f642e44b4b9b58e951c9f7300 [id=aff7710048fe49afa30429f71011001a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.137212 1175 raft_consensus.cc:2272] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.136581 1171 raft_consensus.cc:359] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.137679 1171 raft_consensus.cc:385] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.138425 2704 raft_consensus.cc:2804] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:13.138499 2704 raft_consensus.cc:493] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:13.138559 2704 raft_consensus.cc:3060] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.138705 986 leader_election.cc:304] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.138998 2740 raft_consensus.cc:2804] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:13.139082 2740 raft_consensus.cc:493] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:13.139189 2740 raft_consensus.cc:3060] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.140668 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:13.140841 1050 raft_consensus.cc:2468] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:13.140961 2565 consensus_queue.cc:1048] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:13.141100 2704 raft_consensus.cc:515] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.141489 716 leader_election.cc:304] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.141595 2704 leader_election.cc:290] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:13.141705 2565 raft_consensus.cc:2804] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:13.141770 2565 raft_consensus.cc:493] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:13.141834 2565 raft_consensus.cc:3060] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.140321 2709 leader_election.cc:290] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:13.150391 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 76389us
I20260503 07:53:13.150731 895 tablet_service.cc:1511] Processing CreateTablet for tablet f9972b0e56524fdbbd85e7431a312d9f (DEFAULT_TABLE table=default.Table_4a226e0c25d2475b97321d18bf53e6d1 [id=e7bed8e7277541f1bcd76d5cd0139d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.152582 890 rpcz_store.cc:276] 0503 07:53:11.521599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.375946 (+854347us) service_pool.cc:224] Handling call
0503 07:53:12.685817 (+309871us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.685835 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.878969 (+193134us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.022380 (+143411us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.022540 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.153158 884 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 (DEFAULT_TABLE table=default.Table_4e0954b14b3b420a9aebc96e192e0859 [id=3b3a0333a6f44fd893f3ae9b5a01570c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.155074 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401317bf551401990260fa0419fd924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.155961 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1053) took 1107 ms. Trace:
I20260503 07:53:13.156384 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9685434c3b4c898a254b09fefde69b (DEFAULT_TABLE table=default.Table_6243db5cd8c343a090334a84b493bf40 [id=cce2c80420f14c63b9d8a0b99248ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.159412 880 tablet_service.cc:1511] Processing CreateTablet for tablet fad603dd15f545a999b6e45bcc20bafc (DEFAULT_TABLE table=default.Table_563b0138e42c4e4e88a20822813ce1aa [id=9c25dc41c0a34a149dba504822435697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.159899 1174 ts_tablet_manager.cc:1929] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:13.160274 1174 log.cc:1199] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:13.161497 1174 ts_tablet_manager.cc:1950] T 29fe06a56f70487ea7c479b107d83d8b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:13.138140 1175 ts_tablet_manager.cc:1916] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.162930 894 rpcz_store.cc:276] 0503 07:53:12.005947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.563747 (+557800us) service_pool.cc:224] Handling call
0503 07:53:12.766246 (+202499us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.766281 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.882014 (+115733us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.067244 (+185230us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.078699 (+ 11455us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:13.163794 917 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.654s user 0.013s sys 0.028s
I20260503 07:53:13.165805 903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7336c1df59754cd58c0c290b84fc0d7a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:13.166072 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9972b0e56524fdbbd85e7431a312d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.166810 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1050) took 1524 ms. Trace:
I20260503 07:53:13.167893 891 rpcz_store.cc:276] 0503 07:53:11.982229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.557800 (+575571us) service_pool.cc:224] Handling call
0503 07:53:12.558535 (+ 735us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.558554 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.988018 (+429464us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.089205 (+101187us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.089314 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.168910 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 909) took 5449 ms. Trace:
I20260503 07:53:13.169047 1174 rpcz_store.cc:276] 0503 07:53:07.719663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.720268 (+ 605us) service_pool.cc:224] Handling call
0503 07:53:13.045476 (+5325208us) ts_tablet_manager.cc:1151] Deleting tablet 29fe06a56f70487ea7c479b107d83d8b
0503 07:53:13.045486 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.156673 (+111187us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.159859 (+ 3186us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.168892 (+ 9033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18200,"tablet-delete.queue_time_us":5325002}
I20260503 07:53:13.169340 890 tablet_service.cc:1511] Processing CreateTablet for tablet 79d911c4eb994478ba633e5194ddb343 (DEFAULT_TABLE table=default.Table_b3dad368cb764163b9d4cbc4d27a330a [id=c2029bc4580a49f6bc359b733b5dbca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.169436 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.169612 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 908) took 5451 ms. Trace:
I20260503 07:53:13.169691 1174 rpcz_store.cc:276] 0503 07:53:07.718303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.721830 (+ 3527us) service_pool.cc:224] Handling call
0503 07:53:13.169444 (+5447614us) ts_tablet_manager.cc:1151] Deleting tablet 7986115ad5ff47cf991009f545f0243e
0503 07:53:13.169453 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.169596 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5447416}
W20260503 07:53:13.169840 715 leader_election.cc:343] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.170352 1174 tablet_replica.cc:333] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:13.174163 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a129cc3aa6dd403bb3f420f9028046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.174304 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.174616 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1064) took 1028 ms. Trace:
I20260503 07:53:13.174772 892 rpcz_store.cc:276] 0503 07:53:11.629368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.480251 (+850883us) service_pool.cc:224] Handling call
0503 07:53:12.481450 (+ 1199us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.481722 (+ 272us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:12.991178 (+509456us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.153801 (+162623us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.154083 (+ 282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.175385 1166 tablet_bootstrap.cc:492] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
W20260503 07:53:13.177836 917 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.655s user 0.014s sys 0.028s
W20260503 07:53:13.180600 988 leader_election.cc:343] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.176222 891 tablet_service.cc:1511] Processing CreateTablet for tablet e93d2f3321bb4a018c1798eeef92abac (DEFAULT_TABLE table=default.Table_7e13cceca5d24df38154032bd30dd8a7 [id=79bb6735caae491ab6d11350e295c487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.183717 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad603dd15f545a999b6e45bcc20bafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.183905 894 tablet_service.cc:1511] Processing CreateTablet for tablet cc933a07094146b1ad0c2949188c3470 (DEFAULT_TABLE table=default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.184324 1166 ts_tablet_manager.cc:1403] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.421s user 0.009s sys 0.005s
I20260503 07:53:13.171288 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1076)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1077)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1080)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1081)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1083)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1085)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1096)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1097)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1098)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1099)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1100)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1102)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1103)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1104)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1105)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1106)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1107)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1108)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1109)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1124)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1119)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1120)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
I20260503 07:53:13.187289 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 7eb362fee7bc4f948d3a5b660e9cbd1a (table default.Table_2f491d2732c2492c8ba3fb5ad99aa755 [id=854e3ca83f2e4a5d8f369d925025170f]) successfully deleted
I20260503 07:53:13.187942 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc933a07094146b1ad0c2949188c3470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.190546 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:13.190726 772 raft_consensus.cc:2468] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48acfab19cf04a069d5166d663adb3c3 in term 1.
I20260503 07:53:13.194572 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet ebec2b05025444ccaf0bf0bb4ab62dae (table default.Table_f0de2626accf4770bdab3f0e2bcb9a10 [id=6b910b3d6b9f46e895415fb755568f3b]) successfully deleted
I20260503 07:53:13.184194 893 rpcz_store.cc:276] 0503 07:53:12.138247 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.857359 (+719112us) service_pool.cc:224] Handling call
0503 07:53:12.857816 (+ 457us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.857845 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.003377 (+145532us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.161655 (+158278us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.166760 (+ 5105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.197460 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet e16d225dde3247d1b61a03cf14b21d63 (table default.Table_72659aafd2334ea8ae99e668e5c7ba4e [id=6f5ca25ce13e48be9570d718d3a2aa4a]) successfully deleted
I20260503 07:53:13.196148 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e9d50a71c1a4bf799de34af1064597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.200281 743 tablet_service.cc:1558] Processing DeleteTablet for tablet fad603dd15f545a999b6e45bcc20bafc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.200502 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.200628 741 tablet_service.cc:1511] Processing CreateTablet for tablet c5691fe1fb1c476287c90f2ab4ff786b (DEFAULT_TABLE table=default.Table_2c645d37f74a43af81f917d309bd0cd8 [id=9649963741d74a7f9530255d4ced8e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.200695 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.201014 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5691fe1fb1c476287c90f2ab4ff786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.207572 748 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2417873f234b26b7fa2c2f0120a86f (DEFAULT_TABLE table=default.Table_15d017bc81f944509caf3605b55506a4 [id=58ccedd067944972895ec0afb28e8bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.207991 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2417873f234b26b7fa2c2f0120a86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.209888 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d2f95e3ad844bc39593787e38a45bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.210306 756 tablet_service.cc:1511] Processing CreateTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 (DEFAULT_TABLE table=default.Table_1a31915dab804360889f9e08e8eb20bd [id=17ed0866123f4974a7b532c55a72255b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.210623 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fdc7738d1e4df6aed3a85c4cee3f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.211287 744 tablet_service.cc:1511] Processing CreateTablet for tablet 94ed1a600ee44c1a9f6e292567e85f92 (DEFAULT_TABLE table=default.Table_4d98077554f141b28214686f206b90b2 [id=208d417062024607bd8e02dd4fca6ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.211575 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ed1a600ee44c1a9f6e292567e85f92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.215358 2747 log.cc:927] Time spent T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260503 07:53:13.216154 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9685434c3b4c898a254b09fefde69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.216683 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 314f539af5e44f048ff42619fcda1943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.216676 758 tablet_service.cc:1511] Processing CreateTablet for tablet ac06a8f3dd204c4396e0f6cf95c9e54a (DEFAULT_TABLE table=default.Table_6fc180ce0ac64713b8d194543bd1e19c [id=c061281fd5b945e2abb7e91d80a6f461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.216996 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac06a8f3dd204c4396e0f6cf95c9e54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.217630 1166 raft_consensus.cc:359] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.218029 880 tablet_service.cc:1511] Processing CreateTablet for tablet f87aab6151d34bb7b0efb00f5cfdf64e (DEFAULT_TABLE table=default.Table_747481a5826140bca2e4ed9b148c96bb [id=f53b4ea9a1c84be4bb1f2aec743aba68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.224086 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1055) took 1149 ms. Trace:
I20260503 07:53:13.224416 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ccbede2c323a420b8a0ca2434d4ad5b8
I20260503 07:53:13.227587 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7f523d718ae8475390f78cf2af6758da
I20260503 07:53:13.138011 1171 raft_consensus.cc:740] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.230484 1171 consensus_queue.cc:260] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.230742 1165 tablet_bootstrap.cc:492] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:13.231249 1171 ts_tablet_manager.cc:1434] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.098s user 0.001s sys 0.002s
I20260503 07:53:13.231206 1165 ts_tablet_manager.cc:1403] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.289s user 0.014s sys 0.036s
I20260503 07:53:13.231980 1171 tablet_bootstrap.cc:492] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.232174 1165 raft_consensus.cc:359] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.232365 1165 raft_consensus.cc:385] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.232419 1165 raft_consensus.cc:740] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.232601 1165 consensus_queue.cc:260] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.233065 1165 ts_tablet_manager.cc:1434] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:13.233305 1165 tablet_bootstrap.cc:492] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:13.233923 752 tablet_service.cc:1511] Processing CreateTablet for tablet e382ffd461ec4ef6a80f5c29c062747a (DEFAULT_TABLE table=default.Table_870965ffd55d465c9e6d769178dd9516 [id=d89f7483b886457ca8b4126f4dbe536f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.235486 1171 tablet_bootstrap.cc:654] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.235797 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e382ffd461ec4ef6a80f5c29c062747a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.241577 1174 raft_consensus.cc:2243] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:13.241833 1174 raft_consensus.cc:2272] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.243499 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32a0cef7755c4b14b4b97855b791b883" } new_table_name: "default.Table_ecaab663c98147c7a3f7760565663fa4" modify_external_catalogs: true
I20260503 07:53:13.244956 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1f3645e996e04ee4ab3731d4cfc21ef3" } new_table_name: "default.Table_e94462c3e1d1494091fda87f7d042d0b" modify_external_catalogs: true
I20260503 07:53:13.260802 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e4637a8b90ee4ac88da954efe295d605"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.261493 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e71826e4a2b64189a1bb50edfa1c12ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.261884 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e71826e4a2b64189a1bb50edfa1c12ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.262606 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_02afbc612ef24400bc2f6df2dee7d796" } new_table_name: "default.Table_422fabea6ce340369b6425ac4fad9903" modify_external_catalogs: true
W20260503 07:53:13.263764 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4637a8b90ee4ac88da954efe295d605 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.263994 1174 ts_tablet_manager.cc:1916] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.226250 892 tablet_service.cc:1511] Processing CreateTablet for tablet b0c31cc44bea459081697fa3b17bb403 (DEFAULT_TABLE table=default.Table_13da6ea9ff3f422d9a7234c57ba92764 [id=67b0b0b7c0954efb9597c715d26be13e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.226862 893 tablet_service.cc:1511] Processing CreateTablet for tablet aba38ebd9cdc4c0b927806d25d803b87 (DEFAULT_TABLE table=default.Table_f3b781f9a01a481aa77e60f9a1d8167b [id=538675a2fe6b419090d467d8b08244ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.226989 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12c2f3cbf74edc9caf98853272c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.227151 1166 raft_consensus.cc:385] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.252213 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d5a84f62f446c488a7e02be814a26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.267069 1171 tablet_bootstrap.cc:492] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.267227 1171 ts_tablet_manager.cc:1403] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.001s
I20260503 07:53:13.268518 594 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:13.269485 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 01c7925b82934b59839a0e8ddf99356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.271706 1171 raft_consensus.cc:359] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.271948 1171 raft_consensus.cc:385] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.272054 1171 raft_consensus.cc:740] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.272317 1171 consensus_queue.cc:260] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.272938 1171 ts_tablet_manager.cc:1434] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:53:13.273213 1171 tablet_bootstrap.cc:492] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.273909 889 tablet_service.cc:1511] Processing CreateTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de (DEFAULT_TABLE table=default.Table_7c59ab3fec2f4ed787f9260a16901b85 [id=7b10bd6b69dc46ffbd4e48d62aec01de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.275148 1171 tablet_bootstrap.cc:654] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.276773 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba38ebd9cdc4c0b927806d25d803b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.277225 1165 tablet_bootstrap.cc:654] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:13.280438 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fe55ee95698445c85753782b8b651b0 consensus state has no leader
W20260503 07:53:13.284958 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 70580.4us
W20260503 07:53:13.286888 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb406f1ca50e480e8f621106620fa261 consensus state has no leader
I20260503 07:53:13.288607 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3fcabe72ad45feb71819ee22240c2e (DEFAULT_TABLE table=default.Table_77e114a37f6a4981b4a113bb290dcfdd [id=72f5acd8c7514c33a259661e1e2e4dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.290726 757 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.290673 755 tablet_service.cc:1511] Processing CreateTablet for tablet 759f0cc8b2c4440fa2830087ffe38d8f (DEFAULT_TABLE table=default.Table_f6d4a870eb2047848f1d4f7f62272c05 [id=3d96ed696d7546a6a97a0b7ac923a432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.290170 885 tablet_service.cc:1558] Processing DeleteTablet for tablet bda89822863d4f70bc6f115dc2f808c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.290673 750 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea2727074984065bc603363e2b62cb8 (DEFAULT_TABLE table=default.Table_15308a97428e45e8ba696da09885250b [id=e1ed2a0e4091462289ea5d157e4e01ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.291138 885 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6f24fda1c420d96ab75621d8015e4 (DEFAULT_TABLE table=default.Table_a0c51bdaabce48edbfa6d0abb9d1b5fc [id=fcee9c6410284246b9687cb2bb6f184e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.291183 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf with delete_type TABLET_DATA_DELETED (replaced by tablet 75872effe17740b0b322a621cb9ceb17) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.290268 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c31cc44bea459081697fa3b17bb403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.291467 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.291882 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7cead0c0237b4360bc84c661deaf7dd9 (DEFAULT_TABLE table=default.Table_36da2c59317c4f3bb4c2b3b203f298b7 [id=62773f34d971442b89b2bb86e127109f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.292261 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b10183f49464684acfa54e7d10ccee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.292645 745 tablet_service.cc:1558] Processing DeleteTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.290303 1166 raft_consensus.cc:740] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.293078 745 tablet_service.cc:1511] Processing CreateTablet for tablet 300fb1d2d29a48f98d9458c3a2dd0aff (DEFAULT_TABLE table=default.Table_2923dafec6854f58bcfd56dab4677849 [id=85d6930da22e4782b4cca110f86d2b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.294396 898 rpcz_store.cc:276] 0503 07:53:12.074737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.586036 (+511299us) service_pool.cc:224] Handling call
0503 07:53:12.687277 (+101241us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.687298 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.097525 (+410227us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.223894 (+126369us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.224045 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.294739 748 tablet_service.cc:1511] Processing CreateTablet for tablet af91a12968604fc795239b1141f9fa10 (DEFAULT_TABLE table=default.Table_7ffb7ee3ef9848d2860e3ae82ed1e12b [id=e3b71e5427154b3a89f1df4784e69198]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.295213 2704 consensus_queue.cc:1048] T c2f31cff599248dd994a7bcee38ef2ab P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:13.298328 743 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.298513 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 001ded76f1894772898cb660e501984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.298591 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.298806 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f523d718ae8475390f78cf2af6758da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.299381 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 471d979edca2476bb5787319a442603a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:11 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:13.299562 986 leader_election.cc:343] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.299763 986 leader_election.cc:304] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:13.300272 2704 raft_consensus.cc:2749] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:13.300272 744 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.300704 758 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5d55b39bcf4195a55edce71e37aa0a (DEFAULT_TABLE table=default.Table_5d7ddac49c474eacb06291a067c7aa8f [id=e2395e1f7dbb49018f744f933033297d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.301254 1166 consensus_queue.cc:260] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.303275 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_db2dde7023504a5884e4c6b3901587ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.303848 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db2dde7023504a5884e4c6b3901587ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.305851 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d911c4eb994478ba633e5194ddb343. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.307283 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0b4e48e85b04f0cb4a5cbac4a59f6b6 consensus state has no leader
I20260503 07:53:13.307596 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e05a268800c741258262ebbef730615c" } modify_external_catalogs: true
I20260503 07:53:13.307729 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e05a268800c741258262ebbef730615c" } modify_external_catalogs: true
W20260503 07:53:13.310218 988 leader_election.cc:343] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.312827 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_07967b4e81bd431e86edc76d6da158de" } modify_external_catalogs: true
I20260503 07:53:13.313017 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_07967b4e81bd431e86edc76d6da158de" } modify_external_catalogs: true
I20260503 07:53:13.314253 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32773c065bd240f0932f0f5e52f2bdd8" } modify_external_catalogs: true
I20260503 07:53:13.314429 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_32773c065bd240f0932f0f5e52f2bdd8" } modify_external_catalogs: true
I20260503 07:53:13.316558 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet aef746161e6b446ab0d299d37e2151ea (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]) successfully deleted
I20260503 07:53:13.319756 2740 raft_consensus.cc:515] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.322329 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 8ffec630db9a430fa3006268b0e28fcd (table default.Table_5927563641d44bc28addfeb760ee7280 [id=62cd8ca8c65b443a87799ad6b3e263a7]) successfully deleted
W20260503 07:53:13.322602 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet a328057ceb3640d1a26b773862492f04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a328057ceb3640d1a26b773862492f04 already in progress: creating tablet
W20260503 07:53:13.322911 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2df2ed7d2563487aa15fe917b3fcf313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2ed7d2563487aa15fe917b3fcf313 already in progress: creating tablet
W20260503 07:53:13.323282 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet acbfff84673541929083cbc13b059398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acbfff84673541929083cbc13b059398 already in progress: creating tablet
I20260503 07:53:13.323594 752 tablet_service.cc:1511] Processing CreateTablet for tablet d2f9d4b323284e6e8f172a04e35be881 (DEFAULT_TABLE table=default.Table_12ec486261344161bd8fcd5894291c74 [id=14dfa830ea4e45ebbe1f24f6df8c4e0b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.323405 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7b0ba340aa94ea78c2a0982d65e129f consensus state has no leader
I20260503 07:53:13.324918 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3d52b85a5cd74d2385814258399ca2d2 (DEFAULT_TABLE table=default.Table_b87484809fe040a2bd35bf2b9a44344d [id=543a2ecec75b4b769b39427ff6196f27]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.325249 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9aa3759511d942bfbc6e50ea2e2f2777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aa3759511d942bfbc6e50ea2e2f2777 already in progress: creating tablet
I20260503 07:53:13.326332 898 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ea60ce7a14842b6cdab25e9f0d150 (DEFAULT_TABLE table=default.Table_71186bdc93b245dfa138e23897bdba05 [id=2eb015e5ab4a47c996f24a1aa4adc268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.329926 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759f0cc8b2c4440fa2830087ffe38d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.330514 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300fb1d2d29a48f98d9458c3a2dd0aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.330957 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cead0c0237b4360bc84c661deaf7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.331434 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af91a12968604fc795239b1141f9fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.331879 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5d55b39bcf4195a55edce71e37aa0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.332358 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2727074984065bc603363e2b62cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.332435 893 tablet_service.cc:1511] Processing CreateTablet for tablet a4797d5bc24e4b65b75ef83907efdba7 (DEFAULT_TABLE table=default.Table_41739ba8d4404bafad498d6d58f810ec [id=0acca61592e54dfa9a4ee3a9deb313d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.332731 897 tablet_service.cc:1511] Processing CreateTablet for tablet c7af8a51b1de45b2a3cc539770e1b3dd (DEFAULT_TABLE table=default.Table_366b3b6108d9462c9b51f0c3ef634dbc [id=4e484bba1e654dd180dc6770eee34cdd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.333334 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 001ded76f1894772898cb660e501984d (table default.Table_6a96f6c8dd1e4772bf6c4a4db5b43256 [id=2b1c73ba2338402da8b009d3b6703fd8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 001ded76f1894772898cb660e501984d consensus state has no leader
I20260503 07:53:13.338696 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f523d718ae8475390f78cf2af6758da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.339620 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.339762 2608 raft_consensus.cc:493] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.340018 2608 raft_consensus.cc:515] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.341085 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:13.341414 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6f24fda1c420d96ab75621d8015e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.341570 716 leader_election.cc:343] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.341748 2608 leader_election.cc:290] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:13.343492 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 17b58e042a6442658d95d373409fa25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17b58e042a6442658d95d373409fa25e already in progress: creating tablet
I20260503 07:53:13.345278 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3be0ae78ada34cd88debca569b77d24a (table default.Table_9674018b68e444bea48fcba2fbc2616b [id=bcb02461828f4365ae8debf32812151b]) successfully deleted
I20260503 07:53:13.346307 879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1060) took 1233 ms. Trace:
I20260503 07:53:13.346469 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d52b85a5cd74d2385814258399ca2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.347060 2457 raft_consensus.cc:493] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.347182 2457 raft_consensus.cc:515] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.347786 2457 leader_election.cc:290] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.348408 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:13.348588 1052 raft_consensus.cc:2468] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:13.348999 716 leader_election.cc:304] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.349175 2708 raft_consensus.cc:2804] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:13.349239 2708 raft_consensus.cc:493] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:13.349292 2708 raft_consensus.cc:3060] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.353384 2708 raft_consensus.cc:515] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.354452 2708 leader_election.cc:290] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.354668 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:13.354827 1052 raft_consensus.cc:3060] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.357450 1052 raft_consensus.cc:2468] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:13.357856 716 leader_election.cc:304] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.358714 1165 tablet_bootstrap.cc:492] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:13.358893 1165 ts_tablet_manager.cc:1403] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.000s
I20260503 07:53:13.359771 1165 raft_consensus.cc:359] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.360009 1165 raft_consensus.cc:385] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.360095 1165 raft_consensus.cc:740] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.360384 1165 consensus_queue.cc:260] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.361019 2708 raft_consensus.cc:2804] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.361109 2708 raft_consensus.cc:697] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:13.361372 2708 consensus_queue.cc:237] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.364501 2768 tablet.cc:1724] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.368569 2769 tablet.cc:1724] T 17b547a24cfa4478a90d3035a59a3381 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.368875 1165 ts_tablet_manager.cc:1434] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260503 07:53:13.369218 1165 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:13.370844 1165 tablet_bootstrap.cc:654] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.377599 1171 tablet_bootstrap.cc:492] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.377761 1171 ts_tablet_manager.cc:1403] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.105s user 0.001s sys 0.003s
I20260503 07:53:13.378408 1171 raft_consensus.cc:359] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.378715 1171 raft_consensus.cc:385] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.378803 1171 raft_consensus.cc:740] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.379045 1171 consensus_queue.cc:260] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.380129 1171 ts_tablet_manager.cc:1434] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:13.380425 2565 raft_consensus.cc:515] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.380484 1171 tablet_bootstrap.cc:492] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.382256 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:13.382454 1050 raft_consensus.cc:3060] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.384441 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f9d4b323284e6e8f172a04e35be881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.385758 1050 raft_consensus.cc:2468] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:13.386173 716 leader_election.cc:304] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.386746 2608 raft_consensus.cc:2804] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.387046 2608 raft_consensus.cc:697] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:13.387480 2608 consensus_queue.cc:237] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.389966 1171 tablet_bootstrap.cc:654] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.394455 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:13.394915 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:13.395023 772 raft_consensus.cc:3060] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.396982 1171 tablet_bootstrap.cc:492] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.397099 1171 ts_tablet_manager.cc:1403] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260503 07:53:13.397289 772 raft_consensus.cc:2468] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:13.398314 1171 raft_consensus.cc:359] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.398522 1171 raft_consensus.cc:385] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.398619 1171 raft_consensus.cc:740] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.398968 1171 consensus_queue.cc:260] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.399085 1173 ts_tablet_manager.cc:1929] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:13.399570 1171 ts_tablet_manager.cc:1434] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:13.400252 1171 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.402192 1171 tablet_bootstrap.cc:654] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.406474 879 rpcz_store.cc:276] 0503 07:53:12.107815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.686450 (+578635us) service_pool.cc:224] Handling call
0503 07:53:12.720699 (+ 34249us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.720723 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.099739 (+379016us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.341247 (+241508us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.341373 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.406975 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4797d5bc24e4b65b75ef83907efdba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.411770 1173 log.cc:1199] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:13.412065 2740 leader_election.cc:290] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:13.413582 2386 raft_consensus.cc:493] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.414059 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1059) took 1294 ms. Trace:
I20260503 07:53:13.414227 884 tablet_service.cc:1511] Processing CreateTablet for tablet f7b0ba340aa94ea78c2a0982d65e129f (DEFAULT_TABLE table=default.Table_02afbc612ef24400bc2f6df2dee7d796 [id=985d8a73178745128f1c92dc85793684]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.415082 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 69777.2us
W20260503 07:53:13.415344 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6b18c4ecb2ca453ea69772cd68244394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b18c4ecb2ca453ea69772cd68244394 already in progress: creating tablet
I20260503 07:53:13.415386 886 rpcz_store.cc:276] 0503 07:53:12.107711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.630837 (+523126us) service_pool.cc:224] Handling call
0503 07:53:12.690594 (+ 59757us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.690642 (+ 48us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.254480 (+563838us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.401864 (+147384us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.402020 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.415853 886 tablet_service.cc:1511] Processing CreateTablet for tablet 14b67fc66ebf40a6b726a76ed813fb24 (DEFAULT_TABLE table=default.Table_9bbe84e829814d7fb2d44abbb8fa0a5a [id=4050ca030274435a9df51ec81f4b40b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.416036 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 29fe06a56f70487ea7c479b107d83d8b (table default.Table_87eaff35bf554a20a9dbff384c14205b [id=bb994ffd4e35451e9cd661bf4bc3217a]) successfully deleted
I20260503 07:53:13.359859 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 2 got 0
W20260503 07:53:13.416311 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7986115ad5ff47cf991009f545f0243e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7986115ad5ff47cf991009f545f0243e already in progress: creating tablet
I20260503 07:53:13.416478 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 8f64902f16534103be2968bdc1823a9e (table default.Table_aab3c94e44334f51b254da90bfa43fcc [id=d880e8f7c3ff4214be9e3bbd8d0f1b4b]). Expected version 1 got 0
I20260503 07:53:13.416927 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5ba5f770a448465491160fc72f66a830 (table default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616]). Expected version 1 got 0
I20260503 07:53:13.417164 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 3 got 2
I20260503 07:53:13.417520 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 9a7af140ce144bc8b2e147dad98ac201 (table default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd]). Expected version 2 got 0
I20260503 07:53:13.417611 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1057) took 1335 ms. Trace:
I20260503 07:53:13.417708 881 rpcz_store.cc:276] 0503 07:53:12.082614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.627445 (+544831us) service_pool.cc:224] Handling call
0503 07:53:12.689879 (+ 62434us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.689903 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.243049 (+553146us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.417459 (+174410us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.417575 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.417706 600 catalog_manager.cc:5671] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:13.418097 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (table default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683]). Expected version 1 got 0
I20260503 07:53:13.418097 881 tablet_service.cc:1511] Processing CreateTablet for tablet 0708cababc844e51ab7da2950664c2c5 (DEFAULT_TABLE table=default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.418359 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:13.418753 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a7ad2250a3414aa5167d54c2c90941" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:13.418941 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:13.419338 600 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf]). Expected version 2 got 0
I20260503 07:53:13.419480 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:13.419641 774 raft_consensus.cc:2468] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:13.419872 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:13.371112 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e6d239c0edef4e3a91278c0702ab5e44" } new_table_name: "default.Table_e461c2185290440e8dfa22bb54879b5d" modify_external_catalogs: true
I20260503 07:53:13.422403 879 tablet_service.cc:1511] Processing CreateTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 (DEFAULT_TABLE table=default.Table_89444261c7144001b844a9846d28eadf [id=517b9c969c9c42858e00a31ce6224e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.423491 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7af8a51b1de45b2a3cc539770e1b3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.426273 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d24ae9e604144ca589008d6697d849df
I20260503 07:53:13.427103 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d9269dd6a9af493a8452b7f657355933
I20260503 07:53:13.427804 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e1d0e93ae66c46749c4f7e9e495ae60a
I20260503 07:53:13.437029 1173 ts_tablet_manager.cc:1950] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:13.437371 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 895) took 5309 ms. Trace:
I20260503 07:53:13.437527 890 tablet_service.cc:1511] Processing CreateTablet for tablet 00535762e832485c987b735c7d6d0671 (DEFAULT_TABLE table=default.Table_fb8eef4fe222404da1bcd56830523881 [id=7d8f1a3e725146cd8e833ef42dd67459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.437976 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1062) took 1293 ms. Trace:
W20260503 07:53:13.439266 986 leader_election.cc:343] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.439425 986 leader_election.cc:304] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:13.439522 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb8d47da511422d9665326520d35601" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:13.439690 764 raft_consensus.cc:3060] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.439867 2740 raft_consensus.cc:2749] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:13.442831 764 raft_consensus.cc:2468] T 4bb8d47da511422d9665326520d35601 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:13.445485 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7336c1df59754cd58c0c290b84fc0d7a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:13.445623 776 raft_consensus.cc:3060] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.446467 1171 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.446596 1171 ts_tablet_manager.cc:1403] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260503 07:53:13.447283 1171 raft_consensus.cc:359] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.447436 1171 raft_consensus.cc:385] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.447494 1171 raft_consensus.cc:740] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.447660 1171 consensus_queue.cc:260] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.448459 1171 ts_tablet_manager.cc:1434] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:13.448623 2768 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.449178 1171 tablet_bootstrap.cc:492] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.451023 1171 tablet_bootstrap.cc:654] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.451366 1165 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:13.451514 1165 ts_tablet_manager.cc:1403] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.002s
I20260503 07:53:13.452605 1165 raft_consensus.cc:359] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.452868 1165 raft_consensus.cc:385] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.452947 1165 raft_consensus.cc:740] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.453222 1165 consensus_queue.cc:260] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.454452 1165 ts_tablet_manager.cc:1434] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:13.454763 1165 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:13.437458 1173 rpcz_store.cc:276] 0503 07:53:08.127807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.127844 (+ 37us) service_pool.cc:224] Handling call
0503 07:53:12.843727 (+4715883us) ts_tablet_manager.cc:1151] Deleting tablet 8fb4d150eadb479d9978f2450637bd3e
0503 07:53:12.843736 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:12.902098 (+ 58362us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.344210 (+442112us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.437338 (+ 93128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6162,"tablet-delete.queue_time_us":4715714}
W20260503 07:53:13.458813 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79cd91c2757c48198aa2067683a7329c consensus state has no leader
I20260503 07:53:13.472478 2565 leader_election.cc:290] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.473280 776 raft_consensus.cc:2468] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:13.474823 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9bf17cb5fa4646b29781ef58efff2450" } modify_external_catalogs: true
I20260503 07:53:13.475054 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9bf17cb5fa4646b29781ef58efff2450" } modify_external_catalogs: true
I20260503 07:53:13.475347 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6d19f1e09913434d875e3a17f0832791" } modify_external_catalogs: true
I20260503 07:53:13.475502 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6d19f1e09913434d875e3a17f0832791" } modify_external_catalogs: true
I20260503 07:53:13.475700 986 leader_election.cc:304] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.475805 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4fe07c3e026f429799ffee480cad8928"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.476104 2740 raft_consensus.cc:2804] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.476331 2740 raft_consensus.cc:697] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:13.476563 2740 consensus_queue.cc:237] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.480412 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_19a81c8e549449b5bfc271441e17a3ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.481012 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a81c8e549449b5bfc271441e17a3ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.482721 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c37ca51ef812421a90de1ebd88d898a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.483016 986 leader_election.cc:343] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.483126 986 leader_election.cc:304] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:13.483192 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c37ca51ef812421a90de1ebd88d898a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.483512 2719 raft_consensus.cc:2749] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:13.484551 986 leader_election.cc:304] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.485317 2719 raft_consensus.cc:2804] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:13.485404 2719 raft_consensus.cc:493] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:13.485486 2719 raft_consensus.cc:3060] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.487800 2719 raft_consensus.cc:515] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.488407 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.488586 2719 leader_election.cc:290] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:13.488752 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1056) took 1336 ms. Trace:
I20260503 07:53:13.488749 2386 raft_consensus.cc:515] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:13.489144 986 leader_election.cc:343] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.489260 986 leader_election.cc:304] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:13.489636 2719 raft_consensus.cc:2749] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:13.490236 986 consensus_peers.cc:597] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ffec630db9a430fa3006268b0e28fcd. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:13.491508 986 leader_election.cc:304] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.491781 2719 raft_consensus.cc:2804] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.491896 2719 raft_consensus.cc:697] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:13.492105 2719 consensus_queue.cc:237] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:13.497895 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fe07c3e026f429799ffee480cad8928 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.501569 1165 tablet_bootstrap.cc:654] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.505239 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_77bcc35ee59443529ee66397713e628b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.505671 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77bcc35ee59443529ee66397713e628b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.506872 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bba9ffa84f1f430391d8720c5069f67d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.507261 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bba9ffa84f1f430391d8720c5069f67d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.508355 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_812b51710d0c47159b3d5e3a9fd3eaea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.508736 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812b51710d0c47159b3d5e3a9fd3eaea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.510625 2769 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:13.517277 2769 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 1190) took 1349 ms. Trace:
I20260503 07:53:13.517370 2769 rpcz_store.cc:276] 0503 07:53:12.167759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.450854 (+283095us) service_pool.cc:224] Handling call
0503 07:53:13.517227 (+1066373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:12.582803 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:53:12.590265 (+ 7462us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:53:12.590277 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0503 07:53:12.590323 (+ 46us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:53:12.590413 (+ 90us) alter_schema_op.cc:128] START. Timestamp: 1777794792590358
0503 07:53:12.592934 (+ 2521us) op_driver.cc:348] REPLICATION: starting
0503 07:53:12.667190 (+ 74256us) log.cc:844] Serialized 173 byte log entry
0503 07:53:13.510489 (+843299us) op_driver.cc:464] REPLICATION: finished
0503 07:53:13.510603 (+ 114us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:53:13.511009 (+ 406us) log.cc:844] Serialized 5 byte log entry
0503 07:53:13.514972 (+ 3963us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.517147 (+ 2175us) log.cc:844] Serialized 14 byte log entry
0503 07:53:13.517189 (+ 42us) alter_schema_op.cc:73] Released schema lock
0503 07:53:13.517194 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":65,"prepare.queue_time_us":131592,"prepare.run_cpu_time_us":627,"prepare.run_wall_time_us":84811,"replication_time_us":917520,"thread_start_us":147652,"threads_started":1}]]}
I20260503 07:53:13.522732 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ef666aa007504682bc044cbd0b56060d
I20260503 07:53:13.523525 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_48c1743be4724061a60d812f3158090d" } new_table_name: "default.Table_3ee38ccde55442c3aca112e70aec602e" modify_external_catalogs: true
I20260503 07:53:13.531023 986 leader_election.cc:304] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.531527 2719 raft_consensus.cc:2804] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.531715 2719 raft_consensus.cc:697] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:13.532011 2719 consensus_queue.cc:237] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.533164 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_13b0c985ac174d199a61e7b3c26061c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.533604 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13b0c985ac174d199a61e7b3c26061c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.535203 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6bd577980624ffeaf6eff8a9c1120f3" } new_table_name: "default.Table_ee2d7a044dfb46aea48bf51119a4a3e3" modify_external_catalogs: true
I20260503 07:53:13.540671 1174 ts_tablet_manager.cc:1929] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:13.541316 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d9269dd6a9af493a8452b7f657355933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.543497 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3fcabe72ad45feb71819ee22240c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.545060 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a15db5ec7f114d89bb16c146360e3b3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.545492 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a15db5ec7f114d89bb16c146360e3b3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.545748 1165 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:13.545889 1165 ts_tablet_manager.cc:1403] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.002s
I20260503 07:53:13.546500 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2e37a8c4a2614022a6d259ed634fb982"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.546590 1165 raft_consensus.cc:359] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.546728 1165 raft_consensus.cc:385] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.546777 1165 raft_consensus.cc:740] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:53:13.546904 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e37a8c4a2614022a6d259ed634fb982 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.546957 1165 consensus_queue.cc:260] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.547468 1165 ts_tablet_manager.cc:1434] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260503 07:53:13.547712 1165 tablet_bootstrap.cc:492] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:13.548157 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_899ab16c8fbf4137b5e1a2b331af4feb" } new_table_name: "default.Table_70ed5394e1094d2c9e5ef294b7dfd6fe" modify_external_catalogs: true
I20260503 07:53:13.548475 748 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.548885 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ef666aa007504682bc044cbd0b56060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.549319 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:13.549491 776 raft_consensus.cc:3060] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.549767 2768 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:13.550395 1174 log.cc:1199] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/4f6c9fb96d5a4397b51611254be1a970
W20260503 07:53:13.554625 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41c0a9d223b040bdb8cd55629914357b has no consensus state
I20260503 07:53:13.555493 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f03a50c52b4b4c519d9b157e2d8409dd" } new_table_name: "default.Table_4790289c54a6468eac6fc74dc5d2bff3" modify_external_catalogs: true
W20260503 07:53:13.556962 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 consensus state has no leader
I20260503 07:53:13.560573 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet d24ae9e604144ca589008d6697d849df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.560724 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet d9269dd6a9af493a8452b7f657355933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.567634 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1049) took 1938 ms. Trace:
I20260503 07:53:13.567749 896 rpcz_store.cc:276] 0503 07:53:11.629316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.461484 (+832168us) service_pool.cc:224] Handling call
0503 07:53:12.521303 (+ 59819us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.521330 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.172097 (+650767us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.567442 (+395345us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.567584 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.568116 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9648cf6a6c774c05a427a5c1344bfb77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.568403 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b56ee573586b49d596592c32c509969f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.568588 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e5283673660476eb689d41ef0daa2d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.573699 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:13.575132 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32564d43180741f396c4682c32c29f43 consensus state has no leader
W20260503 07:53:13.576670 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81b3a0c30b274a2e9a411b9b835f04a2 consensus state has no leader
I20260503 07:53:13.575376 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 899) took 5164 ms. Trace:
I20260503 07:53:13.568747 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b0edcd3617b4c73a419b382492a23aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.575202 882 rpcz_store.cc:276] 0503 07:53:12.117709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.707578 (+589869us) service_pool.cc:224] Handling call
0503 07:53:12.773342 (+ 65764us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.773364 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.238297 (+464933us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.411072 (+172775us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.411208 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.552565 776 raft_consensus.cc:2468] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:13.580787 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 3 got 2
I20260503 07:53:13.578702 2709 raft_consensus.cc:493] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.581027 601 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:13.581475 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:13.587966 715 leader_election.cc:343] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.588085 715 leader_election.cc:304] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.588307 2565 raft_consensus.cc:2749] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:13.588804 715 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.581140 2709 raft_consensus.cc:515] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.589965 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d24ae9e604144ca589008d6697d849df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.590250 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:13.590734 716 leader_election.cc:343] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.591101 2709 leader_election.cc:290] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:13.595175 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1078) took 1010 ms. Trace:
I20260503 07:53:13.595300 892 rpcz_store.cc:276] 0503 07:53:12.532404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.202862 (+670458us) service_pool.cc:224] Handling call
0503 07:53:13.264900 (+ 62038us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.264945 (+ 45us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.298671 (+ 33726us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.462946 (+164275us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.542655 (+ 79709us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25867}
I20260503 07:53:13.595579 892 tablet_service.cc:1558] Processing DeleteTablet for tablet aef746161e6b446ab0d299d37e2151ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.578967 887 rpcz_store.cc:276] 0503 07:53:12.077133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.587414 (+510281us) service_pool.cc:224] Handling call
0503 07:53:12.685611 (+ 98197us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.685639 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.225378 (+539739us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.413281 (+187903us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.413402 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.596211 2386 leader_election.cc:290] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.596359 2386 raft_consensus.cc:493] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.599313 1171 tablet_bootstrap.cc:492] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.599471 1171 ts_tablet_manager.cc:1403] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.003s
I20260503 07:53:13.600075 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbede2c323a420b8a0ca2434d4ad5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.600310 1171 raft_consensus.cc:359] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.600507 1171 raft_consensus.cc:385] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.600581 1171 raft_consensus.cc:740] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.600817 1171 consensus_queue.cc:260] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.601661 1171 ts_tablet_manager.cc:1434] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:13.602092 1171 tablet_bootstrap.cc:492] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.602268 1174 ts_tablet_manager.cc:1950] T 4f6c9fb96d5a4397b51611254be1a970 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:13.605728 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet ef666aa007504682bc044cbd0b56060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.605968 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.607704 1171 tablet_bootstrap.cc:654] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.609889 2756 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:13.610113 1173 rpcz_store.cc:276] 0503 07:53:08.292765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.294306 (+ 1541us) service_pool.cc:224] Handling call
0503 07:53:13.457389 (+5163083us) ts_tablet_manager.cc:1151] Deleting tablet e66033d0ee71439cba1545815aa5213f
0503 07:53:13.457402 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.457505 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5162850}
I20260503 07:53:13.610975 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:13.611825 1165 tablet_bootstrap.cc:654] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.612916 2704 raft_consensus.cc:493] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.613060 2704 raft_consensus.cc:515] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.613575 2704 leader_election.cc:290] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:13.613857 1175 ts_tablet_manager.cc:1929] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:13.613986 1175 log.cc:1199] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1bf42130a55744429d2c64ed55671507
I20260503 07:53:13.614326 1175 ts_tablet_manager.cc:1950] T 1bf42130a55744429d2c64ed55671507 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:13.615073 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 985) took 5399 ms. Trace:
I20260503 07:53:13.615172 1175 rpcz_store.cc:276] 0503 07:53:08.215203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.215255 (+ 52us) service_pool.cc:224] Handling call
0503 07:53:13.121512 (+4906257us) ts_tablet_manager.cc:1151] Deleting tablet 1bf42130a55744429d2c64ed55671507
0503 07:53:13.121525 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.553189 (+431664us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.613781 (+ 60592us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.615031 (+ 1250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13497,"tablet-delete.queue_time_us":4906031}
I20260503 07:53:13.615475 1175 tablet_replica.cc:333] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:13.615685 1175 raft_consensus.cc:2243] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:13.615986 1175 raft_consensus.cc:2272] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.617231 986 leader_election.cc:304] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:13.617709 2741 raft_consensus.cc:2804] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:13.617820 2741 raft_consensus.cc:697] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:13.618031 2741 consensus_queue.cc:237] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.618800 2769 tablet.cc:1724] T 6a845e02bdb54952806f90d3f7cd9fb2 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.619012 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad24ddc82bd401fb5427e7415af3922" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:13.619545 882 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522 (DEFAULT_TABLE table=default.Table_3d38c214d66b4e5eae6ee88e7b29f1de [id=1f191aa0170c4877ac26446aa5c41d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.621508 2757 raft_consensus.cc:493] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.621743 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 910) took 5804 ms. Trace:
I20260503 07:53:13.621812 1174 rpcz_store.cc:276] 0503 07:53:07.817151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.817425 (+ 274us) service_pool.cc:224] Handling call
0503 07:53:13.170312 (+5352887us) ts_tablet_manager.cc:1151] Deleting tablet 4f6c9fb96d5a4397b51611254be1a970
0503 07:53:13.170322 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.340126 (+169804us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.540597 (+200471us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.621724 (+ 81127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5352647}
I20260503 07:53:13.622184 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 913) took 5709 ms. Trace:
I20260503 07:53:13.622262 1174 rpcz_store.cc:276] 0503 07:53:07.912905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.912969 (+ 64us) service_pool.cc:224] Handling call
0503 07:53:13.622072 (+5709103us) ts_tablet_manager.cc:1151] Deleting tablet 82f5e16014a34ab9a125d62c72cf2c00
0503 07:53:13.622081 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.622168 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5690896}
W20260503 07:53:13.622367 854 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:13.622521 1174 tablet_replica.cc:333] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:13.622691 1174 raft_consensus.cc:2243] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:13.622850 715 leader_election.cc:343] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.623088 2763 raft_consensus.cc:493] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:13.623229 715 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.623250 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 773fca453dac452abc723e49b70111b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.623737 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eb48844c2a04b5e8b6f73b9986127ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.623751 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7b1ed7918954467387a0d2e03aa226d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.624292 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae4a39d4e3a42db816e592123a6a2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:13.624497 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b1ed7918954467387a0d2e03aa226d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.625411 2756 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.625831 1173 tablet_replica.cc:333] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:13.626049 1173 raft_consensus.cc:2243] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:13.626180 1173 raft_consensus.cc:2272] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.626797 1173 ts_tablet_manager.cc:1916] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.629268 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 766799446d1a480ca04246b0aec14852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.630692 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f6c9fb96d5a4397b51611254be1a970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.631325 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.631898 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet b269ee59036d4c2f866b6b2bf45c35cf with delete_type TABLET_DATA_DELETED (replaced by tablet 75872effe17740b0b322a621cb9ceb17) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.624122 2386 raft_consensus.cc:515] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.632695 2386 leader_election.cc:290] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.632803 2386 raft_consensus.cc:493] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.632903 2386 raft_consensus.cc:515] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.633437 2386 leader_election.cc:290] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.633638 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 8fb4d150eadb479d9978f2450637bd3e (table default.Table_f9ea98989bfe45d0b35a23b8ef67cd69 [id=5877b62cb4ce441fba5f85e9aecdeddd]) successfully deleted
W20260503 07:53:13.634227 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e66033d0ee71439cba1545815aa5213f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66033d0ee71439cba1545815aa5213f already in progress: creating tablet
I20260503 07:53:13.634527 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1bf42130a55744429d2c64ed55671507 (table default.Table_b64bdadb494f4a1d891b00d815f6bd1f [id=e51beedee3de425899d8e131b58e7b0a]) successfully deleted
I20260503 07:53:13.636389 2768 tablet.cc:1724] T 6a845e02bdb54952806f90d3f7cd9fb2 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.621619 2757 raft_consensus.cc:515] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.639108 2757 leader_election.cc:290] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.642747 2756 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.643494 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb8d47da511422d9665326520d35601" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:13.642652 1174 raft_consensus.cc:2272] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:13.644150 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c30f15ad13340c89df3f5c8d65d63c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.644352 887 tablet_service.cc:1558] Processing DeleteTablet for tablet e662fd10883b401c8f0d4a45735e2639 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:53 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.644474 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf42130a55744429d2c64ed55671507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.644706 892 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd151f5e0d54bdab58423c24186b38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.645026 892 tablet_service.cc:1511] Processing CreateTablet for tablet ad4fd383b31f46e3b02ab5356c791b57 (DEFAULT_TABLE table=default.Table_bba9ee7c0bd54a02ab254eb165cce98b [id=dfa2bd2e77e64385979fdd447e3cb403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.650672 2769 tablet.cc:1724] T 618b858f6e424845b5a6b0010cb2b602 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.653820 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 4f6c9fb96d5a4397b51611254be1a970 (table default.Table_33d33732cee3402b871062f8882acc78 [id=53cb2e9c13104fdfaf925c51b1e9d65c]) successfully deleted
W20260503 07:53:13.654063 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 82f5e16014a34ab9a125d62c72cf2c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82f5e16014a34ab9a125d62c72cf2c00 already in progress: creating tablet
I20260503 07:53:13.656607 2768 tablet.cc:1724] T 618b858f6e424845b5a6b0010cb2b602 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:13.661417 1171 tablet_bootstrap.cc:492] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.661558 1171 ts_tablet_manager.cc:1403] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.000s
I20260503 07:53:13.662839 1171 raft_consensus.cc:359] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.663014 1171 raft_consensus.cc:385] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.663076 1171 raft_consensus.cc:740] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.663298 1171 consensus_queue.cc:260] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.663895 1171 ts_tablet_manager.cc:1434] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:13.664520 1171 tablet_bootstrap.cc:492] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.669296 1171 tablet_bootstrap.cc:654] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.670130 2565 consensus_queue.cc:1048] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:13.673492 2565 raft_consensus.cc:493] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.673620 2565 raft_consensus.cc:515] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.674178 2565 leader_election.cc:290] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:13.675544 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:13.676040 716 leader_election.cc:343] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.677728 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b73e814e84a84ab2a3c4234d82d96659" } modify_external_catalogs: true
I20260503 07:53:13.677894 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b73e814e84a84ab2a3c4234d82d96659" } modify_external_catalogs: true
I20260503 07:53:13.678387 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6847e950344842ee9d8a308444ab7c47" } modify_external_catalogs: true
I20260503 07:53:13.678510 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6847e950344842ee9d8a308444ab7c47" } modify_external_catalogs: true
I20260503 07:53:13.678990 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5382b8d2201a4c1d9ca76cb0726f6540" } new_table_name: "default.Table_ea45e9c4654142728340931008b53f8b" modify_external_catalogs: true
I20260503 07:53:13.680250 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d8ce6874d4994d94a17c0514a7528886" } modify_external_catalogs: true
I20260503 07:53:13.680387 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d8ce6874d4994d94a17c0514a7528886" } modify_external_catalogs: true
I20260503 07:53:13.691634 1175 ts_tablet_manager.cc:1916] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.692420 887 tablet_service.cc:1511] Processing CreateTablet for tablet c2a8057297cc4a16813a545fc2b947d4 (DEFAULT_TABLE table=default.Table_b3e78c443801484cacc0819e8ac0c7f0 [id=b59749fd3f0143bd94e616388c2bb161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.692900 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffec630db9a430fa3006268b0e28fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:13.692884 592 catalog_manager.cc:5671] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:13.693661 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 9a7af140ce144bc8b2e147dad98ac201 (table default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd]). Expected version 2 got 0
I20260503 07:53:13.693964 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 2 got 0
I20260503 07:53:13.694936 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2824974ab454c84172ec3d27e5aa5 (DEFAULT_TABLE table=default.Table_2cd812f25c7a4451a75b9bffc7add74b [id=630ecf139a494362ab56f948e28d6a8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.696058 1166 ts_tablet_manager.cc:1434] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.471s user 0.008s sys 0.013s
W20260503 07:53:13.696151 1166 ts_tablet_manager.cc:1467] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Tablet startup took 511ms
W20260503 07:53:13.696200 1166 ts_tablet_manager.cc:1469] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3: Trace:
0503 07:52:54.302450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:52:54.304926 (+ 2476us) service_pool.cc:224] Handling call
0503 07:52:54.305346 (+ 420us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:52:54.305366 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:52:54.313639 (+ 8273us) tablet_metadata.cc:665] Metadata flushed
0503 07:52:54.318279 (+ 4640us) tablet_replica.cc:206] Creating consensus instance
0503 07:52:54.318390 (+ 111us) inbound_call.cc:177] Queueing success response
0503 07:53:12.754735 (+18436345us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0503 07:53:13.184426 (+429691us) ts_tablet_manager.cc:1435] Starting tablet replica
0503 07:53:13.184539 (+ 113us) tablet_replica.cc:261] Starting instrumentation
0503 07:53:13.184669 (+ 130us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":241028,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":40027,"tablet-open.queue_time_us":18436367,"thread_start_us":353593,"threads_started":1}
I20260503 07:53:13.696661 1166 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:13.696882 750 tablet_service.cc:1511] Processing CreateTablet for tablet 630de41e4a344aec9510a8640e415308 (DEFAULT_TABLE table=default.Table_e25655dbf11749b3887a71e4b6f5aa17 [id=6bd82b57011a4cfb963da292812a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.697365 916 raft_consensus.cc:3060] T 1ae4a39d4e3a42db816e592123a6a2e7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:13.699276 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 630de41e4a344aec9510a8640e415308 (DEFAULT_TABLE table=default.Table_e25655dbf11749b3887a71e4b6f5aa17 [id=6bd82b57011a4cfb963da292812a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.699604 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630de41e4a344aec9510a8640e415308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.704066 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.704835 2796 raft_consensus.cc:493] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.705082 2796 raft_consensus.cc:515] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.644017 2763 raft_consensus.cc:515] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:13.707728 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b07f68090a746a685b088c54c84d5f8 consensus state has no leader
I20260503 07:53:13.709446 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.710345 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1065) took 1383 ms. Trace:
I20260503 07:53:13.710451 883 rpcz_store.cc:276] 0503 07:53:12.327366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.874892 (+547526us) service_pool.cc:224] Handling call
0503 07:53:12.875305 (+ 413us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.875343 (+ 38us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.646060 (+770717us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.708162 (+ 62102us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.710329 (+ 2167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:13.711011 854 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 376e9889ca584931ac1d91a9af2c0689
W20260503 07:53:13.711282 854 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: f7654a4a85b6441f9d36527ced775aa2
W20260503 07:53:13.711505 854 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: cac435b09639484ca1ae82f3d4990d48
W20260503 07:53:13.711758 854 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:13.713404 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1058) took 1609 ms. Trace:
I20260503 07:53:13.713491 888 rpcz_store.cc:276] 0503 07:53:12.097114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.629742 (+532628us) service_pool.cc:224] Handling call
0503 07:53:12.707044 (+ 77302us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:12.707071 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.257407 (+550336us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.706551 (+449144us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.706678 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:13.713856 715 leader_election.cc:343] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.713994 715 leader_election.cc:304] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:13.714383 715 leader_election.cc:343] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.714483 715 leader_election.cc:304] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:13.714581 2565 raft_consensus.cc:2749] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:13.714707 2709 raft_consensus.cc:2749] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:13.715119 883 tablet_service.cc:1511] Processing CreateTablet for tablet f66af40676bd48ba90d4291de161d54f (DEFAULT_TABLE table=default.Table_5ec65f8fd71c412287af4b000577f35c [id=e18dbaf727e74e349717cd1b459a80bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.715293 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 797372a021aa48bab4ca695d897164d8
I20260503 07:53:13.715438 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3 (DEFAULT_TABLE table=default.Table_fad9f90b3ee34de9b2d5c689b8e20608 [id=7dc4492673fc4fd1bb84fd54ff37a36c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.716034 2796 leader_election.cc:290] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.716384 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 369b0b38c0024cf2ba0ff3d13f1d9276
I20260503 07:53:13.716557 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 797372a021aa48bab4ca695d897164d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.717218 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2b08e403756a4d99867263d0941d2120
I20260503 07:53:13.717178 888 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea2727074984065bc603363e2b62cb8 (DEFAULT_TABLE table=default.Table_15308a97428e45e8ba696da09885250b [id=e1ed2a0e4091462289ea5d157e4e01ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.717455 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.718261 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b08e403756a4d99867263d0941d2120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.718706 758 tablet_service.cc:1511] Processing CreateTablet for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3 (DEFAULT_TABLE table=default.Table_fad9f90b3ee34de9b2d5c689b8e20608 [id=7dc4492673fc4fd1bb84fd54ff37a36c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.718849 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.718933 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 797372a021aa48bab4ca695d897164d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.719044 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b08e403756a4d99867263d0941d2120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.719645 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.721283 854 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:13.721524 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1088) took 1038 ms. Trace:
I20260503 07:53:13.721722 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.724469 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:13.724711 595 catalog_manager.cc:5671] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:13.725059 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet df60413555764bcab464b18c6a3370ce (table default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a [id=80c5584e658b4237a6580fd0d0a05a0d]). Expected version 1 got 0
I20260503 07:53:13.725440 595 catalog_manager.cc:5671] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:13.725792 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0a08da2052f5482792c8b3294e9b7332 (table default.Table_ef8abe51f2574f0fb195e588e808102e [id=a8e0e85f02244d0b845242b0d59eedce]). Expected version 1 got 0
I20260503 07:53:13.726015 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:13.726286 595 catalog_manager.cc:5671] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:13.726853 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5ba5f770a448465491160fc72f66a830 (table default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616]). Expected version 1 got 0
I20260503 07:53:13.727160 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 9a7af140ce144bc8b2e147dad98ac201 (table default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd]). Expected version 2 got 0
I20260503 07:53:13.727478 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7336c1df59754cd58c0c290b84fc0d7a
I20260503 07:53:13.727512 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 5e128818985a435faf6a464fa9a9632d (DEFAULT_TABLE table=default.Table_e04055e3ddf94ea08fd1570c20730d94 [id=5ea7032b777e418e9a4cffb1ecc19a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.727829 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e128818985a435faf6a464fa9a9632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.729300 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5e128818985a435faf6a464fa9a9632d (DEFAULT_TABLE table=default.Table_e04055e3ddf94ea08fd1570c20730d94 [id=5ea7032b777e418e9a4cffb1ecc19a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.733605 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.742736 2763 leader_election.cc:290] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:13.745833 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a" } modify_external_catalogs: true
I20260503 07:53:13.746013 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a" } modify_external_catalogs: true
I20260503 07:53:13.746398 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0eeec067673744d58cdb5243c65ca773"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.746490 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b34288d750064c589c90e0a4349492e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.746882 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b34288d750064c589c90e0a4349492e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:13.746896 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eeec067673744d58cdb5243c65ca773 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.721629 894 rpcz_store.cc:276] 0503 07:53:12.683582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.299578 (+615996us) service_pool.cc:224] Handling call
0503 07:53:13.325201 (+ 25623us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.325229 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:13.571185 (+245956us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.721374 (+150189us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:13.721506 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:13.747462 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b58c977f7f8c484d81e4ce565eea0688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.747802 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12c2f3cbf74edc9caf98853272c8b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:13.747869 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b58c977f7f8c484d81e4ce565eea0688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.748224 894 tablet_service.cc:1511] Processing CreateTablet for tablet c5691fe1fb1c476287c90f2ab4ff786b (DEFAULT_TABLE table=default.Table_2c645d37f74a43af81f917d309bd0cd8 [id=9649963741d74a7f9530255d4ced8e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.748298 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.748342 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_83bd2416af9c471d84f650f125aa4f20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.748719 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83bd2416af9c471d84f650f125aa4f20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.749715 745 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83 (DEFAULT_TABLE table=default.Table_599ffdae4ad6419799d2d72fb73675f7 [id=3925031ff6274f36a98b37ba90826281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.750141 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_de122583f1d04569a8cd54a86be61adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.750214 854 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: cc7a0272fdc34044af78ba21b6ca31bc
W20260503 07:53:13.750566 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de122583f1d04569a8cd54a86be61adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.751223 748 tablet_service.cc:1511] Processing CreateTablet for tablet f57c00249b9e49a4b7024e77c9b9980f (DEFAULT_TABLE table=default.Table_e49ae08f607b4c01950a4c2e9c04e701 [id=249f10bfb3f144b693ada847ef78214d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.752151 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83 (DEFAULT_TABLE table=default.Table_599ffdae4ad6419799d2d72fb73675f7 [id=3925031ff6274f36a98b37ba90826281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.752571 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.755594 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f57c00249b9e49a4b7024e77c9b9980f (DEFAULT_TABLE table=default.Table_e49ae08f607b4c01950a4c2e9c04e701 [id=249f10bfb3f144b693ada847ef78214d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.755975 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c00249b9e49a4b7024e77c9b9980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.759210 1174 ts_tablet_manager.cc:1916] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:13.763324 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet df60413555764bcab464b18c6a3370ce
I20260503 07:53:13.764156 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d] alter complete (version 2)
I20260503 07:53:13.764500 757 tablet_service.cc:1558] Processing DeleteTablet for tablet df60413555764bcab464b18c6a3370ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.764722 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fd4ff3ccaf7d4fd88e45a3c17630d26c" } new_table_name: "default.Table_bcd37dfb954e47209063a2499b1bef45" modify_external_catalogs: true
I20260503 07:53:13.764811 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_259468e6a8024773bb49c811211d3bfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.765261 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_259468e6a8024773bb49c811211d3bfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.766788 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_12ecbb3af87d4ca4bddbb7b3fd353682" } new_table_name: "default.Table_06fe37512806434ea9e275527368268d" modify_external_catalogs: true
I20260503 07:53:13.770768 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet df60413555764bcab464b18c6a3370ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.775211 1171 tablet_bootstrap.cc:492] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:53:13.775352 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7439917c2a764658bfa8bf62ba67e34f consensus state has no leader
I20260503 07:53:13.775410 1171 ts_tablet_manager.cc:1403] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.003s
I20260503 07:53:13.777479 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_09c8eef9feea45f19f8b5829ef46557a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.777988 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09c8eef9feea45f19f8b5829ef46557a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.778556 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_62d5856bc94e4d9a89760cf91368cb1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:13.778738 1171 raft_consensus.cc:359] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.778908 1171 raft_consensus.cc:385] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.778985 1171 raft_consensus.cc:740] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:13.778996 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62d5856bc94e4d9a89760cf91368cb1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.779227 1171 consensus_queue.cc:260] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:13.782795 1171 ts_tablet_manager.cc:1434] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:53:13.783851 1171 tablet_bootstrap.cc:492] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.785568 1171 tablet_bootstrap.cc:654] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.787479 757 tablet_service.cc:1511] Processing CreateTablet for tablet 11ba99bde68e470b810e56dc488af990 (DEFAULT_TABLE table=default.Table_1463c35f4b2842478f204ed142920e74 [id=60b81508db0c42caad3953bdd9d3a98a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.787786 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4db7807a41124ed192096d89fd740ddf consensus state has no leader
I20260503 07:53:13.788113 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_77bcc35ee59443529ee66397713e628b" } new_table_name: "default.Table_23080564cfaa4f5ca50f2fee8c6d5f87" modify_external_catalogs: true
I20260503 07:53:13.788058 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 11ba99bde68e470b810e56dc488af990 (DEFAULT_TABLE table=default.Table_1463c35f4b2842478f204ed142920e74 [id=60b81508db0c42caad3953bdd9d3a98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.789669 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ba99bde68e470b810e56dc488af990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.789640 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b] alter complete (version 2)
I20260503 07:53:13.793319 755 tablet_service.cc:1511] Processing CreateTablet for tablet 13ee6084657f408d84225ece852861f3 (DEFAULT_TABLE table=default.Table_628de4684f604a43b78f012131ac17aa [id=8596fbebad97418380f9eabec3d59437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.794117 756 tablet_service.cc:1511] Processing CreateTablet for tablet 03160137934e4709854746096e8b5159 (DEFAULT_TABLE table=default.Table_d624a887085f4e13a8cfadaaefd51833 [id=105a8973b6de43c4a9c7ca94d0370bc2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.796902 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5053947b21449b08a0fc487a49fb48f has no consensus state
I20260503 07:53:13.799412 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 03160137934e4709854746096e8b5159 (DEFAULT_TABLE table=default.Table_d624a887085f4e13a8cfadaaefd51833 [id=105a8973b6de43c4a9c7ca94d0370bc2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.799769 715 consensus_peers.cc:597] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:13.800057 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03160137934e4709854746096e8b5159. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.800311 715 consensus_peers.cc:597] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:13.804565 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 961d0f8f6daa4f359c15743ee42b9a87 (table default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73]). Expected version 3 got 2
I20260503 07:53:13.804729 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 618b858f6e424845b5a6b0010cb2b602 (table default.Table_a39a4fb4860242df95073cf5af334b14 [id=9e7c2b0fbe4546e4b77540e7967e5a8b]). Expected version 2 got 0
I20260503 07:53:13.808627 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 13ee6084657f408d84225ece852861f3 (DEFAULT_TABLE table=default.Table_628de4684f604a43b78f012131ac17aa [id=8596fbebad97418380f9eabec3d59437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.809046 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ee6084657f408d84225ece852861f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.817503 761 tablet_service.cc:1511] Processing CreateTablet for tablet 993372c2d7aa4681b2dc4c0f0738a34b (DEFAULT_TABLE table=default.Table_5c5cb92d3b904b77bcac954dae67f1fe [id=4b5f46b8c7d6474ba8f4010bba22dc34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.821025 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 993372c2d7aa4681b2dc4c0f0738a34b (DEFAULT_TABLE table=default.Table_5c5cb92d3b904b77bcac954dae67f1fe [id=4b5f46b8c7d6474ba8f4010bba22dc34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.821846 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993372c2d7aa4681b2dc4c0f0738a34b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.823737 746 tablet_service.cc:1511] Processing CreateTablet for tablet f8d3ed6f8cec419b9f581435941e6120 (DEFAULT_TABLE table=default.Table_8ad6cc39d6d049649adff267c37d808f [id=6b03c4e54a0e42b3b3395adfb0472c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.825275 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f8d3ed6f8cec419b9f581435941e6120 (DEFAULT_TABLE table=default.Table_8ad6cc39d6d049649adff267c37d808f [id=6b03c4e54a0e42b3b3395adfb0472c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.825623 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d3ed6f8cec419b9f581435941e6120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.804989 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:13.827104 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:13.828320 986 leader_election.cc:343] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.830405 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:13.830667 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (table default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683]). Expected version 1 got 0
I20260503 07:53:13.831241 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.831439 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630de41e4a344aec9510a8640e415308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.832026 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf] alter complete (version 2)
I20260503 07:53:13.832412 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c00249b9e49a4b7024e77c9b9980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.832562 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ba99bde68e470b810e56dc488af990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.832751 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03160137934e4709854746096e8b5159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.836279 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ee6084657f408d84225ece852861f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.841181 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.850728 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e128818985a435faf6a464fa9a9632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.851425 1174 ts_tablet_manager.cc:1929] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260503 07:53:13.851505 1174 log.cc:1199] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/766799446d1a480ca04246b0aec14852
I20260503 07:53:13.851802 1174 ts_tablet_manager.cc:1950] T 766799446d1a480ca04246b0aec14852 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:13.853071 593 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_59450820dd794914919442bb4ff92ab4 [id=f77e5c2d75e54caab615fea946fb7c73] alter complete (version 3)
I20260503 07:53:13.854712 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993372c2d7aa4681b2dc4c0f0738a34b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.854918 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d3ed6f8cec419b9f581435941e6120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.855623 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9f7bf46f985b4f68940463369aabab9b" } new_table_name: "default.Table_d72c27630a8149b98c4eecf8bd4e31e5" modify_external_catalogs: true
I20260503 07:53:13.857614 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ef6b39ff3b694d45b0661a39a3daf4d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.858115 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef6b39ff3b694d45b0661a39a3daf4d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.862887 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.863106 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.863106 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.863351 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.863391 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.865195 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a3110562e44a4af585a25ffb2275d993"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:13.865646 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3110562e44a4af585a25ffb2275d993 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:13.873842 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e4ba72b51a4343be56d56f93693939 with delete_type TABLET_DATA_DELETED (replaced by tablet 56f1c40961284bf0848c93ed6a09b111) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.874841 758 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:13.879066 2741 raft_consensus.cc:493] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:13.879207 2741 raft_consensus.cc:515] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.879503 599 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (table default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683]). Expected version 1 got 0
I20260503 07:53:13.879805 2741 leader_election.cc:290] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:13.880509 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:13.881480 986 leader_election.cc:343] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:13.878844 758 tablet_service.cc:1511] Processing CreateTablet for tablet f1b2ebdcdf1242adbc214ab249cf0da3 (DEFAULT_TABLE table=default.Table_82323a14647f400dbb8478aa5bf61765 [id=52ed2219a3ad4f78ba1ae3f96121d3f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.882143 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b2ebdcdf1242adbc214ab249cf0da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.882869 1171 tablet_bootstrap.cc:492] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:13.882985 1171 ts_tablet_manager.cc:1403] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.001s
I20260503 07:53:13.884047 1171 raft_consensus.cc:359] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.884253 1171 raft_consensus.cc:385] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:13.884310 1171 raft_consensus.cc:740] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:13.884487 1171 consensus_queue.cc:260] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:13.885345 1171 ts_tablet_manager.cc:1434] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:13.888978 1031 tablet_service.cc:1511] Processing CreateTablet for tablet cfdeda899382495fb56a83f3787c9dc6 (DEFAULT_TABLE table=default.Table_73824774ba964016a8a3b4848d08c96e [id=fb1df883c9464f95a7306b35cff31540]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:13.889647 715 consensus_peers.cc:597] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:13.890599 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f1b2ebdcdf1242adbc214ab249cf0da3 (DEFAULT_TABLE table=default.Table_82323a14647f400dbb8478aa5bf61765 [id=52ed2219a3ad4f78ba1ae3f96121d3f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.892232 1171 tablet_bootstrap.cc:492] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:13.893841 1171 tablet_bootstrap.cc:654] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:13.895140 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdeda899382495fb56a83f3787c9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.895737 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b2ebdcdf1242adbc214ab249cf0da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.901175 1031 tablet_service.cc:1511] Processing CreateTablet for tablet cb5a17d9b3c94cf0942a1f347edb0b7a (DEFAULT_TABLE table=default.Table_92bee268b15c4d1d83e558a015ad1d99 [id=585f2dc09fa94114bcd477530dbd96d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.901573 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5a17d9b3c94cf0942a1f347edb0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.902417 748 tablet_service.cc:1511] Processing CreateTablet for tablet 5c121ab35371482b9906b19508862b79 (DEFAULT_TABLE table=default.Table_c7766fda640c49a2afed2609e29794d0 [id=d39cea352e7e4a80b8f05678086f7c75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.902513 761 tablet_service.cc:1511] Processing CreateTablet for tablet f77380a1723b46e59b5caba110c8e91a (DEFAULT_TABLE table=default.Table_48488b7948bf4e2ea071f418c80ec3e7 [id=ac585d46c4b54de094d72dc8e4085736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.902984 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f77380a1723b46e59b5caba110c8e91a (DEFAULT_TABLE table=default.Table_48488b7948bf4e2ea071f418c80ec3e7 [id=ac585d46c4b54de094d72dc8e4085736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.903298 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77380a1723b46e59b5caba110c8e91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.906734 745 tablet_service.cc:1511] Processing CreateTablet for tablet cb5a17d9b3c94cf0942a1f347edb0b7a (DEFAULT_TABLE table=default.Table_92bee268b15c4d1d83e558a015ad1d99 [id=585f2dc09fa94114bcd477530dbd96d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.907910 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 00553b47c50d476dad6fc66517ec7597 (DEFAULT_TABLE table=default.Table_0195509e330240618611fc0d78414554 [id=d975ac2575594357849223a88417cf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.908288 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00553b47c50d476dad6fc66517ec7597. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.913471 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81403b8a897b4e58a0f301d36d76dc8a consensus state has no leader
I20260503 07:53:13.913988 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6644f47cf4974ac28fcc3d3529d0b88f" } new_table_name: "default.Table_742cc8c076f44cca9dcc6c151008ef8f" modify_external_catalogs: true
I20260503 07:53:13.915709 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef452f8361c4aedbac532c5f7669612 (DEFAULT_TABLE table=default.Table_c9c4f91172e64186b6c083959ecc2b32 [id=63099743f58a4e16b0748ada82fbfd48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.916079 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef452f8361c4aedbac532c5f7669612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.917593 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1d33b7920244493683c5f12e1bef5a9a" } modify_external_catalogs: true
I20260503 07:53:13.917726 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1d33b7920244493683c5f12e1bef5a9a" } modify_external_catalogs: true
I20260503 07:53:13.918635 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5c121ab35371482b9906b19508862b79 (DEFAULT_TABLE table=default.Table_c7766fda640c49a2afed2609e29794d0 [id=d39cea352e7e4a80b8f05678086f7c75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.918956 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c121ab35371482b9906b19508862b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.918911 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_914d5e7cae5146b78cb18e6e57795d15" } modify_external_catalogs: true
I20260503 07:53:13.919051 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_914d5e7cae5146b78cb18e6e57795d15" } modify_external_catalogs: true
I20260503 07:53:13.920542 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8ce2b0ef0031470695ebd84edbc7a458" } modify_external_catalogs: true
I20260503 07:53:13.920681 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8ce2b0ef0031470695ebd84edbc7a458" } modify_external_catalogs: true
I20260503 07:53:13.914815 750 tablet_service.cc:1511] Processing CreateTablet for tablet 00553b47c50d476dad6fc66517ec7597 (DEFAULT_TABLE table=default.Table_0195509e330240618611fc0d78414554 [id=d975ac2575594357849223a88417cf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.915117 746 tablet_service.cc:1511] Processing CreateTablet for tablet 5f42346173b2401eac1a2c5abcb532ee (DEFAULT_TABLE table=default.Table_04db65b076f54c28b6b7712c3f86c5e9 [id=865af6f77f084e6d8c01b178f137e7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.918087 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef452f8361c4aedbac532c5f7669612 (DEFAULT_TABLE table=default.Table_c9c4f91172e64186b6c083959ecc2b32 [id=63099743f58a4e16b0748ada82fbfd48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.923549 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 5f42346173b2401eac1a2c5abcb532ee (DEFAULT_TABLE table=default.Table_04db65b076f54c28b6b7712c3f86c5e9 [id=865af6f77f084e6d8c01b178f137e7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.923733 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4 (DEFAULT_TABLE table=default.Table_253eaeecc7a64835a66c6d4b0d0d1265 [id=24f3b86affa94a89b6639bf1283ffbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.923862 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f42346173b2401eac1a2c5abcb532ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.930586 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d (DEFAULT_TABLE table=default.Table_4e50c697b3d540baa679fe0efe2c6f66 [id=54910ba0f75a422398d3e582327fffc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.931921 752 tablet_service.cc:1511] Processing CreateTablet for tablet cfdeda899382495fb56a83f3787c9dc6 (DEFAULT_TABLE table=default.Table_73824774ba964016a8a3b4848d08c96e [id=fb1df883c9464f95a7306b35cff31540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.934803 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_399e3cb559dc48b69df2badacac96f6c" } modify_external_catalogs: true
I20260503 07:53:13.934964 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_399e3cb559dc48b69df2badacac96f6c" } modify_external_catalogs: true
I20260503 07:53:13.936439 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 994d9de9bf5b4dfa9157f84ccd59e294
I20260503 07:53:13.937685 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.939859 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d (DEFAULT_TABLE table=default.Table_4e50c697b3d540baa679fe0efe2c6f66 [id=54910ba0f75a422398d3e582327fffc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.940338 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.940663 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 587dd9dc4f46439e89f216a448118b40 (DEFAULT_TABLE table=default.Table_e53d2641455c498bb608719816f52f01 [id=3a198bbb1b4f421b83a7f0c01d3cf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.940968 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587dd9dc4f46439e89f216a448118b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.942022 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d7b31b3076214d37a744faa4fa8d585b
I20260503 07:53:13.942340 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c121ab35371482b9906b19508862b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.943328 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b31b3076214d37a744faa4fa8d585b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.944434 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6954ec38f7f742eaa7cc05af5b1432d0
I20260503 07:53:13.944542 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4 (DEFAULT_TABLE table=default.Table_253eaeecc7a64835a66c6d4b0d0d1265 [id=24f3b86affa94a89b6639bf1283ffbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.944832 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.945721 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:13.947293 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cc50575cb85463d862e95757a35cfd5 consensus state has no leader
I20260503 07:53:13.948050 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 26032d89839340988fce30f458e785fa
I20260503 07:53:13.949602 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 26032d89839340988fce30f458e785fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.952107 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 582afcb966544e408824d08422aca361 (DEFAULT_TABLE table=default.Table_50c245acca104d69a65c531ca977cb1e [id=2b0abef9c9c74f1bbfd2194e4a82447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.952731 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 582afcb966544e408824d08422aca361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.955935 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 1a387b0b4db7488ba83b9a4f83b68a3c (DEFAULT_TABLE table=default.Table_bcb50750ce5b4b47bc4a79e45df1d2aa [id=fcf783f3d6294e6ea87aed598eab4fc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.956295 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a387b0b4db7488ba83b9a4f83b68a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.959873 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c4ba5e9cfe6b4f24a8f91c571416dae3 (table default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683]). Expected version 1 got 0
I20260503 07:53:13.962478 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 956600f557b84dac98be63ffe14f4e19 with delete_type TABLET_DATA_DELETED (replaced by tablet 5cc695ff556240299788c02f416410c2) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.967275 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1a31915dab804360889f9e08e8eb20bd" } modify_external_catalogs: true
I20260503 07:53:13.967518 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1a31915dab804360889f9e08e8eb20bd" } modify_external_catalogs: true
I20260503 07:53:13.976752 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0e624ecc7a044b14861260875b044676" } new_table_name: "default.Table_b74a333f50764fad86944c5a2acf2d27" modify_external_catalogs: true
I20260503 07:53:13.976954 1018 tablet_service.cc:1511] Processing CreateTablet for tablet a40623d2232f46c19273465065daeede (DEFAULT_TABLE table=default.Table_24b516f2c05c4191af1ebc827eafb9f3 [id=6b79fa8821a141ac91b14cf6c3a4ee07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.977348 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40623d2232f46c19273465065daeede. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:13.982720 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 157bb83e56234f17b906756c0d70868c consensus state has no leader
I20260503 07:53:13.985080 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 19055009ccee4912868eb09094d5e0c5 (DEFAULT_TABLE table=default.Table_8e07bd717fe1461494b19abec87c60c1 [id=b50ba4c980834664ab6534b513f16288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.985500 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19055009ccee4912868eb09094d5e0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.985870 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c9fdc7738d1e4df6aed3a85c4cee3f72
I20260503 07:53:13.986606 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 (DEFAULT_TABLE table=default.Table_54f67bdae2284d7e8da41e63d8f74ba0 [id=7d65cfe5f9334c1a819f114b6177a94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.992633 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b87484809fe040a2bd35bf2b9a44344d" } new_table_name: "default.Table_a5140b7fd8634be689ba6e555a647016" modify_external_catalogs: true
I20260503 07:53:13.989557 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 37bd4b226f924db2ad47395ca5a186d0 (DEFAULT_TABLE table=default.Table_154420e661fb4056a6fccefb241138d1 [id=95d1d6253dd54bba80724852afef9781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:13.989846 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:13.997327 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f3cee208e54c8d812ad3dc66b9e932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.997481 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bd4b226f924db2ad47395ca5a186d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.999765 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bacfe879a66646fb88d9daa8623de480" } new_table_name: "default.Table_d6b996e8d1df4e11bcc4c76da44a2dac" modify_external_catalogs: true
I20260503 07:53:14.001247 2565 consensus_queue.cc:1048] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:14.002935 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d52b85a5cd74d2385814258399ca2d2 consensus state has no leader
W20260503 07:53:14.009114 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59a311dc5ec244fab0cdd8e5c1d58cee consensus state has no leader
I20260503 07:53:14.009228 2740 raft_consensus.cc:493] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.009343 2740 raft_consensus.cc:515] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.009826 2740 leader_election.cc:290] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.012881 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb (DEFAULT_TABLE table=default.Table_768f2bbd81ba4c42a44e594809b502c6 [id=cc29cdf2141e46659376053724a6ce06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.013252 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.018021 1033 tablet_service.cc:1511] Processing CreateTablet for tablet dbd64e91efd546cd9e1bcfa45d573399 (DEFAULT_TABLE table=default.Table_8bb00152ef6245dbb9401fb10277a5d3 [id=a0416f7774e64bed884ea84f3cdd6eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.018961 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd64e91efd546cd9e1bcfa45d573399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:13.973809 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba5f770a448465491160fc72f66a830" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:13.975073 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:13.975369 2759 raft_consensus.cc:493] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.021476 2759 raft_consensus.cc:515] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.022167 2759 leader_election.cc:290] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:14.022951 854 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 61316b7a521e42a59bf955179b080f40
W20260503 07:53:13.804374 851 leader_election.cc:343] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:14.023243 851 leader_election.cc:304] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.023463 2759 raft_consensus.cc:2749] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:14.023737 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 219363us
W20260503 07:53:14.023927 851 leader_election.cc:343] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e16d225dde3247d1b61a03cf14b21d63
I20260503 07:53:14.024036 851 leader_election.cc:304] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.024916 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2a9ae2200bc2451c9be9d6b121e695a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.025431 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a9ae2200bc2451c9be9d6b121e695a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.031503 2740 raft_consensus.cc:493] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.031646 2740 raft_consensus.cc:515] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.032578 2740 leader_election.cc:290] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.059553 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f42346173b2401eac1a2c5abcb532ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.060348 1171 tablet_bootstrap.cc:492] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.060520 1171 ts_tablet_manager.cc:1403] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.169s user 0.005s sys 0.012s
I20260503 07:53:14.061534 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 914) took 6127 ms. Trace:
I20260503 07:53:14.061637 1174 rpcz_store.cc:276] 0503 07:53:07.934409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.934459 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:13.622484 (+5688025us) ts_tablet_manager.cc:1151] Deleting tablet 766799446d1a480ca04246b0aec14852
0503 07:53:13.622492 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:13.848734 (+226242us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:13.851384 (+ 2650us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.061510 (+210126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5687875}
I20260503 07:53:14.061992 1171 raft_consensus.cc:359] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.062192 1171 raft_consensus.cc:385] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.062250 1171 raft_consensus.cc:740] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.062492 1171 consensus_queue.cc:260] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.062578 2812 tablet.cc:1724] T 961d0f8f6daa4f359c15743ee42b9a87 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:14.063544 1171 ts_tablet_manager.cc:1434] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:14.064381 1171 tablet_bootstrap.cc:492] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:14.065667 851 raft_consensus.cc:2686] T e16d225dde3247d1b61a03cf14b21d63 P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260503 07:53:14.066021 851 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:14.066061 1171 tablet_bootstrap.cc:654] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.066126 851 leader_election.cc:304] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.073525 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.073916 744 tablet_service.cc:1511] Processing CreateTablet for tablet 587dd9dc4f46439e89f216a448118b40 (DEFAULT_TABLE table=default.Table_e53d2641455c498bb608719816f52f01 [id=3a198bbb1b4f421b83a7f0c01d3cf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.074723 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 26032d89839340988fce30f458e785fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.075299 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.075452 741 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b31b3076214d37a744faa4fa8d585b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.076882 747 tablet_service.cc:1511] Processing CreateTablet for tablet a40623d2232f46c19273465065daeede (DEFAULT_TABLE table=default.Table_24b516f2c05c4191af1ebc827eafb9f3 [id=6b79fa8821a141ac91b14cf6c3a4ee07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.078166 741 tablet_service.cc:1511] Processing CreateTablet for tablet 1a387b0b4db7488ba83b9a4f83b68a3c (DEFAULT_TABLE table=default.Table_bcb50750ce5b4b47bc4a79e45df1d2aa [id=fcf783f3d6294e6ea87aed598eab4fc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.078581 743 tablet_service.cc:1511] Processing CreateTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 (DEFAULT_TABLE table=default.Table_54f67bdae2284d7e8da41e63d8f74ba0 [id=7d65cfe5f9334c1a819f114b6177a94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.078975 754 tablet_service.cc:1511] Processing CreateTablet for tablet 582afcb966544e408824d08422aca361 (DEFAULT_TABLE table=default.Table_50c245acca104d69a65c531ca977cb1e [id=2b0abef9c9c74f1bbfd2194e4a82447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.079067 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_71d50bc9af074908b69e040f98a93ba1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.079742 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71d50bc9af074908b69e040f98a93ba1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.081260 753 tablet_service.cc:1511] Processing CreateTablet for tablet 19055009ccee4912868eb09094d5e0c5 (DEFAULT_TABLE table=default.Table_8e07bd717fe1461494b19abec87c60c1 [id=b50ba4c980834664ab6534b513f16288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.081609 760 tablet_service.cc:1511] Processing CreateTablet for tablet 37bd4b226f924db2ad47395ca5a186d0 (DEFAULT_TABLE table=default.Table_154420e661fb4056a6fccefb241138d1 [id=95d1d6253dd54bba80724852afef9781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.081950 751 tablet_service.cc:1511] Processing CreateTablet for tablet dbd64e91efd546cd9e1bcfa45d573399 (DEFAULT_TABLE table=default.Table_8bb00152ef6245dbb9401fb10277a5d3 [id=a0416f7774e64bed884ea84f3cdd6eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.082311 742 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.083045 759 tablet_service.cc:1511] Processing CreateTablet for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb (DEFAULT_TABLE table=default.Table_768f2bbd81ba4c42a44e594809b502c6 [id=cc29cdf2141e46659376053724a6ce06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.083659 2759 raft_consensus.cc:2749] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:14.084358 851 leader_election.cc:343] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8fb4d150eadb479d9978f2450637bd3e
I20260503 07:53:14.084467 851 leader_election.cc:304] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:14.084635 851 raft_consensus.cc:2686] T 8fb4d150eadb479d9978f2450637bd3e P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260503 07:53:14.084861 851 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:14.084944 851 leader_election.cc:304] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.087106 2769 tablet.cc:1724] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:14.088388 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 766799446d1a480ca04246b0aec14852 (table default.Table_07d524476f694b8ea7ce95c0fc005807 [id=c9513d6e491a4250894ed7225db630fe]) successfully deleted
I20260503 07:53:14.088737 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e5559d16a8e243dab7cd61db43c0d0c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.089128 2814 tablet.cc:1724] T 618b858f6e424845b5a6b0010cb2b602 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260503 07:53:14.089265 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5559d16a8e243dab7cd61db43c0d0c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.090569 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.093077 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.093499 1171 tablet_bootstrap.cc:492] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.093658 1171 ts_tablet_manager.cc:1403] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.001s
I20260503 07:53:14.094620 1171 raft_consensus.cc:359] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.094825 1171 raft_consensus.cc:385] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.094878 1171 raft_consensus.cc:740] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:14.096887 986 leader_election.cc:343] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.098583 1171 consensus_queue.cc:260] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.099429 1171 ts_tablet_manager.cc:1434] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:53:14.100226 1171 tablet_bootstrap.cc:492] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.102598 1171 tablet_bootstrap.cc:654] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.104257 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_807644122a02408798de0c8b502b0b07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.104306 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3879045db74d4863b8f62d2aff4c31ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.104826 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_807644122a02408798de0c8b502b0b07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.104833 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3879045db74d4863b8f62d2aff4c31ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.107211 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c386b16f4d974890a8fd5df867c9e88f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.107314 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4f525a07b4e84b15abed3e131a3fedc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.107666 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c386b16f4d974890a8fd5df867c9e88f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.107761 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f525a07b4e84b15abed3e131a3fedc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.108799 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d35fc80f52954a3b9f7308f0889787cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.109191 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d35fc80f52954a3b9f7308f0889787cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.110126 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_eea1b385145a4989855907d5eed02328"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.110512 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eea1b385145a4989855907d5eed02328 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.110916 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.111634 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.111807 774 raft_consensus.cc:2468] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:14.111953 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00553b47c50d476dad6fc66517ec7597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.111894 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ca0e7ac763ef44d49ee51109f02130ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.112212 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77380a1723b46e59b5caba110c8e91a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.112323 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca0e7ac763ef44d49ee51109f02130ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.112809 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef452f8361c4aedbac532c5f7669612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.113341 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.120710 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd64e91efd546cd9e1bcfa45d573399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.120736 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 915) took 6176 ms. Trace:
I20260503 07:53:14.120887 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bd4b226f924db2ad47395ca5a186d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.120818 1174 rpcz_store.cc:276] 0503 07:53:07.943924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.947477 (+ 3553us) service_pool.cc:224] Handling call
0503 07:53:14.062046 (+6114569us) ts_tablet_manager.cc:1151] Deleting tablet 5f7d50c1575341bca6673a3cd887415e
0503 07:53:14.114388 (+ 52342us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.120716 (+ 6328us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6114372}
I20260503 07:53:14.121078 1174 tablet_replica.cc:333] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:14.121398 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.121675 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40623d2232f46c19273465065daeede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.122226 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5a17d9b3c94cf0942a1f347edb0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.122676 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 582afcb966544e408824d08422aca361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.124368 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.133675 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cd38962a2bde408a982af1b52836a26a" } new_table_name: "default.Table_6113ef1077fb4e63ab5ae49b1e7a8eea" modify_external_catalogs: true
I20260503 07:53:14.138909 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d00be731a08f4242a005057e341dd1d7" } modify_external_catalogs: true
I20260503 07:53:14.139091 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d00be731a08f4242a005057e341dd1d7" } modify_external_catalogs: true
I20260503 07:53:14.143286 1174 raft_consensus.cc:2243] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:14.143494 1174 raft_consensus.cc:2272] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:14.144032 1174 ts_tablet_manager.cc:1916] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:14.144553 1175 ts_tablet_manager.cc:1929] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:14.144655 1175 log.cc:1199] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c9457d5693eb4f3da5501a0e581fe75c
I20260503 07:53:14.145002 1175 ts_tablet_manager.cc:1950] T c9457d5693eb4f3da5501a0e581fe75c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:14.145545 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a387b0b4db7488ba83b9a4f83b68a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.145761 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 991) took 5744 ms. Trace:
I20260503 07:53:14.145833 1175 rpcz_store.cc:276] 0503 07:53:08.401766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.401821 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:13.615415 (+5213594us) ts_tablet_manager.cc:1151] Deleting tablet c9457d5693eb4f3da5501a0e581fe75c
0503 07:53:13.615423 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.026221 (+410798us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.144484 (+118263us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.145742 (+ 1258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5213394}
I20260503 07:53:14.146281 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 987) took 5852 ms. Trace:
I20260503 07:53:14.146405 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587dd9dc4f46439e89f216a448118b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.146353 1175 rpcz_store.cc:276] 0503 07:53:08.293378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.327146 (+ 33768us) service_pool.cc:224] Handling call
0503 07:53:14.146158 (+5819012us) ts_tablet_manager.cc:1151] Deleting tablet e66033d0ee71439cba1545815aa5213f
0503 07:53:14.146167 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.146264 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5710267}
I20260503 07:53:14.146628 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 990) took 5778 ms. Trace:
I20260503 07:53:14.146693 1175 rpcz_store.cc:276] 0503 07:53:08.368311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.373992 (+ 5681us) service_pool.cc:224] Handling call
0503 07:53:14.146539 (+5772547us) ts_tablet_manager.cc:1151] Deleting tablet 78b3210d1ecd42198e080b02a8b594a5
0503 07:53:14.146547 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.146614 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5634174}
I20260503 07:53:14.146798 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f3cee208e54c8d812ad3dc66b9e932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.146941 1175 tablet_replica.cc:333] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:53:14.146974 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5e540b4e5a046e78af3e61858e1fc42 consensus state has no leader
I20260503 07:53:14.147060 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19055009ccee4912868eb09094d5e0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.147143 1175 raft_consensus.cc:2243] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:14.147401 1175 raft_consensus.cc:2272] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:14.147926 1175 ts_tablet_manager.cc:1916] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:14.148456 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8ad6cc39d6d049649adff267c37d808f" } modify_external_catalogs: true
I20260503 07:53:14.148804 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ca3bd12cae99485f821af37a50f557b0" } modify_external_catalogs: true
I20260503 07:53:14.148962 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdeda899382495fb56a83f3787c9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.148945 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ca3bd12cae99485f821af37a50f557b0" } modify_external_catalogs: true
I20260503 07:53:14.149786 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3811f4c1bc364be0bd601ca29c32140f" } new_table_name: "default.Table_2e796ff4d91140059cd7db8c8e61727c" modify_external_catalogs: true
I20260503 07:53:14.150041 2759 raft_consensus.cc:2749] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:14.150094 2386 raft_consensus.cc:493] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.150187 2386 raft_consensus.cc:515] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:14.150367 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 65508.3us
W20260503 07:53:14.150558 851 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:14.150650 851 leader_election.cc:304] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.150744 2386 leader_election.cc:290] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:14.150847 2386 raft_consensus.cc:2749] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:14.151015 851 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f
I20260503 07:53:14.151310 2759 raft_consensus.cc:2804] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:53:14.151381 2759 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:14.151487 2759 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:53:14.154148 2759 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.154277 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a0ee731928df4482a308e4cbc95906ac" } modify_external_catalogs: true
I20260503 07:53:14.154412 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a0ee731928df4482a308e4cbc95906ac" } modify_external_catalogs: true
I20260503 07:53:14.155181 2759 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.155146 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:14.156625 2802 raft_consensus.cc:493] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.156800 2802 raft_consensus.cc:515] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.157574 2802 leader_election.cc:290] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:14.160727 854 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:14.162500 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]) successfully deleted
W20260503 07:53:14.162719 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e66033d0ee71439cba1545815aa5213f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66033d0ee71439cba1545815aa5213f already in progress: creating tablet
W20260503 07:53:14.162915 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 78b3210d1ecd42198e080b02a8b594a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3210d1ecd42198e080b02a8b594a5 already in progress: creating tablet
I20260503 07:53:14.163847 2802 raft_consensus.cc:493] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.163964 2802 raft_consensus.cc:515] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:14.164294 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6d1885dda594c1f9c1039111af4ce9b consensus state has no leader
I20260503 07:53:14.164499 2802 leader_election.cc:290] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.150874 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8ad6cc39d6d049649adff267c37d808f" } modify_external_catalogs: true
I20260503 07:53:14.178439 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e4ba72b51a4343be56d56f93693939 with delete_type TABLET_DATA_DELETED (replaced by tablet 56f1c40961284bf0848c93ed6a09b111) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:14.182978 851 leader_election.cc:343] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:14.183109 851 leader_election.cc:304] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.183342 2759 raft_consensus.cc:2749] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:14.183671 851 leader_election.cc:343] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:14.183758 851 leader_election.cc:304] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.183929 2759 raft_consensus.cc:2749] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:14.184352 851 leader_election.cc:343] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:14.184445 851 leader_election.cc:304] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.184640 2759 raft_consensus.cc:2749] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:14.185528 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eabb4e1af013438dab101a4c7c684255" } new_table_name: "default.Table_2c1a124adcda48b69262f1c3fbe14f84" modify_external_catalogs: true
I20260503 07:53:14.186849 2759 raft_consensus.cc:493] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.187069 2759 raft_consensus.cc:515] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.188067 2759 leader_election.cc:290] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:14.188681 854 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:14.188843 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f8d3ed6f8cec419b9f581435941e6120
I20260503 07:53:14.189566 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.193006 776 raft_consensus.cc:2468] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:14.195087 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:14.196899 1171 tablet_bootstrap.cc:492] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.197095 1171 ts_tablet_manager.cc:1403] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.097s user 0.003s sys 0.000s
I20260503 07:53:14.198153 1171 raft_consensus.cc:359] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.198380 1171 raft_consensus.cc:385] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.198450 1171 raft_consensus.cc:740] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.198737 1171 consensus_queue.cc:260] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.199297 1171 ts_tablet_manager.cc:1434] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:14.200111 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11cf25210559486dacae5baa7290ef46" } modify_external_catalogs: true
I20260503 07:53:14.200309 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_11cf25210559486dacae5baa7290ef46" } modify_external_catalogs: true
I20260503 07:53:14.208027 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3ee38ccde55442c3aca112e70aec602e" } new_table_name: "default.Table_290176d151124c099354999be2d92a20" modify_external_catalogs: true
I20260503 07:53:14.209510 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 26da686862f44940b13c7790e00ea3b1
W20260503 07:53:14.211274 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9965fee9d08749b6b39c82e99fdcfbef consensus state has no leader
I20260503 07:53:14.211767 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9781f3c5bf124f8a8c0924bda4299878" } new_table_name: "default.Table_6326cbddf0e04cec8b961d8ce34de108" modify_external_catalogs: true
I20260503 07:53:14.212452 2802 raft_consensus.cc:493] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.212621 2802 raft_consensus.cc:515] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.213223 2802 leader_election.cc:290] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.216645 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet f8d3ed6f8cec419b9f581435941e6120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.216984 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 26da686862f44940b13c7790e00ea3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:14.222301 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ceb075e64164ae1ab0c0d6b2d7cc975 consensus state has no leader
I20260503 07:53:14.222348 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.222774 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:14.223809 1165 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.060s sys 0.088s
W20260503 07:53:14.223951 1165 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.604s user 0.060s sys 0.088s
I20260503 07:53:14.224445 1171 tablet_bootstrap.cc:492] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.224619 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.205083 2708 consensus_queue.cc:1048] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260503 07:53:14.225032 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.225814 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.230341 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:14.232543 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b90ec3eb3894c18825ebe5fb79fa5be consensus state has no leader
I20260503 07:53:14.234776 1171 tablet_bootstrap.cc:654] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.248656 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cd4cd700b0664401a92371c9ea522087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.249293 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd4cd700b0664401a92371c9ea522087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.260828 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.261070 772 raft_consensus.cc:2468] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:14.262106 1171 tablet_bootstrap.cc:492] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.262338 1171 ts_tablet_manager.cc:1403] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.002s
W20260503 07:53:14.262854 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5f7d50c1575341bca6673a3cd887415e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7d50c1575341bca6673a3cd887415e already in progress: creating tablet
I20260503 07:53:14.263620 2708 raft_consensus.cc:493] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.263540 1171 raft_consensus.cc:359] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.263794 1171 raft_consensus.cc:385] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.263794 2708 raft_consensus.cc:515] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.263885 1171 raft_consensus.cc:740] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.264626 2708 leader_election.cc:290] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.264381 1171 consensus_queue.cc:260] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.265111 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.265403 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:14.265568 1052 raft_consensus.cc:2468] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:14.265563 715 leader_election.cc:343] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.266853 716 leader_election.cc:304] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:14.268577 986 leader_election.cc:304] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.269153 2740 raft_consensus.cc:2804] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.269243 2740 raft_consensus.cc:493] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.269325 2740 raft_consensus.cc:3060] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.272560 1171 ts_tablet_manager.cc:1434] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:53:14.273228 2708 raft_consensus.cc:2804] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.273340 2708 raft_consensus.cc:493] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.273447 2708 raft_consensus.cc:3060] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.273813 1171 tablet_bootstrap.cc:492] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.274900 2740 raft_consensus.cc:515] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.275490 1171 tablet_bootstrap.cc:654] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.275593 2740 leader_election.cc:290] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.276891 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 10a29807ce9b4ccabafeb059afb9bdae
I20260503 07:53:14.278553 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 17db30b1109845d783ade7c4860a3d0d
I20260503 07:53:14.279253 986 leader_election.cc:304] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.279588 2719 raft_consensus.cc:2804] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.279662 2719 raft_consensus.cc:493] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.279732 2719 raft_consensus.cc:3060] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.279978 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1df4fefd52434b118e1ed016d5d629bb
I20260503 07:53:14.282213 2719 raft_consensus.cc:515] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.282727 2719 leader_election.cc:290] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:14.283084 986 leader_election.cc:343] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:14.283440 851 service_pool.cc:136] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260503 07:53:14.283859 986 leader_election.cc:304] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.284183 2816 raft_consensus.cc:2804] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.284265 2816 raft_consensus.cc:493] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.284337 2816 raft_consensus.cc:3060] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.285207 1171 tablet_bootstrap.cc:492] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.285326 1171 ts_tablet_manager.cc:1403] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260503 07:53:14.287285 2816 raft_consensus.cc:515] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.287858 2816 leader_election.cc:290] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.288004 1171 raft_consensus.cc:359] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.288339 1171 raft_consensus.cc:385] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.288395 1171 raft_consensus.cc:740] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.289222 1171 consensus_queue.cc:260] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.290494 1171 ts_tablet_manager.cc:1434] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:14.291340 1171 tablet_bootstrap.cc:492] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.292207 2740 raft_consensus.cc:493] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.292371 2740 raft_consensus.cc:515] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.292881 2740 leader_election.cc:290] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.293252 2690 raft_consensus.cc:493] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.293386 2690 raft_consensus.cc:515] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.294235 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3e693dd73ff742449e6a82af7b68f122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.294770 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e693dd73ff742449e6a82af7b68f122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.295974 2608 consensus_queue.cc:1048] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:14.299226 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5098542c58ab427c830fe36eaf5110d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.299707 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5098542c58ab427c830fe36eaf5110d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.303292 2690 leader_election.cc:290] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.303755 1171 tablet_bootstrap.cc:654] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.304023 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e4ba72b51a4343be56d56f93693939" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:14.304226 1051 raft_consensus.cc:2468] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:14.304908 1165 tablet_bootstrap.cc:492] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:14.305055 1165 ts_tablet_manager.cc:1403] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.757s user 0.062s sys 0.088s
I20260503 07:53:14.305147 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e4ba72b51a4343be56d56f93693939" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.308908 716 leader_election.cc:304] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.309563 2741 raft_consensus.cc:493] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.309679 2741 raft_consensus.cc:515] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.310171 2741 leader_election.cc:290] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.310272 2741 raft_consensus.cc:493] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.310354 2741 raft_consensus.cc:515] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.310770 2741 leader_election.cc:290] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.322973 1171 tablet_bootstrap.cc:492] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.323206 1171 ts_tablet_manager.cc:1403] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.003s
I20260503 07:53:14.324234 1171 raft_consensus.cc:359] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.324523 1171 raft_consensus.cc:385] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.324630 1171 raft_consensus.cc:740] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.325369 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b11f056d948f43f5a39c9b846137d9c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.326045 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b11f056d948f43f5a39c9b846137d9c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.324944 1171 consensus_queue.cc:260] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:14.328089 988 leader_election.cc:343] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.328486 1171 ts_tablet_manager.cc:1434] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:14.328819 1171 tablet_bootstrap.cc:492] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.330747 2740 raft_consensus.cc:493] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.331326 2740 raft_consensus.cc:515] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.331885 2740 leader_election.cc:290] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.334029 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_449c7851c1704ea496ea74632c7ea2da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.334148 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_5eb646eacf084a7dbebf001fe2b34e7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.334524 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_449c7851c1704ea496ea74632c7ea2da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.335817 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet ab5cd04df830423489b9ff027d7cd5f5 (table default.Table_c5fdbeaed33b49deb1ec020c18ae97b8 [id=e20bd840c43f47beb6e1f3b3ecc9d2c2], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet ab5cd04df830423489b9ff027d7cd5f5 consensus state has no leader
I20260503 07:53:14.336055 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6704a05ca52c4a8cad6e31d38118f26e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.336475 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6704a05ca52c4a8cad6e31d38118f26e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.337536 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1a972fa442ce4877b5d2b2685e03d49e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.337917 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a972fa442ce4877b5d2b2685e03d49e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.334535 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eb646eacf084a7dbebf001fe2b34e7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.342483 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1fa913322e01470c9941e894f6a75e75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.342743 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7e8b1843f23145218ea02f3f48c49572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.342895 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fa913322e01470c9941e894f6a75e75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.343142 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e8b1843f23145218ea02f3f48c49572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.343588 1175 ts_tablet_manager.cc:1929] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:14.343688 1175 log.cc:1199] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/56749914e1a349f0876f52157affdf69
I20260503 07:53:14.344024 1175 ts_tablet_manager.cc:1950] T 56749914e1a349f0876f52157affdf69 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:14.345093 988 leader_election.cc:343] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:14.345341 988 leader_election.cc:343] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.345422 988 leader_election.cc:304] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:14.347048 2816 raft_consensus.cc:2749] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:14.349807 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2cd812f25c7a4451a75b9bffc7add74b" } new_table_name: "default.Table_816d39d53d854f0f8b044d80b01bc38e" modify_external_catalogs: true
I20260503 07:53:14.351704 1171 tablet_bootstrap.cc:654] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.354307 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 532037d672cf49afac0be969e6978589 (DEFAULT_TABLE table=default.Table_09c8eef9feea45f19f8b5829ef46557a [id=e5090a30fd5f4f7c9cab1d33f0bcb6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.354696 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532037d672cf49afac0be969e6978589. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.358563 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0db2824974ab454c84172ec3d27e5aa5 consensus state has no leader
I20260503 07:53:14.309165 2690 raft_consensus.cc:2804] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.360347 2690 raft_consensus.cc:493] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.360446 2690 raft_consensus.cc:3060] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:14.309382 715 leader_election.cc:343] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:14.360816 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 51437us
I20260503 07:53:14.365150 1165 raft_consensus.cc:359] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.366012 1165 raft_consensus.cc:385] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.366080 1165 raft_consensus.cc:740] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.366292 1165 consensus_queue.cc:260] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.367586 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e25c6ff05c264ce4905a0e07af688764" } new_table_name: "default.Table_97a52de1a72f4dbe900ec0f55d54498e" modify_external_catalogs: true
W20260503 07:53:14.372888 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78367d83a2bb405a81ba37357752bc03 consensus state has no leader
I20260503 07:53:14.375545 1171 tablet_bootstrap.cc:492] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.375695 1171 ts_tablet_manager.cc:1403] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.000s
I20260503 07:53:14.376613 1171 raft_consensus.cc:359] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.376766 1171 raft_consensus.cc:385] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.376817 1171 raft_consensus.cc:740] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.377019 1171 consensus_queue.cc:260] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.377486 1171 ts_tablet_manager.cc:1434] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:14.377763 1171 tablet_bootstrap.cc:492] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.379407 1171 tablet_bootstrap.cc:654] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.380206 2741 raft_consensus.cc:493] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.380378 2741 raft_consensus.cc:515] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.381012 2741 leader_election.cc:290] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.384606 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 26da686862f44940b13c7790e00ea3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.401541 2708 raft_consensus.cc:515] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.401850 1171 tablet_bootstrap.cc:492] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.402076 1171 ts_tablet_manager.cc:1403] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.004s
I20260503 07:53:14.402387 2708 leader_election.cc:290] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.403230 1171 raft_consensus.cc:359] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.403698 1171 raft_consensus.cc:385] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.403815 1171 raft_consensus.cc:740] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.404114 1171 consensus_queue.cc:260] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.406028 1171 ts_tablet_manager.cc:1434] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:53:14.407181 1171 tablet_bootstrap.cc:492] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.409067 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.409150 757 tablet_service.cc:1511] Processing CreateTablet for tablet a4420cdc6cd84207b2bdd6c0a609c97d (DEFAULT_TABLE table=default.Table_b58c977f7f8c484d81e4ce565eea0688 [id=b3390aa704704a4fa51a31b3c20cecb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.409544 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4420cdc6cd84207b2bdd6c0a609c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.409660 756 tablet_service.cc:1511] Processing CreateTablet for tablet 66d715f739ae4cfe857f91a29917c438 (DEFAULT_TABLE table=default.Table_259468e6a8024773bb49c811211d3bfe [id=281e06a9808a4af589140e54c96b0f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.410113 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d715f739ae4cfe857f91a29917c438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.412945 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_09c8eef9feea45f19f8b5829ef46557a" } new_table_name: "default.Table_68197980209d43a18ac2c2e326e37ead" modify_external_catalogs: true
I20260503 07:53:14.415196 761 tablet_service.cc:1511] Processing CreateTablet for tablet 532037d672cf49afac0be969e6978589 (DEFAULT_TABLE table=default.Table_09c8eef9feea45f19f8b5829ef46557a [id=e5090a30fd5f4f7c9cab1d33f0bcb6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.415226 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fc2f1060428149818159c2074b32f1f0" } modify_external_catalogs: true
I20260503 07:53:14.415375 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fc2f1060428149818159c2074b32f1f0" } modify_external_catalogs: true
I20260503 07:53:14.415576 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532037d672cf49afac0be969e6978589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.415690 1171 tablet_bootstrap.cc:654] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.416600 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb80e7b5f0714315aee7abdfca47508b" } modify_external_catalogs: true
I20260503 07:53:14.416745 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb80e7b5f0714315aee7abdfca47508b" } modify_external_catalogs: true
I20260503 07:53:14.424858 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea1e16f84064001824c3e25ca7ece28 (DEFAULT_TABLE table=default.Table_de122583f1d04569a8cd54a86be61adb [id=62a9fbe1d345474996aea52f3ba9389b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.425364 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea1e16f84064001824c3e25ca7ece28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.425588 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 532037d672cf49afac0be969e6978589 consensus state has no leader
I20260503 07:53:14.427596 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet af0c0f5999ee4b9cae56cbb3695de12f
I20260503 07:53:14.427664 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a3724490a7ed4afc82e4f7ebc1190f76
I20260503 07:53:14.428706 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_78050367c48f47a5831411a068239629" } new_table_name: "default.Table_d4b23a609715417c888ad7e49fc25830" modify_external_catalogs: true
I20260503 07:53:14.432696 1171 tablet_bootstrap.cc:492] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.433252 1171 ts_tablet_manager.cc:1403] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
W20260503 07:53:14.434748 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 662a418a0fbd4979b08f3a977a14da1d consensus state has no leader
I20260503 07:53:14.434676 1171 raft_consensus.cc:359] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.434875 1171 raft_consensus.cc:385] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.435292 1171 raft_consensus.cc:740] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.435557 1171 consensus_queue.cc:260] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.435606 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bb606273a187473da6be09b9183a8ec1" } new_table_name: "default.Table_2d7cce75444546619757092837fe1410" modify_external_catalogs: true
I20260503 07:53:14.436197 1171 ts_tablet_manager.cc:1434] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:14.436523 1171 tablet_bootstrap.cc:492] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.438831 1171 tablet_bootstrap.cc:654] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.444185 1174 ts_tablet_manager.cc:1929] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:14.444309 1174 log.cc:1199] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bdd151f5e0d54bdab58423c24186b38d
I20260503 07:53:14.444643 1174 ts_tablet_manager.cc:1950] T bdd151f5e0d54bdab58423c24186b38d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:14.444698 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ede91937218487ea2a0ad7a9e58bbee consensus state has no leader
I20260503 07:53:14.445359 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 916) took 6496 ms. Trace:
I20260503 07:53:14.445470 1174 rpcz_store.cc:276] 0503 07:53:07.949304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:07.949676 (+ 372us) service_pool.cc:224] Handling call
0503 07:53:14.121038 (+6171362us) ts_tablet_manager.cc:1151] Deleting tablet bdd151f5e0d54bdab58423c24186b38d
0503 07:53:14.121046 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.239820 (+118774us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.444111 (+204291us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.445338 (+ 1227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6171149}
I20260503 07:53:14.445874 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 923) took 6153 ms. Trace:
I20260503 07:53:14.445966 1174 rpcz_store.cc:276] 0503 07:53:08.292011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.293444 (+ 1433us) service_pool.cc:224] Handling call
0503 07:53:14.445752 (+6152308us) ts_tablet_manager.cc:1151] Deleting tablet e66033d0ee71439cba1545815aa5213f
0503 07:53:14.445762 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.445859 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6152115}
I20260503 07:53:14.446295 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 927) took 6077 ms. Trace:
I20260503 07:53:14.446372 1174 rpcz_store.cc:276] 0503 07:53:08.368935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.369858 (+ 923us) service_pool.cc:224] Handling call
0503 07:53:14.446197 (+6076339us) ts_tablet_manager.cc:1151] Deleting tablet 78b3210d1ecd42198e080b02a8b594a5
0503 07:53:14.446207 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.446280 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6076090}
I20260503 07:53:14.446624 1174 tablet_replica.cc:333] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:14.446849 1174 raft_consensus.cc:2243] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:14.447044 1174 raft_consensus.cc:2272] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:14.447611 1174 ts_tablet_manager.cc:1916] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:14.452358 1171 tablet_bootstrap.cc:492] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.357754 746 tablet_service.cc:1558] Processing DeleteTablet for tablet f8d3ed6f8cec419b9f581435941e6120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.453290 2740 raft_consensus.cc:493] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.453430 1171 ts_tablet_manager.cc:1403] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.003s
I20260503 07:53:14.453477 2740 raft_consensus.cc:515] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.454401 1171 raft_consensus.cc:359] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.455077 1171 raft_consensus.cc:385] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.455281 1171 raft_consensus.cc:740] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.455638 1171 consensus_queue.cc:260] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.457666 1171 ts_tablet_manager.cc:1434] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260503 07:53:14.459482 1171 tablet_bootstrap.cc:492] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.462350 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 17db30b1109845d783ade7c4860a3d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.462797 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0be9e41a37834a51bee50b917edc1eab (DEFAULT_TABLE table=default.Table_4fe07c3e026f429799ffee480cad8928 [id=654e62d066234ef79e753628c5aaccdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.463086 760 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e40b7ef514f448bcf83837656149d (DEFAULT_TABLE table=default.Table_812b51710d0c47159b3d5e3a9fd3eaea [id=637b9ae06f274fb2b437106ef85bbf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.463182 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be9e41a37834a51bee50b917edc1eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.463363 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff73f8a6895419eb45a0a3ceee477ea (DEFAULT_TABLE table=default.Table_e71826e4a2b64189a1bb50edfa1c12ff [id=5c1a154ba31f4c56b592ad82058a764c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.463385 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e40b7ef514f448bcf83837656149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.463852 759 tablet_service.cc:1511] Processing CreateTablet for tablet c1717089130c4302b8e5456e1d23e257 (DEFAULT_TABLE table=default.Table_db2dde7023504a5884e4c6b3901587ea [id=696141a3180e435c8f263c760479f09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.464000 1171 tablet_bootstrap.cc:654] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.464188 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1717089130c4302b8e5456e1d23e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.465734 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff73f8a6895419eb45a0a3ceee477ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.472343 1171 tablet_bootstrap.cc:492] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.473258 1171 ts_tablet_manager.cc:1403] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260503 07:53:14.473807 758 tablet_service.cc:1511] Processing CreateTablet for tablet c7f3ae4fae1445d6a824afe9ff194a6f (DEFAULT_TABLE table=default.Table_87ef1230f42d4b7799cc13d03622ec6a [id=88357b84ef264101bedafaffb91bed4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.474166 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f3ae4fae1445d6a824afe9ff194a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.474162 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d3a13b279f8478599baeb7f7f4648df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.474802 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d3a13b279f8478599baeb7f7f4648df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.475092 1171 raft_consensus.cc:359] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.475230 1171 raft_consensus.cc:385] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.475283 1171 raft_consensus.cc:740] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.475468 1171 consensus_queue.cc:260] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.476800 1171 ts_tablet_manager.cc:1434] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260503 07:53:14.479066 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c686fe8f22a4e96854cc93365235b14" } modify_external_catalogs: true
I20260503 07:53:14.479225 1171 tablet_bootstrap.cc:492] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.479265 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c686fe8f22a4e96854cc93365235b14" } modify_external_catalogs: true
I20260503 07:53:14.481846 746 tablet_service.cc:1511] Processing CreateTablet for tablet c0f80a713d1648109f12e11099ebbb5c (DEFAULT_TABLE table=default.Table_a15db5ec7f114d89bb16c146360e3b3f [id=8f81bf500536452593bff0a689868441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.482257 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f80a713d1648109f12e11099ebbb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.482928 1171 tablet_bootstrap.cc:654] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.484283 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df4fefd52434b118e1ed016d5d629bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.484711 755 tablet_service.cc:1511] Processing CreateTablet for tablet 62ecf23448b141ab9962173294d0a6c3 (DEFAULT_TABLE table=default.Table_b34288d750064c589c90e0a4349492e6 [id=3c68035f4db2431aa58fd1ae361b5a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.484916 2802 raft_consensus.cc:493] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.485118 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ecf23448b141ab9962173294d0a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.485114 2802 raft_consensus.cc:515] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.486446 2802 leader_election.cc:290] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.488792 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet dab8cc17114146628682a0a8432596d2
I20260503 07:53:14.493939 2690 raft_consensus.cc:515] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.494292 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0968db2680314f3bbce927d083943ec1" } modify_external_catalogs: true
I20260503 07:53:14.494462 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0968db2680314f3bbce927d083943ec1" } modify_external_catalogs: true
I20260503 07:53:14.494616 2690 leader_election.cc:290] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.495012 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b74a333f50764fad86944c5a2acf2d27" } modify_external_catalogs: true
I20260503 07:53:14.495179 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b74a333f50764fad86944c5a2acf2d27" } modify_external_catalogs: true
I20260503 07:53:14.455302 2740 leader_election.cc:290] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.503288 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4298b47c6c014712adbd5a05a9920de6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.503784 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4298b47c6c014712adbd5a05a9920de6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.506628 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e753e8572bf746c580f2331da7b73034"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.507066 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e753e8572bf746c580f2331da7b73034 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.511601 742 tablet_service.cc:1511] Processing CreateTablet for tablet f18bf0f400b142bf8d11b0ceb13a3097 (DEFAULT_TABLE table=default.Table_a3110562e44a4af585a25ffb2275d993 [id=4c78b32117f34259bcbceaffa37d617b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.512069 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18bf0f400b142bf8d11b0ceb13a3097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.512428 758 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4877210ebe478db776bffc52050164 (DEFAULT_TABLE table=default.Table_e4637a8b90ee4ac88da954efe295d605 [id=67c9b9e0ba0f43dbb982382fdce9670a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.512841 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4877210ebe478db776bffc52050164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.516111 744 tablet_service.cc:1511] Processing CreateTablet for tablet 3f95e49dfec744da94a6db8c46475302 (DEFAULT_TABLE table=default.Table_d4b95589e7ea46c792a7f069992951a8 [id=2c351024ec3a4339bcf5a45e2bf2eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.516542 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f95e49dfec744da94a6db8c46475302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.521605 745 tablet_service.cc:1511] Processing CreateTablet for tablet 4935dc4ab7b2476f8bc220c16cfdf353 (DEFAULT_TABLE table=default.Table_128e633d864f4d9bac761565fd8d18ef [id=f29177da29f341f88d4bdfa10865e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.522032 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935dc4ab7b2476f8bc220c16cfdf353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.523845 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6bdac8d0c6484da94b93775edbe4d9 (DEFAULT_TABLE table=default.Table_83bd2416af9c471d84f650f125aa4f20 [id=20fdd5f8780748a0bfaa862feaab2030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.524245 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6bdac8d0c6484da94b93775edbe4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.525337 741 tablet_service.cc:1511] Processing CreateTablet for tablet 98eee8cb05dc4e0fae5385f83fb99c13 (DEFAULT_TABLE table=default.Table_62d5856bc94e4d9a89760cf91368cb1b [id=aa2d9dead47c4d7c81567d22327be700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.525729 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eee8cb05dc4e0fae5385f83fb99c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.528435 753 tablet_service.cc:1511] Processing CreateTablet for tablet 16bb8f0632c944c8a5cb5d7393d1cd04 (DEFAULT_TABLE table=default.Table_7b1ed7918954467387a0d2e03aa226d7 [id=a40c2d4cbfe343cb90e2ec85e6ccfa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.528823 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bb8f0632c944c8a5cb5d7393d1cd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.552289 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b4ac4f2792ca45aa8fbeb9453bd07d88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.552839 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4ac4f2792ca45aa8fbeb9453bd07d88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.554302 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9a741073f462488bb9bd48619d464c15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.554729 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a741073f462488bb9bd48619d464c15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.555732 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f3377c51ac0546ada5f045f337b91110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.556119 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3377c51ac0546ada5f045f337b91110 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.556790 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2509bf88cbff482784e5dae08dde4f3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.557178 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2509bf88cbff482784e5dae08dde4f3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.558493 756 tablet_service.cc:1511] Processing CreateTablet for tablet f00c438eeec14086b33909f29b5cc329 (DEFAULT_TABLE table=default.Table_ef6b39ff3b694d45b0661a39a3daf4d4 [id=1e2f898fbeff444aa372f6ec8dc118a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.558826 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3688b03b7ca446e8b2d00614a7863d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.559248 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3688b03b7ca446e8b2d00614a7863d90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.559139 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00c438eeec14086b33909f29b5cc329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.560226 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d890f77dcdf464bba74b7797fb86d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.560608 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d890f77dcdf464bba74b7797fb86d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.561601 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_259899fd21c4432baa40574f11e4e9f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.561988 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_259899fd21c4432baa40574f11e4e9f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.567646 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_617f07674fa14a57a807dd2404ccb547" } new_table_name: "default.Table_22de3676c1bf456c817cfe3dde2d94f9" modify_external_catalogs: true
I20260503 07:53:14.572397 1171 tablet_bootstrap.cc:492] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.572543 1171 ts_tablet_manager.cc:1403] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.094s user 0.019s sys 0.010s
I20260503 07:53:14.573173 761 tablet_service.cc:1511] Processing CreateTablet for tablet 41c0a9d223b040bdb8cd55629914357b (DEFAULT_TABLE table=default.Table_ee2d7a044dfb46aea48bf51119a4a3e3 [id=24de47e4e38845c6adbd7ac7ad444ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.576032 2740 raft_consensus.cc:493] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.576187 2740 raft_consensus.cc:515] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.576740 2740 leader_election.cc:290] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.577872 1171 raft_consensus.cc:359] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.578107 1171 raft_consensus.cc:385] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.578205 1171 raft_consensus.cc:740] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.578464 1171 consensus_queue.cc:260] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.578728 752 tablet_service.cc:1511] Processing CreateTablet for tablet e924c5f6c05d4566b6ad073bb5b5a8a1 (DEFAULT_TABLE table=default.Table_13b0c985ac174d199a61e7b3c26061c5 [id=14ebd5d2b7a94bd3888420cda1ab59dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.579165 1171 ts_tablet_manager.cc:1434] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260503 07:53:14.581036 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_08f0028f534e4a9aa24c1791f1a15a1d" } new_table_name: "default.Table_f753dec874b841f18bf08be5433c6402" modify_external_catalogs: true
I20260503 07:53:14.581826 1171 tablet_bootstrap.cc:492] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.586447 1171 tablet_bootstrap.cc:654] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:14.588505 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 07:53:14.597040 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 277773us
I20260503 07:53:14.600593 2816 raft_consensus.cc:493] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.600742 2816 raft_consensus.cc:515] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.601334 2816 leader_election.cc:290] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:14.602310 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b74af21d58e4fe7aaad590adff10c4e consensus state has no leader
W20260503 07:53:14.607254 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c0ceddd751644d20bcbda15a462d5342 consensus state has no leader
I20260503 07:53:14.608502 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea1e16f84064001824c3e25ca7ece28 (DEFAULT_TABLE table=default.Table_de122583f1d04569a8cd54a86be61adb [id=62a9fbe1d345474996aea52f3ba9389b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.608862 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea1e16f84064001824c3e25ca7ece28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.608922 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 157bb83e56234f17b906756c0d70868c
I20260503 07:53:14.613252 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.614604 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.614861 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e4ba72b51a4343be56d56f93693939" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.615163 1018 tablet_service.cc:1511] Processing CreateTablet for tablet a4420cdc6cd84207b2bdd6c0a609c97d (DEFAULT_TABLE table=default.Table_b58c977f7f8c484d81e4ce565eea0688 [id=b3390aa704704a4fa51a31b3c20cecb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.615512 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4420cdc6cd84207b2bdd6c0a609c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.616269 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ae3862d990f14c3f8a084d234d941bfa
I20260503 07:53:14.621925 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 66d715f739ae4cfe857f91a29917c438 (DEFAULT_TABLE table=default.Table_259468e6a8024773bb49c811211d3bfe [id=281e06a9808a4af589140e54c96b0f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.622270 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d715f739ae4cfe857f91a29917c438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.622706 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bdd151f5e0d54bdab58423c24186b38d (table default.Table_c1a2ce2e59084b5286d27b3efbd097d1 [id=058fdda874e841b99867dd1ad2fb40d7]) successfully deleted
W20260503 07:53:14.622946 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e66033d0ee71439cba1545815aa5213f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66033d0ee71439cba1545815aa5213f already in progress: creating tablet
W20260503 07:53:14.623136 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 78b3210d1ecd42198e080b02a8b594a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3210d1ecd42198e080b02a8b594a5 already in progress: creating tablet
I20260503 07:53:14.600874 757 tablet_service.cc:1511] Processing CreateTablet for tablet f1c95ddbfb634c1997a0e0acdd45ffc3 (DEFAULT_TABLE table=default.Table_2e37a8c4a2614022a6d259ed634fb982 [id=c4006849d6d14ccb8f23fb02548147f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.601823 760 tablet_service.cc:1511] Processing CreateTablet for tablet 51bc007378534ee6ac8c64bfc41ebcd3 (DEFAULT_TABLE table=default.Table_bba9ffa84f1f430391d8720c5069f67d [id=043db8f8057a4ef79a82683ba0d699be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.603004 743 tablet_service.cc:1511] Processing CreateTablet for tablet b4b91ecd211b450583f9e0d22da62641 (DEFAULT_TABLE table=default.Table_19a81c8e549449b5bfc271441e17a3ba [id=7c84f7a8993b41b3aa4645b937885def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.624358 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:14.624610 1052 raft_consensus.cc:3060] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.624886 1171 tablet_bootstrap.cc:492] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:14.625082 1171 ts_tablet_manager.cc:1403] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.005s
W20260503 07:53:14.604152 2565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.000s sys 0.017s
W20260503 07:53:14.625552 2565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s user 0.000s sys 0.018s
I20260503 07:53:14.626080 1171 raft_consensus.cc:359] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.626389 1171 raft_consensus.cc:385] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.626485 1171 raft_consensus.cc:740] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.626881 1171 consensus_queue.cc:260] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.627311 1052 raft_consensus.cc:2468] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:14.607014 747 tablet_service.cc:1511] Processing CreateTablet for tablet 7833f2abd0ff48e88fe7c5fbdaac037e (DEFAULT_TABLE table=default.Table_456974f93b2c49cd8e91e745926dc00d [id=9ab90119696c440aafc26eacd50cce6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.607750 748 tablet_service.cc:1511] Processing CreateTablet for tablet d5053947b21449b08a0fc487a49fb48f (DEFAULT_TABLE table=default.Table_23080564cfaa4f5ca50f2fee8c6d5f87 [id=aec650477ed548c485ee0b7d677d0af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.611037 759 tablet_service.cc:1511] Processing CreateTablet for tablet af2210af3e8b41c283da360610c5e805 (DEFAULT_TABLE table=default.Table_0eeec067673744d58cdb5243c65ca773 [id=35a1ee8829a847c19c1c0bce035a034b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.628113 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 17db30b1109845d783ade7c4860a3d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.611563 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9132dec40e4392aeb19613daaa80ca (DEFAULT_TABLE table=default.Table_d68d813a0dbc41d092cf879d68d6ef5d [id=b056a5f426874c639a97650838cdf1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.628369 1171 ts_tablet_manager.cc:1434] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:14.612768 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c78b3870e4c1e83e9a0625dd3624d (DEFAULT_TABLE table=default.Table_3d7b1b9c33424c509c2224c3d4266ecb [id=143452044f3d4c6694fbb8a20357aa55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.613631 2832 raft_consensus.cc:493] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.629402 1171 tablet_bootstrap.cc:492] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:14.629403 2832 raft_consensus.cc:515] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.629907 2780 raft_consensus.cc:493] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.630029 2832 leader_election.cc:290] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:14.630067 2780 raft_consensus.cc:515] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.630650 2780 leader_election.cc:290] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:14.631062 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c37ca51ef812421a90de1ebd88d898a0" } modify_external_catalogs: true
I20260503 07:53:14.631285 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c37ca51ef812421a90de1ebd88d898a0" } modify_external_catalogs: true
I20260503 07:53:14.620633 753 tablet_service.cc:1511] Processing CreateTablet for tablet 79a662b661114ea4bd986f985a13092d (DEFAULT_TABLE table=default.Table_c37ca51ef812421a90de1ebd88d898a0 [id=4e969940094c480f91b2d58f653cfee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.621176 2819 tablet.cc:1724] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:14.622032 746 tablet_service.cc:1511] Processing CreateTablet for tablet 93c29ea700d94fa695364645895787cd (DEFAULT_TABLE table=default.Table_5098542c58ab427c830fe36eaf5110d7 [id=9f0f7e74af434bd9b2aed228e388391d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:14.632089 854 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5c30f15ad13340c89df3f5c8d65d63c7
I20260503 07:53:14.632269 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 62ecf23448b141ab9962173294d0a6c3 (DEFAULT_TABLE table=default.Table_b34288d750064c589c90e0a4349492e6 [id=3c68035f4db2431aa58fd1ae361b5a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.632614 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ecf23448b141ab9962173294d0a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.632648 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1a972fa442ce4877b5d2b2685e03d49e" } new_table_name: "default.Table_e683012f1fc047c3a80ec030733ee2b8" modify_external_catalogs: true
I20260503 07:53:14.633659 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6326cbddf0e04cec8b961d8ce34de108" } modify_external_catalogs: true
I20260503 07:53:14.633783 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6326cbddf0e04cec8b961d8ce34de108" } modify_external_catalogs: true
I20260503 07:53:14.637173 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_36da2c59317c4f3bb4c2b3b203f298b7" } new_table_name: "default.Table_80d6f763e78040c5a6af0174fde9fd6d" modify_external_catalogs: true
I20260503 07:53:14.641427 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 79a662b661114ea4bd986f985a13092d
I20260503 07:53:14.623723 1165 ts_tablet_manager.cc:1434] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.319s user 0.009s sys 0.002s
I20260503 07:53:14.643278 1165 tablet_bootstrap.cc:492] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:14.643687 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df4fefd52434b118e1ed016d5d629bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.644416 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e4ba72b51a4343be56d56f93693939" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:14.644600 1052 raft_consensus.cc:3060] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:14.644899 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f7fad6661384f2b9a125c1bc7b8345a consensus state has no leader
I20260503 07:53:14.645257 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7b90ec3eb3894c18825ebe5fb79fa5be
I20260503 07:53:14.646147 2780 raft_consensus.cc:493] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.646293 2780 raft_consensus.cc:515] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.646806 2780 leader_election.cc:290] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:14.647223 1052 raft_consensus.cc:2468] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
W20260503 07:53:14.647745 854 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: a117f416c611418a96963db600da1d04
I20260503 07:53:14.648485 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b3e78c443801484cacc0819e8ac0c7f0" } new_table_name: "default.Table_7820f6c21edd44faa101fe8e8594aa93" modify_external_catalogs: true
I20260503 07:53:14.283501 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:14.652361 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0be9e41a37834a51bee50b917edc1eab (DEFAULT_TABLE table=default.Table_4fe07c3e026f429799ffee480cad8928 [id=654e62d066234ef79e753628c5aaccdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.652740 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be9e41a37834a51bee50b917edc1eab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.652954 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cead0c0237b4360bc84c661deaf7dd9 consensus state has no leader
W20260503 07:53:14.658438 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2a8057297cc4a16813a545fc2b947d4 consensus state has no leader
I20260503 07:53:14.659148 1171 tablet_bootstrap.cc:654] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.659898 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:14.660099 715 leader_election.cc:343] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:14.681602 715 leader_election.cc:343] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.686352 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:14.686519 1048 raft_consensus.cc:2468] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:14.688721 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c0f80a713d1648109f12e11099ebbb5c (DEFAULT_TABLE table=default.Table_a15db5ec7f114d89bb16c146360e3b3f [id=8f81bf500536452593bff0a689868441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.689090 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f80a713d1648109f12e11099ebbb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.692621 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_21c7a07f359c40da89a6c8624d48ef7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.693198 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21c7a07f359c40da89a6c8624d48ef7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.694844 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3571003422e4455f9f765cf5a1b64104" } modify_external_catalogs: true
I20260503 07:53:14.695063 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3571003422e4455f9f765cf5a1b64104" } modify_external_catalogs: true
I20260503 07:53:14.695679 1033 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e40b7ef514f448bcf83837656149d (DEFAULT_TABLE table=default.Table_812b51710d0c47159b3d5e3a9fd3eaea [id=637b9ae06f274fb2b437106ef85bbf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.696053 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e40b7ef514f448bcf83837656149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.704960 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet aaef17b7249e4f208b672fde4a284590
W20260503 07:53:14.710258 715 consensus_peers.cc:597] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:14.711184 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0d3f50d1b6c24d838b7bb7e6fc88e968"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.711699 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d3f50d1b6c24d838b7bb7e6fc88e968 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.712687 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff73f8a6895419eb45a0a3ceee477ea (DEFAULT_TABLE table=default.Table_e71826e4a2b64189a1bb50edfa1c12ff [id=5c1a154ba31f4c56b592ad82058a764c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.713132 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff73f8a6895419eb45a0a3ceee477ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.716468 1015 tablet_service.cc:1511] Processing CreateTablet for tablet c7f3ae4fae1445d6a824afe9ff194a6f (DEFAULT_TABLE table=default.Table_87ef1230f42d4b7799cc13d03622ec6a [id=88357b84ef264101bedafaffb91bed4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.716852 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f3ae4fae1445d6a824afe9ff194a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.720322 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.720453 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 4935dc4ab7b2476f8bc220c16cfdf353 (DEFAULT_TABLE table=default.Table_128e633d864f4d9bac761565fd8d18ef [id=f29177da29f341f88d4bdfa10865e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.720810 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935dc4ab7b2476f8bc220c16cfdf353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.722458 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_532e0bf3bb9e41edac74e09b1744e9a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.698997 716 leader_election.cc:304] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:14.722951 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_532e0bf3bb9e41edac74e09b1744e9a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.723034 716 leader_election.cc:304] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:14.723508 716 leader_election.cc:304] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.685009 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c0a9d223b040bdb8cd55629914357b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.724153 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c78b3870e4c1e83e9a0625dd3624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.724458 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 16bb8f0632c944c8a5cb5d7393d1cd04 (DEFAULT_TABLE table=default.Table_7b1ed7918954467387a0d2e03aa226d7 [id=a40c2d4cbfe343cb90e2ec85e6ccfa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.724817 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bb8f0632c944c8a5cb5d7393d1cd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.711665 750 tablet_service.cc:1511] Processing CreateTablet for tablet fe34cedd1e694e09bc3bdf1b3a176a9d (DEFAULT_TABLE table=default.Table_cd4cd700b0664401a92371c9ea522087 [id=4ac0e6050fb84703b453f29888fc6c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.728303 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5053947b21449b08a0fc487a49fb48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.728462 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c95ddbfb634c1997a0e0acdd45ffc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.728446 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 98eee8cb05dc4e0fae5385f83fb99c13 (DEFAULT_TABLE table=default.Table_62d5856bc94e4d9a89760cf91368cb1b [id=aa2d9dead47c4d7c81567d22327be700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.728811 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eee8cb05dc4e0fae5385f83fb99c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.732273 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7833f2abd0ff48e88fe7c5fbdaac037e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.732421 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b91ecd211b450583f9e0d22da62641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.733917 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2210af3e8b41c283da360610c5e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.736307 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51bc007378534ee6ac8c64bfc41ebcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.736866 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9132dec40e4392aeb19613daaa80ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.737581 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e924c5f6c05d4566b6ad073bb5b5a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.740304 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a662b661114ea4bd986f985a13092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.743726 751 tablet_service.cc:1511] Processing CreateTablet for tablet b689cae48af74395a270719e32ff520e (DEFAULT_TABLE table=default.Table_ca0e7ac763ef44d49ee51109f02130ff [id=b709de6d5490447c9260a22f4dd0055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.744259 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c29ea700d94fa695364645895787cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.745465 1165 tablet_bootstrap.cc:654] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:14.710841 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:14.750023 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b689cae48af74395a270719e32ff520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.754742 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57261ae6531348d7bdd8deb5dfd980b4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:14.754796 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:14.754915 778 raft_consensus.cc:3060] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.755180 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:14.755311 762 raft_consensus.cc:3060] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.755645 747 tablet_service.cc:1511] Processing CreateTablet for tablet f35ba647f99249dabdb9810805b58877 (DEFAULT_TABLE table=default.Table_eea1b385145a4989855907d5eed02328 [id=d313b10f66254890b5a0c93c8c9136ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.756031 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35ba647f99249dabdb9810805b58877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.756577 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df94a7071f472c8962206d51c44429" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.757107 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08da2052f5482792c8b3294e9b7332" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.757359 778 raft_consensus.cc:2468] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:14.757508 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.754930 772 raft_consensus.cc:3060] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.758174 762 raft_consensus.cc:2468] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:14.758221 2826 raft_consensus.cc:2804] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:14.758313 2826 raft_consensus.cc:697] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:14.758623 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.758548 2826 consensus_queue.cc:237] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.759047 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.759441 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.759649 751 tablet_service.cc:1511] Processing CreateTablet for tablet 066e62a9892a450f8a211659fab4bc2b (DEFAULT_TABLE table=default.Table_3879045db74d4863b8f62d2aff4c31ba [id=fa42f9d5a3cc4339b70d5e7d200b807d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.759995 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066e62a9892a450f8a211659fab4bc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.759943 772 raft_consensus.cc:2468] T b4df94a7071f472c8962206d51c44429 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:14.761019 2608 raft_consensus.cc:2804] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:14.761090 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.761344 2608 raft_consensus.cc:697] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:14.761458 762 raft_consensus.cc:2468] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:14.761561 2608 consensus_queue.cc:237] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.762275 2816 raft_consensus.cc:493] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.762387 2708 consensus_queue.cc:1048] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:14.762444 2816 raft_consensus.cc:515] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.762719 2708 raft_consensus.cc:2804] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:14.762782 2708 raft_consensus.cc:493] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:14.762837 2708 raft_consensus.cc:3060] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.763023 2816 leader_election.cc:290] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:14.768829 751 tablet_service.cc:1511] Processing CreateTablet for tablet ae9d435a9c5b4fa786faa765a1cf541c (DEFAULT_TABLE table=default.Table_d35fc80f52954a3b9f7308f0889787cc [id=6bf4cffad9ab4583a9fa29bc219854b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.769174 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9d435a9c5b4fa786faa765a1cf541c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.769979 2708 raft_consensus.cc:515] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.775842 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e924c5f6c05d4566b6ad073bb5b5a8a1 (DEFAULT_TABLE table=default.Table_13b0c985ac174d199a61e7b3c26061c5 [id=14ebd5d2b7a94bd3888420cda1ab59dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.776237 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e924c5f6c05d4566b6ad073bb5b5a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.777393 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8e7e8c5538084100b030def99b1fb17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.777897 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_2734bd26b8ba4525b31bf46ae3cedeea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.778142 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e7e8c5538084100b030def99b1fb17d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:14.778348 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2734bd26b8ba4525b31bf46ae3cedeea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.779498 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_71a82cc361e244948d83eb8068a52749"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.779922 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71a82cc361e244948d83eb8068a52749 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.781668 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bb7ea1bef84d48a5bbf2d50ec048882d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.782033 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb7ea1bef84d48a5bbf2d50ec048882d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.787645 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f18bf0f400b142bf8d11b0ceb13a3097 (DEFAULT_TABLE table=default.Table_a3110562e44a4af585a25ffb2275d993 [id=4c78b32117f34259bcbceaffa37d617b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.788020 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18bf0f400b142bf8d11b0ceb13a3097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.788101 1023 tablet_service.cc:1511] Processing CreateTablet for tablet b4b91ecd211b450583f9e0d22da62641 (DEFAULT_TABLE table=default.Table_19a81c8e549449b5bfc271441e17a3ba [id=7c84f7a8993b41b3aa4645b937885def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.788101 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 3f95e49dfec744da94a6db8c46475302 (DEFAULT_TABLE table=default.Table_d4b95589e7ea46c792a7f069992951a8 [id=2c351024ec3a4339bcf5a45e2bf2eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.788455 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b91ecd211b450583f9e0d22da62641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.788653 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f95e49dfec744da94a6db8c46475302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.792897 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6bdac8d0c6484da94b93775edbe4d9 (DEFAULT_TABLE table=default.Table_83bd2416af9c471d84f650f125aa4f20 [id=20fdd5f8780748a0bfaa862feaab2030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.793210 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6bdac8d0c6484da94b93775edbe4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.797354 1026 tablet_service.cc:1511] Processing CreateTablet for tablet f1c95ddbfb634c1997a0e0acdd45ffc3 (DEFAULT_TABLE table=default.Table_2e37a8c4a2614022a6d259ed634fb982 [id=c4006849d6d14ccb8f23fb02548147f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.797744 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c95ddbfb634c1997a0e0acdd45ffc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.800546 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 41c0a9d223b040bdb8cd55629914357b (DEFAULT_TABLE table=default.Table_ee2d7a044dfb46aea48bf51119a4a3e3 [id=24de47e4e38845c6adbd7ac7ad444ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.800864 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c0a9d223b040bdb8cd55629914357b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.805454 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4877210ebe478db776bffc52050164 (DEFAULT_TABLE table=default.Table_e4637a8b90ee4ac88da954efe295d605 [id=67c9b9e0ba0f43dbb982382fdce9670a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.805787 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4877210ebe478db776bffc52050164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.808295 1015 tablet_service.cc:1511] Processing CreateTablet for tablet f00c438eeec14086b33909f29b5cc329 (DEFAULT_TABLE table=default.Table_ef6b39ff3b694d45b0661a39a3daf4d4 [id=1e2f898fbeff444aa372f6ec8dc118a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.808723 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00c438eeec14086b33909f29b5cc329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.770548 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 46847.4us
I20260503 07:53:14.811981 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:14.812306 1052 raft_consensus.cc:3060] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:14.819080 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c1717089130c4302b8e5456e1d23e257 (DEFAULT_TABLE table=default.Table_db2dde7023504a5884e4c6b3901587ea [id=696141a3180e435c8f263c760479f09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.819459 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1717089130c4302b8e5456e1d23e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.820930 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7833f2abd0ff48e88fe7c5fbdaac037e (DEFAULT_TABLE table=default.Table_456974f93b2c49cd8e91e745926dc00d [id=9ab90119696c440aafc26eacd50cce6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.821245 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7833f2abd0ff48e88fe7c5fbdaac037e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.827127 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d5053947b21449b08a0fc487a49fb48f (DEFAULT_TABLE table=default.Table_23080564cfaa4f5ca50f2fee8c6d5f87 [id=aec650477ed548c485ee0b7d677d0af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.827495 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5053947b21449b08a0fc487a49fb48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.834775 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9132dec40e4392aeb19613daaa80ca (DEFAULT_TABLE table=default.Table_d68d813a0dbc41d092cf879d68d6ef5d [id=b056a5f426874c639a97650838cdf1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.835219 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9132dec40e4392aeb19613daaa80ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.835345 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 066e62a9892a450f8a211659fab4bc2b (DEFAULT_TABLE table=default.Table_3879045db74d4863b8f62d2aff4c31ba [id=fa42f9d5a3cc4339b70d5e7d200b807d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.835500 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e4068720834a4ff088139dd907ff9cb9 (DEFAULT_TABLE table=default.Table_4f525a07b4e84b15abed3e131a3fedc6 [id=65dccf79b3b347d682d2b53290daa45e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.835620 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066e62a9892a450f8a211659fab4bc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.835759 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4068720834a4ff088139dd907ff9cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.835995 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ae9d435a9c5b4fa786faa765a1cf541c (DEFAULT_TABLE table=default.Table_d35fc80f52954a3b9f7308f0889787cc [id=6bf4cffad9ab4583a9fa29bc219854b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.836264 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9d435a9c5b4fa786faa765a1cf541c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.836310 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 79a662b661114ea4bd986f985a13092d (DEFAULT_TABLE table=default.Table_c37ca51ef812421a90de1ebd88d898a0 [id=4e969940094c480f91b2d58f653cfee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.836669 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a662b661114ea4bd986f985a13092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.838894 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 93c29ea700d94fa695364645895787cd (DEFAULT_TABLE table=default.Table_5098542c58ab427c830fe36eaf5110d7 [id=9f0f7e74af434bd9b2aed228e388391d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.839258 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c29ea700d94fa695364645895787cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.840839 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b83e492f9445478f890dd9d90321b41a (DEFAULT_TABLE table=default.Table_807644122a02408798de0c8b502b0b07 [id=6f315ff55cc24727a434a90be2ea2b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.841102 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83e492f9445478f890dd9d90321b41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.841825 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b689cae48af74395a270719e32ff520e (DEFAULT_TABLE table=default.Table_ca0e7ac763ef44d49ee51109f02130ff [id=b709de6d5490447c9260a22f4dd0055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.842180 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b689cae48af74395a270719e32ff520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.843950 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c78b3870e4c1e83e9a0625dd3624d (DEFAULT_TABLE table=default.Table_3d7b1b9c33424c509c2224c3d4266ecb [id=143452044f3d4c6694fbb8a20357aa55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.844285 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c78b3870e4c1e83e9a0625dd3624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.844532 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 25c586dc2fb74270a9669de65e2328b0 (DEFAULT_TABLE table=default.Table_e5559d16a8e243dab7cd61db43c0d0c2 [id=6eb28d00cccf4df3961f8c7be4df3c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.844812 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c586dc2fb74270a9669de65e2328b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.845085 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f35ba647f99249dabdb9810805b58877 (DEFAULT_TABLE table=default.Table_eea1b385145a4989855907d5eed02328 [id=d313b10f66254890b5a0c93c8c9136ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.845324 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35ba647f99249dabdb9810805b58877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.850004 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a34d76fc72b042b9a4f682e865f44397 (DEFAULT_TABLE table=default.Table_2a9ae2200bc2451c9be9d6b121e695a7 [id=ee854c21b5ed4afdac616b263e8f2836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.850152 1021 tablet_service.cc:1511] Processing CreateTablet for tablet deda702aaf554fc38e43d719b102754f (DEFAULT_TABLE table=default.Table_3e693dd73ff742449e6a82af7b68f122 [id=cf2a021766f241c3aa3e63fe65a7d876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.850281 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34d76fc72b042b9a4f682e865f44397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.850405 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deda702aaf554fc38e43d719b102754f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.855841 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.857268 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 14204e9500de4c23835e82bc2a376b7b (DEFAULT_TABLE table=default.Table_c386b16f4d974890a8fd5df867c9e88f [id=49f1737dbc2e4e009270713ba5acac9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.857579 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14204e9500de4c23835e82bc2a376b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.858461 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b0c49496026246f0a3c123d009c9c27e" } new_table_name: "default.Table_41c6e252f1bf4eeaa38ef484f2e87a05" modify_external_catalogs: true
I20260503 07:53:14.860239 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2734bd26b8ba4525b31bf46ae3cedeea" } modify_external_catalogs: true
I20260503 07:53:14.860265 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7d360d20b40243669f2adb98438fb661"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.860389 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2734bd26b8ba4525b31bf46ae3cedeea" } modify_external_catalogs: true
W20260503 07:53:14.860738 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d360d20b40243669f2adb98438fb661 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.861891 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_50eb48ad04f5421c81bbebf096035b97" } new_table_name: "default.Table_9ff8761ce8284f32baf42e90d89e6fb8" modify_external_catalogs: true
I20260503 07:53:14.862084 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f465ee67c38409ea945ead7c9f84eae" } modify_external_catalogs: true
I20260503 07:53:14.862222 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0f465ee67c38409ea945ead7c9f84eae" } modify_external_catalogs: true
I20260503 07:53:14.861908 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cc6e51bc0e8043b39f23a978249b8355"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.862941 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc6e51bc0e8043b39f23a978249b8355 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.863013 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c59ab3fec2f4ed787f9260a16901b85" } modify_external_catalogs: true
I20260503 07:53:14.863137 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7c59ab3fec2f4ed787f9260a16901b85" } modify_external_catalogs: true
I20260503 07:53:14.863269 1024 tablet_service.cc:1511] Processing CreateTablet for tablet f8672664090a4ab8bc307d6a4efd3806 (DEFAULT_TABLE table=default.Table_71d50bc9af074908b69e040f98a93ba1 [id=cbd85157ff204c6589de86700ac9b9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.863605 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8672664090a4ab8bc307d6a4efd3806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.864277 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3d8bfac37e6d4024ae18b044b89bff8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.864423 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:14.864833 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d8bfac37e6d4024ae18b044b89bff8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.865106 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:14.749780 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:14.874081 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b1386995480944aa9881fc68fcc03c6a" } modify_external_catalogs: true
I20260503 07:53:14.874257 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b1386995480944aa9881fc68fcc03c6a" } modify_external_catalogs: true
I20260503 07:53:14.794036 757 tablet_service.cc:1511] Processing CreateTablet for tablet e4068720834a4ff088139dd907ff9cb9 (DEFAULT_TABLE table=default.Table_4f525a07b4e84b15abed3e131a3fedc6 [id=65dccf79b3b347d682d2b53290daa45e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.795420 751 tablet_service.cc:1511] Processing CreateTablet for tablet b83e492f9445478f890dd9d90321b41a (DEFAULT_TABLE table=default.Table_807644122a02408798de0c8b502b0b07 [id=6f315ff55cc24727a434a90be2ea2b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.877276 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e683012f1fc047c3a80ec030733ee2b8" } new_table_name: "default.Table_4c3e5af70cc8400ab17054fce0da9ec4" modify_external_catalogs: true
I20260503 07:53:14.805053 753 tablet_service.cc:1511] Processing CreateTablet for tablet a34d76fc72b042b9a4f682e865f44397 (DEFAULT_TABLE table=default.Table_2a9ae2200bc2451c9be9d6b121e695a7 [id=ee854c21b5ed4afdac616b263e8f2836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.810017 2819 tablet.cc:1724] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:14.808959 2708 leader_election.cc:290] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:14.813868 774 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.639s user 0.008s sys 0.005s
W20260503 07:53:14.878887 774 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.704s user 0.008s sys 0.005s
I20260503 07:53:14.861105 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe34cedd1e694e09bc3bdf1b3a176a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.879385 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83e492f9445478f890dd9d90321b41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.883606 2740 raft_consensus.cc:493] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.883726 2740 raft_consensus.cc:515] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.884337 2740 leader_election.cc:290] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:14.889068 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33d4ff2b0fe14e2fba3de7873b03f49a consensus state has no leader
I20260503 07:53:14.889433 596 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 24ab201ffa1c4acabb107410d31355e2
I20260503 07:53:14.889559 1052 raft_consensus.cc:2468] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
W20260503 07:53:14.889818 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bca06d9ad364a9e8a6f5d2a95009b36 consensus state has no leader
I20260503 07:53:14.890666 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_768f2bbd81ba4c42a44e594809b502c6" } new_table_name: "default.Table_a6ffba37b4b442829e9093e50b970078" modify_external_catalogs: true
I20260503 07:53:14.891816 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3e693dd73ff742449e6a82af7b68f122" } new_table_name: "default.Table_8e02188769464a9fb41b445e16eb6783" modify_external_catalogs: true
I20260503 07:53:14.892205 1014 tablet_service.cc:1511] Processing CreateTablet for tablet fe34cedd1e694e09bc3bdf1b3a176a9d (DEFAULT_TABLE table=default.Table_cd4cd700b0664401a92371c9ea522087 [id=4ac0e6050fb84703b453f29888fc6c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.892529 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe34cedd1e694e09bc3bdf1b3a176a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.895479 716 leader_election.cc:304] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:14.895840 2708 raft_consensus.cc:2804] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:14.896010 2708 raft_consensus.cc:697] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:14.896302 2708 consensus_queue.cc:237] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.898766 1165 tablet_bootstrap.cc:492] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:14.899114 1165 ts_tablet_manager.cc:1403] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.256s user 0.001s sys 0.004s
I20260503 07:53:14.796108 743 tablet_service.cc:1511] Processing CreateTablet for tablet 25c586dc2fb74270a9669de65e2328b0 (DEFAULT_TABLE table=default.Table_e5559d16a8e243dab7cd61db43c0d0c2 [id=6eb28d00cccf4df3961f8c7be4df3c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.901657 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c586dc2fb74270a9669de65e2328b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.901834 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.904280 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4068720834a4ff088139dd907ff9cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.904500 754 tablet_service.cc:1511] Processing CreateTablet for tablet 14204e9500de4c23835e82bc2a376b7b (DEFAULT_TABLE table=default.Table_c386b16f4d974890a8fd5df867c9e88f [id=49f1737dbc2e4e009270713ba5acac9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.904594 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bb75a18a02be4bab9e1e6e736d47dc76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:14.904996 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14204e9500de4c23835e82bc2a376b7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.905143 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb75a18a02be4bab9e1e6e736d47dc76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.907831 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eca1c70488b24800b87da036697e2137" } modify_external_catalogs: true
I20260503 07:53:14.911537 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.911767 774 raft_consensus.cc:2468] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:14.913044 741 tablet_service.cc:1511] Processing CreateTablet for tablet deda702aaf554fc38e43d719b102754f (DEFAULT_TABLE table=default.Table_3e693dd73ff742449e6a82af7b68f122 [id=cf2a021766f241c3aa3e63fe65a7d876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.913414 2816 raft_consensus.cc:493] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:14.913465 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deda702aaf554fc38e43d719b102754f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.913563 2816 raft_consensus.cc:515] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:14.913884 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 51bc007378534ee6ac8c64bfc41ebcd3 (DEFAULT_TABLE table=default.Table_bba9ffa84f1f430391d8720c5069f67d [id=043db8f8057a4ef79a82683ba0d699be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.914209 2816 leader_election.cc:290] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:14.802436 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 49288.1us
W20260503 07:53:14.914458 715 consensus_peers.cc:597] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:14.914577 715 leader_election.cc:343] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.914230 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51bc007378534ee6ac8c64bfc41ebcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.916102 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34d76fc72b042b9a4f682e865f44397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.918090 756 tablet_service.cc:1511] Processing CreateTablet for tablet f8672664090a4ab8bc307d6a4efd3806 (DEFAULT_TABLE table=default.Table_71d50bc9af074908b69e040f98a93ba1 [id=cbd85157ff204c6589de86700ac9b9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.918673 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8672664090a4ab8bc307d6a4efd3806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.920208 744 tablet_service.cc:1558] Processing DeleteTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.920537 744 tablet_service.cc:1558] Processing DeleteTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.920979 744 tablet_service.cc:1558] Processing DeleteTablet for tablet dab8cc17114146628682a0a8432596d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.921213 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 157bb83e56234f17b906756c0d70868c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.921525 744 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3862d990f14c3f8a084d234d941bfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:14.924244 2854 tablet.cc:1724] T 9a7af140ce144bc8b2e147dad98ac201 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:14.929054 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.929248 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet dab8cc17114146628682a0a8432596d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.929358 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3862d990f14c3f8a084d234d941bfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.929632 1017 tablet_service.cc:1511] Processing CreateTablet for tablet d23ff7d87cdf49d5b3c5f367f80d1fff (DEFAULT_TABLE table=default.Table_7e8b1843f23145218ea02f3f48c49572 [id=89cfc291dc4144e4b521be1dd87797a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.929996 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8 (DEFAULT_TABLE table=default.Table_5eb646eacf084a7dbebf001fe2b34e7d [id=73cf4cb30108407ca87e9fa87f9df305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.930292 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet aaef17b7249e4f208b672fde4a284590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.930322 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.930641 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 (DEFAULT_TABLE table=default.Table_1fa913322e01470c9941e894f6a75e75 [id=b77b1075bad04704827e76cf1fa8283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.930938 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ff7d87cdf49d5b3c5f367f80d1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.930914 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 85ce02a2b5984765bbb292b0c3ce8c8a (DEFAULT_TABLE table=default.Table_3688b03b7ca446e8b2d00614a7863d90 [id=63797f54c98a41a2b16de0599719b2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.931488 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ce02a2b5984765bbb292b0c3ce8c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.932332 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7fad6661384f2b9a125c1bc7b8345a (DEFAULT_TABLE table=default.Table_e683012f1fc047c3a80ec030733ee2b8 [id=a41c0f5b959049e6a6de8d4c0afe162d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.932617 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.932910 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 9f008243dbcc4893a915b079e1ee9805 (DEFAULT_TABLE table=default.Table_b4ac4f2792ca45aa8fbeb9453bd07d88 [id=94515cdcae5c42a9a3d27b1ac420b4ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.933096 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 637af4aa4d0543b1b179cd3a8fdeadca (DEFAULT_TABLE table=default.Table_6704a05ca52c4a8cad6e31d38118f26e [id=bb010ee38e4e4867ac507829a67b57e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.932927 1029 tablet_service.cc:1511] Processing CreateTablet for tablet e7faa40fdb9e4560a7b0759d774e8a9d (DEFAULT_TABLE table=default.Table_b11f056d948f43f5a39c9b846137d9c8 [id=3e6fa244b6204b52bb38c756b3c9ccdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.933583 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 2f948e5d45d347e09ea73c5a52233858 (DEFAULT_TABLE table=default.Table_449c7851c1704ea496ea74632c7ea2da [id=927f1d8020484f559b895c677916204f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.930399 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 2df37ced81264092a170c9b9548f01d7 (DEFAULT_TABLE table=default.Table_259899fd21c4432baa40574f11e4e9f0 [id=c5711e571aa2409b87e50e6c5f0757bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.934338 1019 tablet_service.cc:1511] Processing CreateTablet for tablet f3bdb03e1eea408e983cbf86f9faf007 (DEFAULT_TABLE table=default.Table_f3377c51ac0546ada5f045f337b91110 [id=3bd3dcdf2f5a49e29987e03cff0894d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.935169 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 79a662b661114ea4bd986f985a13092d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:14.935729 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f6227c81b5c54e579d31a966a0e2e531 (DEFAULT_TABLE table=default.Table_4298b47c6c014712adbd5a05a9920de6 [id=21a8a72a90464c2cb20f8b1a70b97c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.938313 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eca1c70488b24800b87da036697e2137" } modify_external_catalogs: true
I20260503 07:53:14.940690 592 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:14.935660 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 0911e2364ebf4e25bcc3f7420be042bd (DEFAULT_TABLE table=default.Table_9a741073f462488bb9bd48619d464c15 [id=3b67a9092dee4a7195b3ff6160fa176e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.944789 1027 tablet_service.cc:1511] Processing CreateTablet for tablet af2210af3e8b41c283da360610c5e805 (DEFAULT_TABLE table=default.Table_0eeec067673744d58cdb5243c65ca773 [id=35a1ee8829a847c19c1c0bce035a034b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.945896 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:14.946328 1165 raft_consensus.cc:359] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.946586 1165 raft_consensus.cc:385] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:14.946686 1165 raft_consensus.cc:740] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:14.947259 1165 consensus_queue.cc:260] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:14.947896 1165 ts_tablet_manager.cc:1434] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260503 07:53:14.952225 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3759511d942bfbc6e50ea2e2f2777" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:14.957747 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b0ba340aa94ea78c2a0982d65e129f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.871977 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:14.958945 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:14.962150 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1ab085f9bb854edaa2ebdc4cb085db34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:14.962989 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ab085f9bb854edaa2ebdc4cb085db34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:14.963934 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b67fc66ebf40a6b726a76ed813fb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.964184 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87aab6151d34bb7b0efb00f5cfdf64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.967212 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708cababc844e51ab7da2950664c2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.968000 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8774ffc66c854bcd8d8f394b9bc8a0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.968672 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4fd383b31f46e3b02ab5356c791b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.973779 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a8057297cc4a16813a545fc2b947d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.979903 2644 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 07:53:14.980481 2644 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260503 07:53:14.980527 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66af40676bd48ba90d4291de161d54f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.980659 2644 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260503 07:53:14.985635 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2727074984065bc603363e2b62cb8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.986745 715 leader_election.cc:343] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:14.986753 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5d03e9f4504a8987128b93d3f296a2 (DEFAULT_TABLE table=default.Table_2509bf88cbff482784e5dae08dde4f3b [id=9b539815642048ebb258668277476738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.995536 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ea60ce7a14842b6cdab25e9f0d150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.995879 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93d2f3321bb4a018c1798eeef92abac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:14.999887 2644 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 07:53:15.000047 2644 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 07:53:15.000190 2644 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 07:53:15.000299 2644 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 07:53:15.000823 1174 ts_tablet_manager.cc:1929] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:15.001025 1174 log.cc:1199] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c9457d5693eb4f3da5501a0e581fe75c
I20260503 07:53:14.935935 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 157f7f12772b4c7189963535a8b86ab8 (DEFAULT_TABLE table=default.Table_3d3a13b279f8478599baeb7f7f4648df [id=60f43ca9dcf44d24b1e23889b47d5a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.007344 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f7f12772b4c7189963535a8b86ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.007715 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f008243dbcc4893a915b079e1ee9805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.008394 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2210af3e8b41c283da360610c5e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.009186 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df37ced81264092a170c9b9548f01d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.009629 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bdb03e1eea408e983cbf86f9faf007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.010288 1028 tablet_service.cc:1511] Processing CreateTablet for tablet ee495f04cf0d49158ccf2358dcc9fad8 (DEFAULT_TABLE table=default.Table_3d890f77dcdf464bba74b7797fb86d79 [id=2f1f230fc0c84406be848d39ebe3216d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:14.939504 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 157bb83e56234f17b906756c0d70868c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.010810 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7fad6661384f2b9a125c1bc7b8345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.011243 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637af4aa4d0543b1b179cd3a8fdeadca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.011287 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed9c2b2604242008415d636a4c273b9 (DEFAULT_TABLE table=default.Table_e753e8572bf746c580f2331da7b73034 [id=8d8f16d90318418aa817026b0f06c3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.011669 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7faa40fdb9e4560a7b0759d774e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.012102 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911e2364ebf4e25bcc3f7420be042bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.012475 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6227c81b5c54e579d31a966a0e2e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.013566 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.013741 762 raft_consensus.cc:2468] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:15.014827 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.015920 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.018242 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.018661 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79225c2dd80e41bf93ad2fa023b2a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.019673 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet baa7721278d14e71aeba005d2bd40ecd
I20260503 07:53:15.020604 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8774ffc66c854bcd8d8f394b9bc8a0de
I20260503 07:53:15.021131 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6afc9e653bc742d0acfb720ab4f56658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.021663 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6afc9e653bc742d0acfb720ab4f56658 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:15.022863 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet deda702aaf554fc38e43d719b102754f consensus state has no leader
I20260503 07:53:15.023144 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3096be03a61e425a99a8086b09e4c157"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.023408 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7cbd105ef7a3474fa546b4945ddc875a
I20260503 07:53:15.023821 592 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_058d3f065dd6438eb2ef31f7fc0b5ad1 [id=511c8a1028b1401c91f3c164e4b70683] alter complete (version 1)
I20260503 07:53:15.022851 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5d03e9f4504a8987128b93d3f296a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:15.026110 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb consensus state has no leader
I20260503 07:53:15.023115 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_918a7bdc4b7244a597fd0afb8c8a7adf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.028483 1165 tablet_bootstrap.cc:492] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:15.028542 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_918a7bdc4b7244a597fd0afb8c8a7adf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.030032 1165 tablet_bootstrap.cc:654] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.030179 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 83c6b320f8c446a2bee7dc25af7f49c0
W20260503 07:53:15.030872 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f7fad6661384f2b9a125c1bc7b8345a consensus state has no leader
W20260503 07:53:15.031785 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3096be03a61e425a99a8086b09e4c157 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.045807 2644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:43005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:44841,127.0.105.61:41759,127.0.105.60:40873
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.61:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.61
--webserver_port=38399
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 07:43:22 UTC on bdcb31816ec0
build id 11722
ASAN enabled
I20260503 07:53:15.047580 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f948e5d45d347e09ea73c5a52233858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.052345 1174 ts_tablet_manager.cc:1950] T c9457d5693eb4f3da5501a0e581fe75c P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:15.053113 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 928) took 6653 ms. Trace:
I20260503 07:53:15.053208 1174 rpcz_store.cc:276] 0503 07:53:08.399717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.435765 (+ 36048us) service_pool.cc:224] Handling call
0503 07:53:14.446582 (+6010817us) ts_tablet_manager.cc:1151] Deleting tablet c9457d5693eb4f3da5501a0e581fe75c
0503 07:53:14.446591 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.742477 (+295886us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.000766 (+258289us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.053094 (+ 52328us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6010644}
I20260503 07:53:15.053499 1174 tablet_replica.cc:333] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:15.053668 1174 raft_consensus.cc:2243] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.053810 1174 raft_consensus.cc:2272] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.047871 2644 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:53:15.054337 1174 ts_tablet_manager.cc:1916] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.056536 2644 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260503 07:53:15.064210 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.065451 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_f7d6abb46e1542c2a900101ca6fa5099 [id=24fd4589eb1145eaaef226bb18346edd] alter complete (version 2)
I20260503 07:53:15.068327 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee495f04cf0d49158ccf2358dcc9fad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.071731 2816 raft_consensus.cc:493] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.071852 2816 raft_consensus.cc:515] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.072427 2816 leader_election.cc:290] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.080937 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed9c2b2604242008415d636a4c273b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.083537 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b68f6201a8c74e3db86c941d919bf8de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.084156 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b68f6201a8c74e3db86c941d919bf8de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.089601 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00535762e832485c987b735c7d6d0671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:14.959851 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:15.096774 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8306df6ff4d74da7baa4a439498cdb5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.097262 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8306df6ff4d74da7baa4a439498cdb5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.097905 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb732ccf487c4052974b1c65720243bd" } modify_external_catalogs: true
I20260503 07:53:15.097872 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2946eabdeefd44cb8de4aefc235cc906" } new_table_name: "default.Table_868eb376b61f485b8831572b35e6f606" modify_external_catalogs: true
I20260503 07:53:15.098140 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c8358ee48d14474cb1bfb40be55ee485" } new_table_name: "default.Table_fc9f7ee7b49e4b1493cf7675fa2995b8" modify_external_catalogs: true
I20260503 07:53:15.098169 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c385c133b5ff4ec7bfd4073f7e175538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.098608 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c385c133b5ff4ec7bfd4073f7e175538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.099532 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_557490923aff4617bea08659402eddf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.099982 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_557490923aff4617bea08659402eddf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.100275 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_575d34ce55254889a874cd08afb29ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.100684 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_575d34ce55254889a874cd08afb29ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:15.107046 2867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:53:15.110374 2868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:53:15.113623 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2824974ab454c84172ec3d27e5aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.122613 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2aa55fb8d042e0ad24bcc25ddcf522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.125407 2644 server_base.cc:1061] running on GCE node
W20260503 07:53:15.126111 988 leader_election.cc:343] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.126309 988 leader_election.cc:304] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.126609 2816 raft_consensus.cc:2749] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.093389 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
W20260503 07:53:15.129240 2870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:53:15.131078 988 leader_election.cc:343] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.124392 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5691fe1fb1c476287c90f2ab4ff786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.133121 2644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 07:53:15.142894 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb732ccf487c4052974b1c65720243bd" } modify_external_catalogs: true
I20260503 07:53:15.143793 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.145645 1165 tablet_bootstrap.cc:492] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.145918 1165 ts_tablet_manager.cc:1403] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.001s
I20260503 07:53:15.147413 1165 raft_consensus.cc:359] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.147688 1165 raft_consensus.cc:385] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.147801 1165 raft_consensus.cc:740] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.148226 1165 consensus_queue.cc:260] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.131341 988 leader_election.cc:304] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.155510 2816 raft_consensus.cc:2749] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.155936 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1014) took 5981 ms. Trace:
I20260503 07:53:15.156034 1175 rpcz_store.cc:276] 0503 07:53:09.174137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.174201 (+ 64us) service_pool.cc:224] Handling call
0503 07:53:14.146903 (+4972702us) ts_tablet_manager.cc:1151] Deleting tablet 56749914e1a349f0876f52157affdf69
0503 07:53:14.146912 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:14.340831 (+193919us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.343533 (+ 2702us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.155917 (+812384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5025,"tablet-delete.queue_time_us":4972493}
I20260503 07:53:15.156498 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1013) took 5982 ms. Trace:
I20260503 07:53:15.156582 1175 rpcz_store.cc:276] 0503 07:53:09.173982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.174731 (+ 749us) service_pool.cc:224] Handling call
0503 07:53:15.156370 (+5981639us) ts_tablet_manager.cc:1151] Deleting tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc
0503 07:53:15.156381 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.156482 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5981475}
W20260503 07:53:15.156991 988 leader_election.cc:343] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.158888 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1015) took 5964 ms. Trace:
I20260503 07:53:15.159825 1174 ts_tablet_manager.cc:1929] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.159940 1174 log.cc:1199] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/773fca453dac452abc723e49b70111b9
W20260503 07:53:15.160079 988 leader_election.cc:343] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.164577 1165 ts_tablet_manager.cc:1434] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260503 07:53:15.164969 1165 tablet_bootstrap.cc:492] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.165482 1171 tablet_bootstrap.cc:492] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:53:15.165515 988 leader_election.cc:343] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.166528 586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111) [suppressed 25 similar messages]
I20260503 07:53:15.165611 1171 ts_tablet_manager.cc:1403] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.537s user 0.042s sys 0.034s
I20260503 07:53:15.168439 988 leader_election.cc:304] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.159034 1175 rpcz_store.cc:276] 0503 07:53:09.194341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.194395 (+ 54us) service_pool.cc:224] Handling call
0503 07:53:15.156801 (+5962406us) ts_tablet_manager.cc:1151] Deleting tablet baf176bdc6d54088846ee5eaf5e61447
0503 07:53:15.157465 (+ 664us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.158844 (+ 1379us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5962221}
I20260503 07:53:15.169153 1175 tablet_replica.cc:333] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.169335 1175 raft_consensus.cc:2243] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.172354 2644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 07:53:15.172511 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.174329 2644 hybrid_clock.cc:648] HybridClock initialized: now 1777794795174288 us; error 38 us; skew 500 ppm
I20260503 07:53:15.174777 2644 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:53:15.127526 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:15.186075 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.186578 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.187007 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:15.191372 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42c82dbdf98947fca0b8aaa9f47f13db consensus state has no leader
W20260503 07:53:15.191916 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8c26bdda34a4bb9b980401ad6f0cad2 consensus state has no leader
I20260503 07:53:15.199071 2862 raft_consensus.cc:2749] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.199923 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet e36b8bb09d5849cea5ba5b67155b590a
I20260503 07:53:15.201289 2644 webserver.cc:492] Webserver started at http://127.0.105.61:38399/ using document root <none> and password file <none>
I20260503 07:53:15.201843 1171 raft_consensus.cc:359] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.202030 1171 raft_consensus.cc:385] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.202095 1171 raft_consensus.cc:740] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.202299 1171 consensus_queue.cc:260] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.202817 1171 ts_tablet_manager.cc:1434] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260503 07:53:15.203117 1171 tablet_bootstrap.cc:492] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.202912 2644 fs_manager.cc:362] Metadata directory not provided
I20260503 07:53:15.203272 2644 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:53:15.204623 2802 raft_consensus.cc:493] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.204732 2802 raft_consensus.cc:515] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:15.205080 988 leader_election.cc:343] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.205314 1175 raft_consensus.cc:2272] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.205811 1171 tablet_bootstrap.cc:654] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.206084 1175 ts_tablet_manager.cc:1916] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.206933 2802 leader_election.cc:290] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.217682 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.218588 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.219101 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:15.221858 986 leader_election.cc:304] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.222159 2802 raft_consensus.cc:2804] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:15.222256 2802 raft_consensus.cc:697] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:15.222447 2802 consensus_queue.cc:237] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.228271 1173 ts_tablet_manager.cc:1929] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:15.228379 1173 log.cc:1199] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/596130e78eb1444a96480fc1075478cd
I20260503 07:53:15.228664 1173 ts_tablet_manager.cc:1950] T 596130e78eb1444a96480fc1075478cd P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:15.228637 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c4f599d97c14121ab590982ded7da24" } modify_external_catalogs: true
I20260503 07:53:15.228724 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6bfd9bf351fb41e4bd497d54a607e041" } modify_external_catalogs: true
I20260503 07:53:15.228806 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2c4f599d97c14121ab590982ded7da24" } modify_external_catalogs: true
I20260503 07:53:15.228819 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_6bfd9bf351fb41e4bd497d54a607e041" } modify_external_catalogs: true
I20260503 07:53:15.233101 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.233749 986 leader_election.cc:304] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.234014 2862 raft_consensus.cc:2804] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:15.234221 2862 raft_consensus.cc:697] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:15.235167 2862 consensus_queue.cc:237] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.235370 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.242430 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_13da6ea9ff3f422d9a7234c57ba92764" } new_table_name: "default.Table_23be8f8bbc944a958379aa20b658b47a" modify_external_catalogs: true
I20260503 07:53:15.242645 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d2bff2e711dc43a7b8757df95f3173b3
I20260503 07:53:15.242758 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_84316b71af09498f9e9a82cde5c24dff" } new_table_name: "default.Table_14a2c824a0ba4a23ab34516fb880faf8" modify_external_catalogs: true
W20260503 07:53:15.243139 2814 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.259s user 0.000s sys 0.001s
I20260503 07:53:15.243590 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c80939a7093c450d9c329f058eb4f6e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.243992 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c80939a7093c450d9c329f058eb4f6e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.244035 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3f26e2bf724b4df49cf01f05597312b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.245064 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f26e2bf724b4df49cf01f05597312b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.245152 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6eff74f66a7422495c40dd3a55319e0" } modify_external_catalogs: true
I20260503 07:53:15.245293 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d6eff74f66a7422495c40dd3a55319e0" } modify_external_catalogs: true
I20260503 07:53:15.246397 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ded7810841684e97ba79192f06d51bff" } new_table_name: "default.Table_cf1aadf5bcb4462dbd5bb81eb6c24e19" modify_external_catalogs: true
I20260503 07:53:15.247190 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.247743 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1091) took 2528 ms. Trace:
I20260503 07:53:15.247844 884 rpcz_store.cc:276] 0503 07:53:12.718937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.404316 (+685379us) service_pool.cc:224] Handling call
0503 07:53:13.414429 (+ 10113us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.414455 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.961353 (+1546898us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.963751 (+ 2398us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.247727 (+283976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.248499 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1079) took 2716 ms. Trace:
I20260503 07:53:15.248582 880 rpcz_store.cc:276] 0503 07:53:12.532483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.198294 (+665811us) service_pool.cc:224] Handling call
0503 07:53:13.218199 (+ 19905us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.218221 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.966899 (+1748678us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.016616 (+ 49717us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.248486 (+231870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.248994 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1082) took 2716 ms. Trace:
I20260503 07:53:15.248953 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4b95589e7ea46c792a7f069992951a8" } modify_external_catalogs: true
I20260503 07:53:15.249089 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d4b95589e7ea46c792a7f069992951a8" } modify_external_catalogs: true
I20260503 07:53:15.249065 889 rpcz_store.cc:276] 0503 07:53:12.532690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.250446 (+717756us) service_pool.cc:224] Handling call
0503 07:53:13.281989 (+ 31543us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.282015 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.971044 (+1689029us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.973494 (+ 2450us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.248981 (+275487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.249521 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1111) took 2482 ms. Trace:
I20260503 07:53:15.249588 892 rpcz_store.cc:276] 0503 07:53:12.767252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.644817 (+877565us) service_pool.cc:224] Handling call
0503 07:53:13.645220 (+ 403us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.645251 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.971431 (+1326180us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:14.973679 (+ 2248us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.249510 (+275831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.251225 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1113) took 2483 ms. Trace:
W20260503 07:53:15.251334 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0c31cc44bea459081697fa3b17bb403 consensus state has no leader
W20260503 07:53:15.251978 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6ef54bb09984a529815ea974905eb20 consensus state has no leader
I20260503 07:53:15.252650 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 918d98225bd44da9afef237fb836b6b3
I20260503 07:53:15.252717 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1093) took 2498 ms. Trace:
I20260503 07:53:15.252777 886 rpcz_store.cc:276] 0503 07:53:12.753909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.415634 (+661725us) service_pool.cc:224] Handling call
0503 07:53:13.416012 (+ 378us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.416036 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.033638 (+1617602us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.131525 (+ 97887us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.252705 (+121180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.253087 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1110) took 2486 ms. Trace:
I20260503 07:53:15.253319 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1124) took 2103 ms. Trace:
I20260503 07:53:15.253904 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1075) took 2723 ms. Trace:
I20260503 07:53:15.253983 891 rpcz_store.cc:276] 0503 07:53:12.530467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.168477 (+638010us) service_pool.cc:224] Handling call
0503 07:53:13.181497 (+ 13020us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.181632 (+ 135us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.045354 (+1863722us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.198511 (+153157us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.253891 (+ 55380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.254387 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 901) took 6954 ms. Trace:
I20260503 07:53:15.254472 1173 rpcz_store.cc:276] 0503 07:53:08.299912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.299967 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:13.610374 (+5310407us) ts_tablet_manager.cc:1151] Deleting tablet 596130e78eb1444a96480fc1075478cd
0503 07:53:13.610384 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.215507 (+1605123us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.228199 (+ 12692us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.254370 (+ 26171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5310253}
I20260503 07:53:15.254827 1173 tablet_replica.cc:333] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:15.255043 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1084) took 2716 ms. Trace:
I20260503 07:53:15.255148 895 rpcz_store.cc:276] 0503 07:53:12.532820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.288344 (+755524us) service_pool.cc:224] Handling call
0503 07:53:13.290716 (+ 2372us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.290744 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.978728 (+1687984us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.034315 (+ 55587us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.249438 (+215123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.251320 883 rpcz_store.cc:276] 0503 07:53:12.767412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.710807 (+943395us) service_pool.cc:224] Handling call
0503 07:53:13.715441 (+ 4634us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.715463 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.983167 (+1267704us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.113323 (+130156us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.251204 (+137881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.253379 888 rpcz_store.cc:276] 0503 07:53:13.150350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.713710 (+563360us) service_pool.cc:224] Handling call
0503 07:53:13.717361 (+ 3651us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.717383 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.995133 (+1277750us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.173400 (+178267us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.253308 (+ 79908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.261523 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 3f95e49dfec744da94a6db8c46475302
W20260503 07:53:15.261977 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7dcf2ca392e43528c164c5372cf4c78 consensus state has no leader
I20260503 07:53:15.262656 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 378cc6d613584f308d3c0fb68b31f26e
W20260503 07:53:15.262296 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 56940.1us
W20260503 07:53:15.263036 988 leader_election.cc:343] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.264448 988 leader_election.cc:343] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.264420 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b3e72ade570e4453a358a772d6c9717e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.264875 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3e72ade570e4453a358a772d6c9717e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.266580 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_59ec796d480b44249426d1dfc637aee5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.267019 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59ec796d480b44249426d1dfc637aee5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:15.264636 988 leader_election.cc:343] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.267370 988 leader_election.cc:343] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.268317 986 leader_election.cc:343] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.268425 986 leader_election.cc:304] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.268819 2816 raft_consensus.cc:2749] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:15.269362 986 leader_election.cc:343] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.269476 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_692ad5dc212c48819189ebe9e823d551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.269989 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_692ad5dc212c48819189ebe9e823d551 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.270308 1166 tablet_bootstrap.cc:654] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.253149 887 rpcz_store.cc:276] 0503 07:53:12.767163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.644558 (+877395us) service_pool.cc:224] Handling call
0503 07:53:13.692696 (+ 48138us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.692725 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.004107 (+1311382us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.133750 (+129643us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.253075 (+119325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:15.273914 986 leader_election.cc:343] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.274230 986 leader_election.cc:304] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:15.274658 2816 raft_consensus.cc:2804] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:15.274775 2816 raft_consensus.cc:697] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:15.274994 2816 consensus_queue.cc:237] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.275691 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1090) took 2567 ms. Trace:
I20260503 07:53:15.275767 893 rpcz_store.cc:276] 0503 07:53:12.708645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.332192 (+623547us) service_pool.cc:224] Handling call
0503 07:53:13.332638 (+ 446us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.332660 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.220027 (+1887367us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.275540 (+ 55513us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.275673 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.279553 986 leader_election.cc:304] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.279778 2816 raft_consensus.cc:2804] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.279835 2816 raft_consensus.cc:493] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.279928 2816 raft_consensus.cc:3060] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.283089 2816 raft_consensus.cc:515] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.284415 2816 leader_election.cc:290] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.287442 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1112) took 2520 ms. Trace:
I20260503 07:53:15.287534 896 rpcz_store.cc:276] 0503 07:53:12.767329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.693106 (+925777us) service_pool.cc:224] Handling call
0503 07:53:13.695129 (+ 2023us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.695151 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.221022 (+1525871us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.287286 (+ 66264us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.287425 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.293072 1173 raft_consensus.cc:2243] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.293294 1173 raft_consensus.cc:2272] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.293790 1173 ts_tablet_manager.cc:1916] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:15.295845 986 leader_election.cc:343] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.298496 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1094) took 2534 ms. Trace:
I20260503 07:53:15.298585 881 rpcz_store.cc:276] 0503 07:53:12.763571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.417875 (+654304us) service_pool.cc:224] Handling call
0503 07:53:13.418244 (+ 369us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.418265 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.104037 (+1685772us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.298179 (+194142us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.298479 (+ 300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.178181 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1123)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1127)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1128)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1132)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1133)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1134)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1135)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1137)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1138)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1139)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1140)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1141)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1142)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1145)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1146)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1147)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1149)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1152)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
I20260503 07:53:15.301105 2816 consensus_queue.cc:1048] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:15.301632 1165 tablet_bootstrap.cc:654] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:15.302065 988 leader_election.cc:343] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.302253 988 leader_election.cc:304] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.302552 2816 raft_consensus.cc:2749] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.303170 1171 tablet_bootstrap.cc:492] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.303323 1171 ts_tablet_manager.cc:1403] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.003s
I20260503 07:53:15.303947 1171 raft_consensus.cc:359] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.304119 1171 raft_consensus.cc:385] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.304205 1171 raft_consensus.cc:740] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.304404 1171 consensus_queue.cc:260] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.310309 986 leader_election.cc:304] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.310710 2802 raft_consensus.cc:2804] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.310842 2802 raft_consensus.cc:493] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.310954 2802 raft_consensus.cc:3060] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.314107 879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1092) took 2595 ms. Trace:
I20260503 07:53:15.314245 879 rpcz_store.cc:276] 0503 07:53:12.719034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.406712 (+687678us) service_pool.cc:224] Handling call
0503 07:53:13.422568 (+ 15856us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.422593 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.182237 (+1759644us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.313917 (+131680us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.314089 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:15.314806 988 leader_election.cc:343] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.314965 988 leader_election.cc:304] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.315227 2816 raft_consensus.cc:2749] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.317154 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1089) took 2608 ms. Trace:
I20260503 07:53:15.317250 897 rpcz_store.cc:276] 0503 07:53:12.708518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.300744 (+592226us) service_pool.cc:224] Handling call
0503 07:53:13.332951 (+ 32207us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.332969 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.189308 (+1856339us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.231654 (+ 42346us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.317137 (+ 85483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.318286 889 tablet_service.cc:1511] Processing CreateTablet for tablet 759f0cc8b2c4440fa2830087ffe38d8f (DEFAULT_TABLE table=default.Table_f6d4a870eb2047848f1d4f7f62272c05 [id=3d96ed696d7546a6a97a0b7ac923a432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.318410 883 tablet_service.cc:1558] Processing DeleteTablet for tablet e63ee58b76a24cdc9b701f44aad4d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.318545 883 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbede2c323a420b8a0ca2434d4ad5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.318286 887 tablet_service.cc:1511] Processing CreateTablet for tablet 0516484f0ffd41b383f20a7bad1cb72c (DEFAULT_TABLE table=default.Table_4c1d216c3b5b4d10b263944d20c92d5a [id=2a2747efc75744cd9f324da9768ac006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.318662 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759f0cc8b2c4440fa2830087ffe38d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.318964 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0516484f0ffd41b383f20a7bad1cb72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.318661 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f523d718ae8475390f78cf2af6758da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.319731 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d24ae9e604144ca589008d6697d849df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.319886 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d9269dd6a9af493a8452b7f657355933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.320094 883 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d0e93ae66c46749c4f7e9e495ae60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.320293 883 tablet_service.cc:1558] Processing DeleteTablet for tablet ef666aa007504682bc044cbd0b56060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.320591 883 tablet_service.cc:1511] Processing CreateTablet for tablet 630de41e4a344aec9510a8640e415308 (DEFAULT_TABLE table=default.Table_e25655dbf11749b3887a71e4b6f5aa17 [id=6bd82b57011a4cfb963da292812a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.320927 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630de41e4a344aec9510a8640e415308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.321501 888 tablet_service.cc:1511] Processing CreateTablet for tablet 03160137934e4709854746096e8b5159 (DEFAULT_TABLE table=default.Table_d624a887085f4e13a8cfadaaefd51833 [id=105a8973b6de43c4a9c7ca94d0370bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.322252 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 001ded76f1894772898cb660e501984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.322294 892 tablet_service.cc:1511] Processing CreateTablet for tablet d30ad713a05b41dd814d5787de7cff2f (DEFAULT_TABLE table=default.Table_6b08393d6dc448cb83b53551d377ee44 [id=28444fe333dc46cdacc546bf64e34c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.322525 880 tablet_service.cc:1511] Processing CreateTablet for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3 (DEFAULT_TABLE table=default.Table_fad9f90b3ee34de9b2d5c689b8e20608 [id=7dc4492673fc4fd1bb84fd54ff37a36c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.322734 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30ad713a05b41dd814d5787de7cff2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.322836 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d2f95e3ad844bc39593787e38a45bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.322979 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 797372a021aa48bab4ca695d897164d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.323202 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1086) took 2718 ms. Trace:
I20260503 07:53:15.323268 885 rpcz_store.cc:276] 0503 07:53:12.532997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.290922 (+757925us) service_pool.cc:224] Handling call
0503 07:53:13.291317 (+ 395us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.291340 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:14.982800 (+1691460us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.112497 (+129697us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.251204 (+138707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.323469 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b08e403756a4d99867263d0941d2120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.323714 885 tablet_service.cc:1511] Processing CreateTablet for tablet 5e128818985a435faf6a464fa9a9632d (DEFAULT_TABLE table=default.Table_e04055e3ddf94ea08fd1570c20730d94 [id=5ea7032b777e418e9a4cffb1ecc19a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.324088 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e128818985a435faf6a464fa9a9632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.324705 884 tablet_service.cc:1558] Processing DeleteTablet for tablet dad4408db9eb47c9bb925fb66b7d8b8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.324949 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.325546 886 tablet_service.cc:1511] Processing CreateTablet for tablet 7cead0c0237b4360bc84c661deaf7dd9 (DEFAULT_TABLE table=default.Table_36da2c59317c4f3bb4c2b3b203f298b7 [id=62773f34d971442b89b2bb86e127109f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.325876 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cead0c0237b4360bc84c661deaf7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:15.325830 988 leader_election.cc:343] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.326534 988 consensus_peers.cc:597] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:15.326681 988 consensus_peers.cc:597] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:15.326797 988 leader_election.cc:343] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.327036 988 leader_election.cc:343] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.327122 988 leader_election.cc:304] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.328094 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c25b29188224fbe98ee8c6f6b7b956b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.328454 891 tablet_service.cc:1511] Processing CreateTablet for tablet f57c00249b9e49a4b7024e77c9b9980f (DEFAULT_TABLE table=default.Table_e49ae08f607b4c01950a4c2e9c04e701 [id=249f10bfb3f144b693ada847ef78214d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.329075 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 70243e24ae17460f9d3e20720a9bfa53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.329306 881 tablet_service.cc:1558] Processing DeleteTablet for tablet df60413555764bcab464b18c6a3370ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.329766 881 tablet_service.cc:1511] Processing CreateTablet for tablet 11ba99bde68e470b810e56dc488af990 (DEFAULT_TABLE table=default.Table_1463c35f4b2842478f204ed142920e74 [id=60b81508db0c42caad3953bdd9d3a98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.335088 2740 consensus_queue.cc:1048] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:15.337023 1171 ts_tablet_manager.cc:1434] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260503 07:53:15.337422 1171 tablet_bootstrap.cc:492] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:15.338248 986 leader_election.cc:343] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.339077 1174 ts_tablet_manager.cc:1950] T 773fca453dac452abc723e49b70111b9 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:15.341684 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c1bede5f6a154557b54f60570220730c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.342170 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1bede5f6a154557b54f60570220730c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.342650 986 leader_election.cc:304] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.343041 2816 raft_consensus.cc:2804] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.343171 2816 raft_consensus.cc:493] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.343286 2816 raft_consensus.cc:3060] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.345675 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213b04ab933e4fc9b2af9d59ed4ebfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.347024 2816 raft_consensus.cc:515] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.347666 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5d55b39bcf4195a55edce71e37aa0a (DEFAULT_TABLE table=default.Table_5d7ddac49c474eacb06291a067c7aa8f [id=e2395e1f7dbb49018f744f933033297d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:15.348542 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet b0c31cc44bea459081697fa3b17bb403 (table default.Table_23be8f8bbc944a958379aa20b658b47a [id=67b0b0b7c0954efb9597c715d26be13e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b0c31cc44bea459081697fa3b17bb403 consensus state has no leader
I20260503 07:53:15.350075 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03160137934e4709854746096e8b5159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.321979 893 tablet_service.cc:1511] Processing CreateTablet for tablet af91a12968604fc795239b1141f9fa10 (DEFAULT_TABLE table=default.Table_7ffb7ee3ef9848d2860e3ae82ed1e12b [id=e3b71e5427154b3a89f1df4784e69198]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.352583 2816 leader_election.cc:290] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:15.352945 986 leader_election.cc:343] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.353754 2862 consensus_queue.cc:1048] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:15.355345 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c00249b9e49a4b7024e77c9b9980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.357652 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.357827 884 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83 (DEFAULT_TABLE table=default.Table_599ffdae4ad6419799d2d72fb73675f7 [id=3925031ff6274f36a98b37ba90826281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.357959 895 tablet_service.cc:1511] Processing CreateTablet for tablet 13ee6084657f408d84225ece852861f3 (DEFAULT_TABLE table=default.Table_628de4684f604a43b78f012131ac17aa [id=8596fbebad97418380f9eabec3d59437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.358115 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcc5ec2a85b4d978f26857c0e6a1b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.358387 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ee6084657f408d84225ece852861f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.364639 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1154) took 1560 ms. Trace:
I20260503 07:53:15.364773 895 rpcz_store.cc:276] 0503 07:53:13.804126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.357793 (+1553667us) service_pool.cc:224] Handling call
0503 07:53:15.358100 (+ 307us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.358117 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.361327 (+ 3210us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.364482 (+ 3155us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.364618 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.366888 895 tablet_service.cc:1511] Processing CreateTablet for tablet 5f42346173b2401eac1a2c5abcb532ee (DEFAULT_TABLE table=default.Table_04db65b076f54c28b6b7712c3f86c5e9 [id=865af6f77f084e6d8c01b178f137e7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.367244 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f42346173b2401eac1a2c5abcb532ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.368566 1165 tablet_bootstrap.cc:492] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.368758 1165 ts_tablet_manager.cc:1403] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.204s user 0.002s sys 0.001s
I20260503 07:53:15.369436 1165 raft_consensus.cc:359] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.369609 1165 raft_consensus.cc:385] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.369673 1165 raft_consensus.cc:740] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.369904 1165 consensus_queue.cc:260] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.370517 1165 ts_tablet_manager.cc:1434] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:15.372171 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1150) took 1568 ms. Trace:
I20260503 07:53:15.372285 884 rpcz_store.cc:276] 0503 07:53:13.803865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.325103 (+1521238us) service_pool.cc:224] Handling call
0503 07:53:15.357979 (+ 32876us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.358003 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.362730 (+ 4727us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.372029 (+ 9299us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.372156 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.372706 884 tablet_service.cc:1511] Processing CreateTablet for tablet 993372c2d7aa4681b2dc4c0f0738a34b (DEFAULT_TABLE table=default.Table_5c5cb92d3b904b77bcac954dae67f1fe [id=4b5f46b8c7d6474ba8f4010bba22dc34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.372997 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993372c2d7aa4681b2dc4c0f0738a34b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:15.365387 851 service_pool.cc:136] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items [suppressed 8 similar messages]
I20260503 07:53:15.374261 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
I20260503 07:53:15.375294 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.376307 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.377965 2802 raft_consensus.cc:515] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.377434 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
W20260503 07:53:15.379086 986 leader_election.cc:343] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.378449 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.379429 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.380456 1175 ts_tablet_manager.cc:1929] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:15.380564 1175 log.cc:1199] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/efbf07a603be411895839aece99fa78c
I20260503 07:53:15.380956 1175 ts_tablet_manager.cc:1950] T efbf07a603be411895839aece99fa78c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.381698 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1016) took 6185 ms. Trace:
I20260503 07:53:15.381784 1175 rpcz_store.cc:276] 0503 07:53:09.196564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.196807 (+ 243us) service_pool.cc:224] Handling call
0503 07:53:15.169111 (+5972304us) ts_tablet_manager.cc:1151] Deleting tablet efbf07a603be411895839aece99fa78c
0503 07:53:15.169120 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.211524 (+ 42404us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.380400 (+168876us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.381680 (+ 1280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29661,"tablet-delete.queue_time_us":5972054}
I20260503 07:53:15.382160 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1017) took 6151 ms. Trace:
I20260503 07:53:15.382234 1175 rpcz_store.cc:276] 0503 07:53:09.230772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.232220 (+ 1448us) service_pool.cc:224] Handling call
0503 07:53:15.382052 (+6149832us) ts_tablet_manager.cc:1151] Deleting tablet 91b9a724c6354a9eb17cc024c8f84669
0503 07:53:15.382062 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.382146 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6149647}
I20260503 07:53:15.382529 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1019) took 6035 ms. Trace:
I20260503 07:53:15.382596 1175 rpcz_store.cc:276] 0503 07:53:09.347229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.347281 (+ 52us) service_pool.cc:224] Handling call
0503 07:53:15.382444 (+6035163us) ts_tablet_manager.cc:1151] Deleting tablet fe059e59c2b24ead87ef36e5b7cac5bf
0503 07:53:15.382452 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.382515 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6034991}
I20260503 07:53:15.382864 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1023) took 5900 ms. Trace:
I20260503 07:53:15.382934 1175 rpcz_store.cc:276] 0503 07:53:09.482121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.482179 (+ 58us) service_pool.cc:224] Handling call
0503 07:53:15.382781 (+5900602us) ts_tablet_manager.cc:1151] Deleting tablet f2de368e66424e4d9edf7c840ac8071e
0503 07:53:15.382788 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.382848 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5900424}
I20260503 07:53:15.383164 1175 tablet_replica.cc:333] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.383353 1175 raft_consensus.cc:2243] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.383500 1175 raft_consensus.cc:2272] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.383977 1175 ts_tablet_manager.cc:1916] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.385490 875 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 181) took 4100 ms. Trace:
W20260503 07:53:15.385843 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 58806.5us
W20260503 07:53:15.386132 988 leader_election.cc:343] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.386341 988 leader_election.cc:304] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.386595 2862 raft_consensus.cc:2749] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:15.387280 986 leader_election.cc:343] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.387562 1171 tablet_bootstrap.cc:654] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.388772 1165 tablet_bootstrap.cc:492] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.388756 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]) successfully deleted
I20260503 07:53:15.340250 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 944) took 6307 ms. Trace:
I20260503 07:53:15.389324 1174 rpcz_store.cc:276] 0503 07:53:09.033031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.051831 (+ 18800us) service_pool.cc:224] Handling call
0503 07:53:15.053458 (+6001627us) ts_tablet_manager.cc:1151] Deleting tablet 773fca453dac452abc723e49b70111b9
0503 07:53:15.053467 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.157136 (+103669us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.159776 (+ 2640us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.340221 (+180445us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6000366}
W20260503 07:53:15.390110 988 consensus_peers.cc:597] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:15.390321 988 leader_election.cc:343] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.390699 2862 raft_consensus.cc:2749] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.390862 1165 tablet_bootstrap.cc:654] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.395859 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_06bbe98616f24b8ba5461549c8af26d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.396459 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06bbe98616f24b8ba5461549c8af26d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:15.397292 986 leader_election.cc:343] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.397590 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f51cbfb98b0c49c5a7b4c1d93174b7f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.398072 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f51cbfb98b0c49c5a7b4c1d93174b7f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.398013 1174 tablet_replica.cc:333] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:15.398313 1174 raft_consensus.cc:2243] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.398487 1174 raft_consensus.cc:2272] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.399036 1174 ts_tablet_manager.cc:1916] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.399123 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_af7472be34b44089a4f151c3a1324479" } new_table_name: "default.Table_86a6421c8e9145449dc4483b0fd936b3" modify_external_catalogs: true
I20260503 07:53:15.400221 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ef8abe51f2574f0fb195e588e808102e" } new_table_name: "default.Table_11c94f42fdb74455a513cdd269339d90" modify_external_catalogs: true
I20260503 07:53:15.402041 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bf0c0baea6dc4c2c8012c0138ef29207" } modify_external_catalogs: true
I20260503 07:53:15.402192 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bf0c0baea6dc4c2c8012c0138ef29207" } modify_external_catalogs: true
I20260503 07:53:15.403326 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cb525444d6554724a8ff74e0892ddb33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.403471 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_37f7ff2ff96a48d8a1786b2a10ac567b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.403754 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb525444d6554724a8ff74e0892ddb33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:15.403887 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37f7ff2ff96a48d8a1786b2a10ac567b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.405421 2740 consensus_queue.cc:1048] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:15.409998 2802 leader_election.cc:290] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:15.410439 986 leader_election.cc:343] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:15.410744 988 leader_election.cc:343] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.411056 988 leader_election.cc:304] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.411327 2862 raft_consensus.cc:2749] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:15.416790 986 consensus_peers.cc:597] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdd151f5e0d54bdab58423c24186b38d. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:15.418797 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a08da2052f5482792c8b3294e9b7332 consensus state has no leader
I20260503 07:53:15.425698 1165 tablet_bootstrap.cc:492] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.425848 1165 ts_tablet_manager.cc:1403] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.004s
W20260503 07:53:15.426296 986 consensus_peers.cc:597] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:15.426575 1165 raft_consensus.cc:359] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.426764 1165 raft_consensus.cc:385] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.426826 1165 raft_consensus.cc:740] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
W20260503 07:53:15.427325 988 leader_election.cc:343] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.427618 988 leader_election.cc:304] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.428274 2740 raft_consensus.cc:2749] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.429332 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 407a28fbbb9b4678986fdaf761f95271
W20260503 07:53:15.429454 988 leader_election.cc:343] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.429564 988 leader_election.cc:304] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.429795 2740 raft_consensus.cc:2749] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:15.430198 988 leader_election.cc:343] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.430388 988 leader_election.cc:304] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:15.430596 2816 raft_consensus.cc:2749] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:15.431423 1165 consensus_queue.cc:260] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.431916 1165 ts_tablet_manager.cc:1434] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:53:15.432191 1165 tablet_bootstrap.cc:492] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
W20260503 07:53:15.435113 986 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.436015 1175 ts_tablet_manager.cc:1929] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:15.436112 1175 log.cc:1199] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c7a7ad2250a3414aa5167d54c2c90941
I20260503 07:53:15.436436 1175 ts_tablet_manager.cc:1950] T c7a7ad2250a3414aa5167d54c2c90941 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.437157 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1025) took 5933 ms. Trace:
I20260503 07:53:15.437250 1175 rpcz_store.cc:276] 0503 07:53:09.503650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.504140 (+ 490us) service_pool.cc:224] Handling call
0503 07:53:15.383125 (+5878985us) ts_tablet_manager.cc:1151] Deleting tablet c7a7ad2250a3414aa5167d54c2c90941
0503 07:53:15.383134 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.405790 (+ 22656us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.435959 (+ 30169us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.437138 (+ 1179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5878781}
I20260503 07:53:15.437551 1175 tablet_replica.cc:333] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.437757 1175 raft_consensus.cc:2243] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.438014 1175 raft_consensus.cc:2272] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.440449 1165 tablet_bootstrap.cc:654] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.444981 741 tablet_service.cc:1511] Processing CreateTablet for tablet d23ff7d87cdf49d5b3c5f367f80d1fff (DEFAULT_TABLE table=default.Table_7e8b1843f23145218ea02f3f48c49572 [id=89cfc291dc4144e4b521be1dd87797a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.445384 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ff7d87cdf49d5b3c5f367f80d1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.447551 593 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:15.449023 1175 ts_tablet_manager.cc:1916] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.454411 1165 tablet_bootstrap.cc:492] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.454533 1165 ts_tablet_manager.cc:1403] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260503 07:53:15.454617 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_51d7f64d591047159048f9395ddbf407" } new_table_name: "default.Table_f89fa20db6e543d1a83c7a8454c9a9da" modify_external_catalogs: true
I20260503 07:53:15.454731 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d35fc80f52954a3b9f7308f0889787cc" } new_table_name: "default.Table_f534d318d604491e9651d2ea8e45eb5d" modify_external_catalogs: true
I20260503 07:53:15.455204 1165 raft_consensus.cc:359] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.455367 1165 raft_consensus.cc:385] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.455335 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_00a265bded494e629c023c1199bdb23a" } modify_external_catalogs: true
I20260503 07:53:15.455423 1165 raft_consensus.cc:740] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.454620 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4248601c3f624bd8ba822648871feb03" } modify_external_catalogs: true
I20260503 07:53:15.455554 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2f948e5d45d347e09ea73c5a52233858 (DEFAULT_TABLE table=default.Table_449c7851c1704ea496ea74632c7ea2da [id=927f1d8020484f559b895c677916204f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.455607 1165 consensus_queue.cc:260] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.455862 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f948e5d45d347e09ea73c5a52233858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.456446 1171 tablet_bootstrap.cc:492] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.456547 1171 ts_tablet_manager.cc:1403] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.119s user 0.006s sys 0.008s
I20260503 07:53:15.457209 1171 raft_consensus.cc:359] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.457386 1171 raft_consensus.cc:385] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.457435 1171 raft_consensus.cc:740] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.457629 1171 consensus_queue.cc:260] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.471952 741 tablet_service.cc:1511] Processing CreateTablet for tablet e7faa40fdb9e4560a7b0759d774e8a9d (DEFAULT_TABLE table=default.Table_b11f056d948f43f5a39c9b846137d9c8 [id=3e6fa244b6204b52bb38c756b3c9ccdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.472369 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7faa40fdb9e4560a7b0759d774e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.476713 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_0eeec067673744d58cdb5243c65ca773" } new_table_name: "default.Table_f611e0ac9cce4156a93b23635ac5dcc2" modify_external_catalogs: true
I20260503 07:53:15.476835 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4248601c3f624bd8ba822648871feb03" } modify_external_catalogs: true
I20260503 07:53:15.477870 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3856e2648e8b44cfbf93659c8e183931"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.478318 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3856e2648e8b44cfbf93659c8e183931 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.479113 1165 ts_tablet_manager.cc:1434] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260503 07:53:15.479202 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_06fe37512806434ea9e275527368268d" } modify_external_catalogs: true
I20260503 07:53:15.479377 1165 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.479369 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_06fe37512806434ea9e275527368268d" } modify_external_catalogs: true
I20260503 07:53:15.480410 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6b85f9b0c8a34996b7dde81cda8493bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.480607 1165 tablet_bootstrap.cc:654] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:15.480790 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b85f9b0c8a34996b7dde81cda8493bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.481032 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_00a265bded494e629c023c1199bdb23a" } modify_external_catalogs: true
I20260503 07:53:15.458179 1171 ts_tablet_manager.cc:1434] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:15.481316 1174 ts_tablet_manager.cc:1929] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:15.481406 1174 log.cc:1199] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/56749914e1a349f0876f52157affdf69
I20260503 07:53:15.481683 1174 ts_tablet_manager.cc:1950] T 56749914e1a349f0876f52157affdf69 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:15.485751 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d632b4e26a645269d8c554f5dd9f8ab" } modify_external_catalogs: true
I20260503 07:53:15.485879 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d632b4e26a645269d8c554f5dd9f8ab" } modify_external_catalogs: true
I20260503 07:53:15.490893 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c7263a5d258e4f8ab413a1619ac611f0
W20260503 07:53:15.491724 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af2210af3e8b41c283da360610c5e805 consensus state has no leader
W20260503 07:53:15.492058 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae9d435a9c5b4fa786faa765a1cf541c consensus state has no leader
I20260503 07:53:15.502068 1171 tablet_bootstrap.cc:492] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:15.505635 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5aeae993f8894649ac780f266b3b4968 consensus state has no leader
I20260503 07:53:15.505966 1175 ts_tablet_manager.cc:1929] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.506068 1175 log.cc:1199] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:53:15.506412 1175 ts_tablet_manager.cc:1950] T 5eb48844c2a04b5e8b6f73b9986127ee P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.508673 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 7439917c2a764658bfa8bf62ba67e34f
I20260503 07:53:15.513080 1171 tablet_bootstrap.cc:654] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.514514 1165 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.514693 1165 ts_tablet_manager.cc:1403] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260503 07:53:15.524494 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8a1f239e33bc42beb9dad004d5b20c89
I20260503 07:53:15.528723 2708 raft_consensus.cc:493] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.528865 2708 raft_consensus.cc:515] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.529433 2708 leader_election.cc:290] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:15.530329 1165 raft_consensus.cc:359] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.530557 1165 raft_consensus.cc:385] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.530649 1165 raft_consensus.cc:740] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.530855 1165 consensus_queue.cc:260] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.531473 1165 ts_tablet_manager.cc:1434] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260503 07:53:15.531759 1165 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.533775 1165 tablet_bootstrap.cc:654] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.535418 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9158409f18204903b0a2203e6bb8b924
I20260503 07:53:15.535838 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1029) took 5405 ms. Trace:
I20260503 07:53:15.535957 1175 rpcz_store.cc:276] 0503 07:53:10.130640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.130902 (+ 262us) service_pool.cc:224] Handling call
0503 07:53:15.437510 (+5306608us) ts_tablet_manager.cc:1151] Deleting tablet 5eb48844c2a04b5e8b6f73b9986127ee
0503 07:53:15.437519 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.452003 (+ 14484us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.505916 (+ 53913us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.535814 (+ 29898us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5306398}
I20260503 07:53:15.536386 1175 tablet_replica.cc:333] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.536960 1175 raft_consensus.cc:2243] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.536936 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:15.537139 1051 raft_consensus.cc:2468] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:15.537647 1175 raft_consensus.cc:2272] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.538177 1175 ts_tablet_manager.cc:1916] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.544353 716 leader_election.cc:304] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.544646 2708 raft_consensus.cc:2804] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.544740 2708 raft_consensus.cc:493] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.544801 2708 raft_consensus.cc:3060] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.547333 2708 raft_consensus.cc:515] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.547888 2708 leader_election.cc:290] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:15.548354 2740 raft_consensus.cc:493] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.550309 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:15.550276 2740 raft_consensus.cc:515] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.550447 1051 raft_consensus.cc:3060] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.550833 2740 leader_election.cc:290] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.553382 1051 raft_consensus.cc:2468] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:15.553740 716 leader_election.cc:304] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.554055 2708 raft_consensus.cc:2804] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:15.554574 2708 raft_consensus.cc:697] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:15.554885 2708 consensus_queue.cc:237] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.565625 1171 tablet_bootstrap.cc:492] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.565835 1171 ts_tablet_manager.cc:1403] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.001s
I20260503 07:53:15.566799 1171 raft_consensus.cc:359] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.567040 1171 raft_consensus.cc:385] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.567143 1171 raft_consensus.cc:740] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.567436 1171 consensus_queue.cc:260] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.568132 1171 ts_tablet_manager.cc:1434] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:15.568483 1171 tablet_bootstrap.cc:492] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.570259 1171 tablet_bootstrap.cc:654] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.584630 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.584858 754 tablet_service.cc:1511] Processing CreateTablet for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8 (DEFAULT_TABLE table=default.Table_5eb646eacf084a7dbebf001fe2b34e7d [id=73cf4cb30108407ca87e9fa87f9df305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.585268 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.591496 754 tablet_service.cc:1511] Processing CreateTablet for tablet 637af4aa4d0543b1b179cd3a8fdeadca (DEFAULT_TABLE table=default.Table_6704a05ca52c4a8cad6e31d38118f26e [id=bb010ee38e4e4867ac507829a67b57e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.592059 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7fad6661384f2b9a125c1bc7b8345a (DEFAULT_TABLE table=default.Table_e683012f1fc047c3a80ec030733ee2b8 [id=a41c0f5b959049e6a6de8d4c0afe162d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.592144 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 946) took 6418 ms. Trace:
I20260503 07:53:15.591645 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 79a662b661114ea4bd986f985a13092d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.592388 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7fad6661384f2b9a125c1bc7b8345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.592541 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637af4aa4d0543b1b179cd3a8fdeadca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.596403 753 tablet_service.cc:1511] Processing CreateTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 (DEFAULT_TABLE table=default.Table_1fa913322e01470c9941e894f6a75e75 [id=b77b1075bad04704827e76cf1fa8283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.596566 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_37a701dfcbd8445493c2a2886382c756"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.596679 743 tablet_service.cc:1558] Processing DeleteTablet for tablet aaef17b7249e4f208b672fde4a284590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.596724 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79225c2dd80e41bf93ad2fa023b2a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.596531 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f001df33442b490ea5a1b97fbca5f4f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.596987 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f001df33442b490ea5a1b97fbca5f4f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.597333 743 tablet_service.cc:1511] Processing CreateTablet for tablet 2df37ced81264092a170c9b9548f01d7 (DEFAULT_TABLE table=default.Table_259899fd21c4432baa40574f11e4e9f0 [id=c5711e571aa2409b87e50e6c5f0757bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.597584 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df37ced81264092a170c9b9548f01d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.598261 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_578fbd130e20482fa133085f79be8f91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.598534 1171 tablet_bootstrap.cc:492] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
W20260503 07:53:15.598618 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_578fbd130e20482fa133085f79be8f91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.598646 1171 ts_tablet_manager.cc:1403] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260503 07:53:15.599352 1171 raft_consensus.cc:359] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.599509 1171 raft_consensus.cc:385] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.599563 1171 raft_consensus.cc:740] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.599534 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6787181f2fc0489d974cbf840a50adbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.599720 1171 consensus_queue.cc:260] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:15.599892 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6787181f2fc0489d974cbf840a50adbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.600303 1171 ts_tablet_manager.cc:1434] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:15.600564 1171 tablet_bootstrap.cc:492] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.602108 1171 tablet_bootstrap.cc:654] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.605340 743 tablet_service.cc:1511] Processing CreateTablet for tablet f3bdb03e1eea408e983cbf86f9faf007 (DEFAULT_TABLE table=default.Table_f3377c51ac0546ada5f045f337b91110 [id=3bd3dcdf2f5a49e29987e03cff0894d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:15.596989 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37a701dfcbd8445493c2a2886382c756 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.606593 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bdb03e1eea408e983cbf86f9faf007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.616073 1165 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.616227 1165 ts_tablet_manager.cc:1403] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.001s
I20260503 07:53:15.616890 1165 raft_consensus.cc:359] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.616884 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3561bb0d844c4640b2e28ee803269589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.617043 1165 raft_consensus.cc:385] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.617010 747 tablet_service.cc:1511] Processing CreateTablet for tablet f6227c81b5c54e579d31a966a0e2e531 (DEFAULT_TABLE table=default.Table_4298b47c6c014712adbd5a05a9920de6 [id=21a8a72a90464c2cb20f8b1a70b97c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.617144 1165 raft_consensus.cc:740] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.617010 756 tablet_service.cc:1511] Processing CreateTablet for tablet 0911e2364ebf4e25bcc3f7420be042bd (DEFAULT_TABLE table=default.Table_9a741073f462488bb9bd48619d464c15 [id=3b67a9092dee4a7195b3ff6160fa176e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:15.617347 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3561bb0d844c4640b2e28ee803269589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.617370 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6227c81b5c54e579d31a966a0e2e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.617326 1165 consensus_queue.cc:260] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.617843 1165 ts_tablet_manager.cc:1434] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:15.618098 1165 tablet_bootstrap.cc:492] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.619336 1165 tablet_bootstrap.cc:654] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.619933 1175 ts_tablet_manager.cc:1929] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.620092 1175 log.cc:1199] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/aef746161e6b446ab0d299d37e2151ea
I20260503 07:53:15.620481 1175 ts_tablet_manager.cc:1950] T aef746161e6b446ab0d299d37e2151ea P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.621191 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1030) took 5490 ms. Trace:
I20260503 07:53:15.621272 1175 rpcz_store.cc:276] 0503 07:53:10.130734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.131147 (+ 413us) service_pool.cc:224] Handling call
0503 07:53:15.536341 (+5405194us) ts_tablet_manager.cc:1151] Deleting tablet aef746161e6b446ab0d299d37e2151ea
0503 07:53:15.536352 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.593451 (+ 57099us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.596119 (+ 2668us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.621172 (+ 25053us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5405006}
I20260503 07:53:15.621661 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1034) took 5459 ms. Trace:
I20260503 07:53:15.621735 1175 rpcz_store.cc:276] 0503 07:53:10.162150 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.162194 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:15.621548 (+5459354us) ts_tablet_manager.cc:1151] Deleting tablet 2beb13a5d2844d44a3146d7937c8e964
0503 07:53:15.621556 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.621647 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5459170}
I20260503 07:53:15.622004 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1036) took 5450 ms. Trace:
I20260503 07:53:15.622058 1175 rpcz_store.cc:276] 0503 07:53:10.171054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.171945 (+ 891us) service_pool.cc:224] Handling call
0503 07:53:15.621922 (+5449977us) ts_tablet_manager.cc:1151] Deleting tablet 0f707cb0257c4d6182ec331a235ba06c
0503 07:53:15.621930 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.621992 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5449696}
I20260503 07:53:15.622273 1175 tablet_replica.cc:333] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.622465 1175 raft_consensus.cc:2243] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.622663 1175 pending_rounds.cc:70] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Trying to abort 1 pending ops.
I20260503 07:53:15.622702 1175 pending_rounds.cc:77] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847481233362944 op_type: NO_OP noop_request { }
I20260503 07:53:15.622799 1175 raft_consensus.cc:2889] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:15.622869 1175 raft_consensus.cc:2272] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.629160 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b34288d750064c589c90e0a4349492e6" } new_table_name: "default.Table_90fc77cec9e54900bdc08ad35fd3e281" modify_external_catalogs: true
I20260503 07:53:15.629271 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b5eef1ddf8be416fbf3acc015a033854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:15.629405 748 tablet_service.cc:1511] Processing CreateTablet for tablet 157f7f12772b4c7189963535a8b86ab8 (DEFAULT_TABLE table=default.Table_3d3a13b279f8478599baeb7f7f4648df [id=60f43ca9dcf44d24b1e23889b47d5a53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:15.629762 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5eef1ddf8be416fbf3acc015a033854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.629810 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9f008243dbcc4893a915b079e1ee9805 (DEFAULT_TABLE table=default.Table_b4ac4f2792ca45aa8fbeb9453bd07d88 [id=94515cdcae5c42a9a3d27b1ac420b4ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.630249 757 tablet_service.cc:1511] Processing CreateTablet for tablet 85ce02a2b5984765bbb292b0c3ce8c8a (DEFAULT_TABLE table=default.Table_3688b03b7ca446e8b2d00614a7863d90 [id=63797f54c98a41a2b16de0599719b2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.630362 594 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_032933754e71413aa0bd9a712e7bcc1b" } new_table_name: "default.Table_2a653430872c4b25aae894ba8d1f426d" modify_external_catalogs: true
I20260503 07:53:15.630782 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911e2364ebf4e25bcc3f7420be042bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.630867 747 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5d03e9f4504a8987128b93d3f296a2 (DEFAULT_TABLE table=default.Table_2509bf88cbff482784e5dae08dde4f3b [id=9b539815642048ebb258668277476738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.631325 1175 ts_tablet_manager.cc:1916] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.631878 741 tablet_service.cc:1511] Processing CreateTablet for tablet ee495f04cf0d49158ccf2358dcc9fad8 (DEFAULT_TABLE table=default.Table_3d890f77dcdf464bba74b7797fb86d79 [id=2f1f230fc0c84406be848d39ebe3216d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.632431 750 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed9c2b2604242008415d636a4c273b9 (DEFAULT_TABLE table=default.Table_e753e8572bf746c580f2331da7b73034 [id=8d8f16d90318418aa817026b0f06c3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.633206 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f4e04b692cd401c8f8248d2b54732e3" } modify_external_catalogs: true
I20260503 07:53:15.633296 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aa3759511d942bfbc6e50ea2e2f2777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.633368 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7f4e04b692cd401c8f8248d2b54732e3" } modify_external_catalogs: true
I20260503 07:53:15.633638 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f7f12772b4c7189963535a8b86ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.633728 752 tablet_service.cc:1558] Processing DeleteTablet for tablet baa7721278d14e71aeba005d2bd40ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.634092 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.634670 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed9c2b2604242008415d636a4c273b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.634610 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c876deb5a4444105bbfcbab543509877"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.635066 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c876deb5a4444105bbfcbab543509877 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.636376 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ce02a2b5984765bbb292b0c3ce8c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.636432 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_417934ccc822402683f4260861be498c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.636833 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_417934ccc822402683f4260861be498c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.640249 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f008243dbcc4893a915b079e1ee9805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.643596 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5d03e9f4504a8987128b93d3f296a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.645637 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee495f04cf0d49158ccf2358dcc9fad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.650345 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.654222 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.640159 1175 ts_tablet_manager.cc:1929] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.654681 1175 log.cc:1199] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/57261ae6531348d7bdd8deb5dfd980b4
I20260503 07:53:15.654803 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc (DEFAULT_TABLE table=default.Table_cc6e51bc0e8043b39f23a978249b8355 [id=48be3ff429864fee8984c171f6add3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.655056 1175 ts_tablet_manager.cc:1950] T 57261ae6531348d7bdd8deb5dfd980b4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.655159 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c56e8742f614c4a89c913a415cbb1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.655826 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1043) took 5253 ms. Trace:
I20260503 07:53:15.655901 1175 rpcz_store.cc:276] 0503 07:53:10.402696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.403744 (+ 1048us) service_pool.cc:224] Handling call
0503 07:53:15.622238 (+5218494us) ts_tablet_manager.cc:1151] Deleting tablet 57261ae6531348d7bdd8deb5dfd980b4
0503 07:53:15.622245 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.637387 (+ 15142us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.640104 (+ 2717us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.655807 (+ 15703us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5218259}
W20260503 07:53:15.658560 594 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1dc9ff7cf2494634886cdc8543a915c7 consensus state has no leader
W20260503 07:53:15.659369 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62ecf23448b141ab9962173294d0a6c3 consensus state has no leader
I20260503 07:53:15.648835 2802 raft_consensus.cc:493] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.661486 2802 raft_consensus.cc:515] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.662325 2802 leader_election.cc:290] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.663242 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1044) took 5260 ms. Trace:
I20260503 07:53:15.663352 1175 rpcz_store.cc:276] 0503 07:53:10.402814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.404043 (+ 1229us) service_pool.cc:224] Handling call
0503 07:53:15.663119 (+5259076us) ts_tablet_manager.cc:1151] Deleting tablet b38735fd577548b192131a769daa1d78
0503 07:53:15.663131 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.663225 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5258941}
I20260503 07:53:15.663705 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1045) took 5245 ms. Trace:
I20260503 07:53:15.416589 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.663790 1175 rpcz_store.cc:276] 0503 07:53:10.418676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.418732 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:15.663600 (+5244868us) ts_tablet_manager.cc:1151] Deleting tablet 8dbca27f54064345b374b0cea96ca1c4
0503 07:53:15.663609 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.663690 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5244680}
I20260503 07:53:15.664067 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1046) took 5170 ms. Trace:
I20260503 07:53:15.664230 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.665124 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 07f79085c25d43e58f221af146d252cf
I20260503 07:53:15.665371 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.664129 1175 rpcz_store.cc:276] 0503 07:53:10.493835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.493890 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:15.663975 (+5170085us) ts_tablet_manager.cc:1151] Deleting tablet c5a592a14c3e4659ba81754cbe62c438
0503 07:53:15.663983 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.664052 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5169840}
I20260503 07:53:15.666656 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1048) took 5093 ms. Trace:
I20260503 07:53:15.666728 1175 rpcz_store.cc:276] 0503 07:53:10.573052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.573096 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:15.666570 (+5093474us) ts_tablet_manager.cc:1151] Deleting tablet 6720679e01e44baaa1501c8dbadba08a
0503 07:53:15.666577 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.666641 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5093279}
I20260503 07:53:15.666975 1175 tablet_replica.cc:333] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.667145 1175 raft_consensus.cc:2243] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.666455 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.667410 1175 raft_consensus.cc:2272] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.428462 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1156) took 1146 ms. Trace:
I20260503 07:53:15.667685 884 rpcz_store.cc:276] 0503 07:53:14.281933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.372499 (+1090566us) service_pool.cc:224] Handling call
0503 07:53:15.372872 (+ 373us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.372891 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.398072 (+ 25181us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.428264 (+ 30192us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.428442 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.667948 1175 ts_tablet_manager.cc:1916] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:15.669430 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 239216us
I20260503 07:53:15.674628 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.674654 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]) successfully deleted
W20260503 07:53:15.674892 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc already in progress: creating tablet
W20260503 07:53:15.675279 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet baf176bdc6d54088846ee5eaf5e61447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baf176bdc6d54088846ee5eaf5e61447 already in progress: creating tablet
I20260503 07:53:15.676466 884 tablet_service.cc:1511] Processing CreateTablet for tablet f8d3ed6f8cec419b9f581435941e6120 (DEFAULT_TABLE table=default.Table_8ad6cc39d6d049649adff267c37d808f [id=6b03c4e54a0e42b3b3395adfb0472c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.677945 906 raft_consensus.cc:1240] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Rejecting Update request from peer 0c11eb9ffa7845269a6a8000e8ff248f for earlier term 1. Current term is 2. Ops: []
I20260503 07:53:15.667501 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
I20260503 07:53:15.678996 2644 fs_manager.cc:714] Time spent opening directory manager: real 0.471s user 0.084s sys 0.134s
I20260503 07:53:15.679500 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1228)
I20260503 07:53:15.681515 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1228)
I20260503 07:53:15.592259 1174 rpcz_store.cc:276] 0503 07:53:09.173400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.176320 (+ 2920us) service_pool.cc:224] Handling call
0503 07:53:15.389734 (+6213414us) ts_tablet_manager.cc:1151] Deleting tablet 56749914e1a349f0876f52157affdf69
0503 07:53:15.397943 (+ 8209us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.478751 (+ 80808us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.481263 (+ 2512us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.592129 (+110866us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109767,"tablet-delete.queue_time_us":6213220}
I20260503 07:53:15.685974 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 945) took 6513 ms. Trace:
I20260503 07:53:15.434599 878 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 183) took 3878 ms. Trace:
I20260503 07:53:15.485203 1166 tablet_bootstrap.cc:492] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:15.686769 1166 ts_tablet_manager.cc:1403] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 1.990s user 0.018s sys 0.024s
I20260503 07:53:15.687565 1166 raft_consensus.cc:359] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.687769 1166 raft_consensus.cc:385] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.687871 1166 raft_consensus.cc:740] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.688110 1166 consensus_queue.cc:260] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.489219 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1122) took 2339 ms. Trace:
I20260503 07:53:15.489976 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1131) took 1702 ms. Trace:
I20260503 07:53:15.688503 889 rpcz_store.cc:276] 0503 07:53:13.150144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.318046 (+2167902us) service_pool.cc:224] Handling call
0503 07:53:15.318486 (+ 440us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.318512 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.321804 (+ 3292us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.489066 (+167262us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.489201 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.501773 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1155) took 1697 ms. Trace:
I20260503 07:53:15.500958 897 tablet_service.cc:1511] Processing CreateTablet for tablet 300fb1d2d29a48f98d9458c3a2dd0aff (DEFAULT_TABLE table=default.Table_2923dafec6854f58bcfd56dab4677849 [id=85d6930da22e4782b4cca110f86d2b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.688746 888 rpcz_store.cc:276] 0503 07:53:13.804269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.321347 (+1517078us) service_pool.cc:224] Handling call
0503 07:53:15.321698 (+ 351us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.321722 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.497856 (+176134us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.501639 (+ 3783us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.501757 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.502059 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1095) took 2738 ms. Trace:
I20260503 07:53:15.689064 890 rpcz_store.cc:276] 0503 07:53:12.763681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.437274 (+673593us) service_pool.cc:224] Handling call
0503 07:53:13.437726 (+ 452us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.437750 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.134142 (+1696392us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.501934 (+367792us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.502046 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.686808 1174 rpcz_store.cc:276] 0503 07:53:09.172262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.182228 (+ 9966us) service_pool.cc:224] Handling call
0503 07:53:15.685834 (+6503606us) ts_tablet_manager.cc:1151] Deleting tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc
0503 07:53:15.685845 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.685939 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6503297}
I20260503 07:53:15.503921 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ba99bde68e470b810e56dc488af990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.689632 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af91a12968604fc795239b1141f9fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.511276 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1101) took 2747 ms. Trace:
I20260503 07:53:15.689800 882 rpcz_store.cc:276] 0503 07:53:12.764102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.579225 (+815123us) service_pool.cc:224] Handling call
0503 07:53:13.619756 (+ 40531us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.619778 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.300131 (+1680353us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.511123 (+210992us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.511259 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.516522 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1120) took 2396 ms. Trace:
I20260503 07:53:15.690122 894 rpcz_store.cc:276] 0503 07:53:13.120466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.747973 (+627507us) service_pool.cc:224] Handling call
0503 07:53:13.748646 (+ 673us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.748675 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.313442 (+1564767us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.516360 (+202918us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.516505 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.690480 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300fb1d2d29a48f98d9458c3a2dd0aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.691586 1175 ts_tablet_manager.cc:1929] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.691679 1175 log.cc:1199] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/64c6dad26de642879307b7dca6ae85f5
I20260503 07:53:15.696017 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1126) took 2539 ms. Trace:
I20260503 07:53:15.697050 1165 tablet_bootstrap.cc:492] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.697165 1165 ts_tablet_manager.cc:1403] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.014s
I20260503 07:53:15.697898 1165 raft_consensus.cc:359] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.698087 1165 raft_consensus.cc:385] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.698143 1165 raft_consensus.cc:740] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.698349 1165 consensus_queue.cc:260] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.699021 1165 ts_tablet_manager.cc:1434] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:15.699546 1165 tablet_bootstrap.cc:492] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.701197 1165 tablet_bootstrap.cc:654] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.701910 1175 ts_tablet_manager.cc:1950] T 64c6dad26de642879307b7dca6ae85f5 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.509243 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1125) took 2352 ms. Trace:
I20260503 07:53:15.702661 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1049) took 5124 ms. Trace:
I20260503 07:53:15.702701 886 rpcz_store.cc:276] 0503 07:53:13.156386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.325387 (+2169001us) service_pool.cc:224] Handling call
0503 07:53:15.325739 (+ 352us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.325762 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.497846 (+172084us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.508936 (+ 11090us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.509227 (+ 291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.702742 1175 rpcz_store.cc:276] 0503 07:53:10.578009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.578059 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:15.666936 (+5088877us) ts_tablet_manager.cc:1151] Deleting tablet 64c6dad26de642879307b7dca6ae85f5
0503 07:53:15.666944 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.671539 (+ 4595us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.691537 (+ 19998us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.702639 (+ 11102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5088714}
W20260503 07:53:15.524225 2812 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.304s user 0.004s sys 0.021s
I20260503 07:53:15.703126 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1070) took 4617 ms. Trace:
I20260503 07:53:15.703188 1175 rpcz_store.cc:276] 0503 07:53:11.085377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.085482 (+ 105us) service_pool.cc:224] Handling call
0503 07:53:15.703010 (+4617528us) ts_tablet_manager.cc:1151] Deleting tablet 949c2dc3bcb144578739aec2ea066fdf
0503 07:53:15.703020 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.703112 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4617377}
I20260503 07:53:15.703469 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1073) took 4616 ms. Trace:
I20260503 07:53:15.703526 1175 rpcz_store.cc:276] 0503 07:53:11.086755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.086869 (+ 114us) service_pool.cc:224] Handling call
0503 07:53:15.703386 (+4616517us) ts_tablet_manager.cc:1151] Deleting tablet 0bffda3cc5e8484ea1666c788a11a6a3
0503 07:53:15.703394 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.703457 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4616369}
I20260503 07:53:15.703769 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1063) took 4622 ms. Trace:
I20260503 07:53:15.703820 1175 rpcz_store.cc:276] 0503 07:53:11.081408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.088112 (+ 6704us) service_pool.cc:224] Handling call
0503 07:53:15.703693 (+4615581us) ts_tablet_manager.cc:1151] Deleting tablet 2f9a23702aa5493ea8712f904af96755
0503 07:53:15.703700 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.703759 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4615438}
I20260503 07:53:15.704077 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1078) took 4597 ms. Trace:
I20260503 07:53:15.705921 1173 ts_tablet_manager.cc:1929] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:15.706036 1173 log.cc:1199] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/3650ec1de28c4f1bafd979257dd2b778
I20260503 07:53:15.706372 1173 ts_tablet_manager.cc:1950] T 3650ec1de28c4f1bafd979257dd2b778 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:15.706657 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5d55b39bcf4195a55edce71e37aa0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.704138 1175 rpcz_store.cc:276] 0503 07:53:11.106954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.213615 (+106661us) service_pool.cc:224] Handling call
0503 07:53:15.703997 (+4490382us) ts_tablet_manager.cc:1151] Deleting tablet 35ca011a011a44ad9447f2d5b19a63ba
0503 07:53:15.704004 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.704064 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4490222}
I20260503 07:53:15.707736 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1079) took 4600 ms. Trace:
I20260503 07:53:15.531980 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1148) took 1728 ms. Trace:
I20260503 07:53:15.707794 1175 rpcz_store.cc:276] 0503 07:53:11.107022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.213790 (+106768us) service_pool.cc:224] Handling call
0503 07:53:15.707651 (+4493861us) ts_tablet_manager.cc:1151] Deleting tablet 6c615cb123224ceda51d68d5980a2323
0503 07:53:15.707659 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.707723 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4493767}
I20260503 07:53:15.707846 885 rpcz_store.cc:276] 0503 07:53:13.803720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.323572 (+1519852us) service_pool.cc:224] Handling call
0503 07:53:15.323950 (+ 378us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.323970 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.529415 (+205445us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.531830 (+ 2415us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.531964 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.707978 1175 tablet_replica.cc:333] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.532186 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.708151 1175 raft_consensus.cc:2243] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.533032 876 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 180) took 4725 ms. Trace:
I20260503 07:53:15.708355 1175 raft_consensus.cc:2272] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.708434 876 rpcz_store.cc:276] 0503 07:53:10.807363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.807423 (+ 60us) service_pool.cc:224] Handling call
0503 07:53:10.975570 (+168147us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x6160001e2e54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:11.226033 (+250463us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x616000191b54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:11.365537 (+139504us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x6160001e2854. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.308119 (+942582us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x6160000a8a54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.529309 (+221190us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x6160000b5954. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:13.179586 (+650277us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x616000223954. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.532981 (+2353395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4226847616}
I20260503 07:53:15.709213 1165 tablet_bootstrap.cc:492] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.709329 1165 ts_tablet_manager.cc:1403] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260503 07:53:15.709913 1165 raft_consensus.cc:359] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.710055 1165 raft_consensus.cc:385] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.710098 1165 raft_consensus.cc:740] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.710247 1165 consensus_queue.cc:260] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.710736 1165 ts_tablet_manager.cc:1434] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260503 07:53:15.710960 1165 tablet_bootstrap.cc:492] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.712204 1165 tablet_bootstrap.cc:654] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:15.712430 715 leader_election.cc:343] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.713165 1175 ts_tablet_manager.cc:1916] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.539108 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1087) took 2954 ms. Trace:
I20260503 07:53:15.714699 898 rpcz_store.cc:276] 0503 07:53:12.584638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.294637 (+709999us) service_pool.cc:224] Handling call
0503 07:53:13.326546 (+ 31909us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:13.326569 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.482869 (+2156300us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.538916 (+ 56047us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.539091 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.715965 1174 tablet_replica.cc:333] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:15.716135 1174 raft_consensus.cc:2243] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.716334 1174 raft_consensus.cc:2272] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.716881 1174 ts_tablet_manager.cc:1916] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.716931 1171 tablet_bootstrap.cc:492] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.717041 1171 ts_tablet_manager.cc:1403] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.014s
I20260503 07:53:15.717695 1171 raft_consensus.cc:359] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.717854 1171 raft_consensus.cc:385] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.540364 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1144) took 1736 ms. Trace:
I20260503 07:53:15.717922 880 rpcz_store.cc:276] 0503 07:53:13.803461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.322381 (+1518920us) service_pool.cc:224] Handling call
0503 07:53:15.322676 (+ 295us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.322696 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.490532 (+167836us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.539862 (+ 49330us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.540347 (+ 485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.542551 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1151) took 1738 ms. Trace:
I20260503 07:53:15.718240 891 rpcz_store.cc:276] 0503 07:53:13.803935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.328309 (+1524374us) service_pool.cc:224] Handling call
0503 07:53:15.355173 (+ 26864us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.355205 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.502642 (+147437us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.542406 (+ 39764us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.542536 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.516906 879 tablet_service.cc:1558] Processing DeleteTablet for tablet fad603dd15f545a999b6e45bcc20bafc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:12 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.720738 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d3ed6f8cec419b9f581435941e6120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.544459 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1130) took 1902 ms. Trace:
I20260503 07:53:15.723513 892 rpcz_store.cc:276] 0503 07:53:13.641927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.322126 (+1680199us) service_pool.cc:224] Handling call
0503 07:53:15.322539 (+ 413us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.322561 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.535119 (+212558us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.544338 (+ 9219us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.544446 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.549319 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956600f557b84dac98be63ffe14f4e19" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:15.724360 715 leader_election.cc:343] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.727223 877 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 182) took 4379 ms. Trace:
I20260503 07:53:15.727329 877 rpcz_store.cc:276] 0503 07:53:11.347360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.347419 (+ 59us) service_pool.cc:224] Handling call
0503 07:53:11.365778 (+ 18359us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x6160001e2854. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.311163 (+945385us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x6160000a8a54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.529545 (+218382us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x6160000b5954. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.255771 (+2726226us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x616000119330. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59ff7b5fc3 00007f5a022e2cb8 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.727174 (+471403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338294528}
I20260503 07:53:15.727610 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 900) took 7427 ms. Trace:
I20260503 07:53:15.727692 1173 rpcz_store.cc:276] 0503 07:53:08.299742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.303541 (+ 3799us) service_pool.cc:224] Handling call
0503 07:53:15.254784 (+6951243us) ts_tablet_manager.cc:1151] Deleting tablet 3650ec1de28c4f1bafd979257dd2b778
0503 07:53:15.254794 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.515291 (+260497us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.705838 (+190547us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.727563 (+ 21725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6951019}
I20260503 07:53:15.730664 1173 tablet_replica.cc:333] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:15.730903 1173 raft_consensus.cc:2243] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.731122 1173 raft_consensus.cc:2272] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.731640 1173 ts_tablet_manager.cc:1916] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.547741 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1143) took 1744 ms. Trace:
I20260503 07:53:15.605888 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1166) took 1323 ms. Trace:
I20260503 07:53:15.688516 887 rpcz_store.cc:276] 0503 07:53:13.802465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.318103 (+1515638us) service_pool.cc:224] Handling call
0503 07:53:15.318836 (+ 733us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.318859 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.486210 (+167351us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.489846 (+ 3636us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.489960 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.733457 883 rpcz_store.cc:276] 0503 07:53:13.803400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.320427 (+1517027us) service_pool.cc:224] Handling call
0503 07:53:15.320791 (+ 364us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.320810 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.526363 (+205553us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.547459 (+ 21096us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.547726 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.733634 895 rpcz_store.cc:276] 0503 07:53:14.282734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.366711 (+1083977us) service_pool.cc:224] Handling call
0503 07:53:15.367108 (+ 397us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.367131 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.372079 (+ 4948us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.605394 (+233315us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.605758 (+ 364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.733927 2708 raft_consensus.cc:493] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.734064 2708 raft_consensus.cc:515] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.734678 2708 leader_election.cc:290] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:15.735270 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:15.735455 1051 raft_consensus.cc:2468] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:15.735435 595 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c0ceddd751644d20bcbda15a462d5342 (table default.Table_f753dec874b841f18bf08be5433c6402 [id=36a30c4e7a864127b873fc19a9b9cfd5]). Expected version 1 got 0
I20260503 07:53:15.735864 716 leader_election.cc:304] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.736112 2708 raft_consensus.cc:2804] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.736199 2708 raft_consensus.cc:493] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.736254 2708 raft_consensus.cc:3060] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.736735 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.738569 2708 raft_consensus.cc:515] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.738689 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:15.739055 715 leader_election.cc:343] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.739722 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:15.739053 2708 leader_election.cc:290] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:15.740269 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4fd9524157c4225885a1f1831982faa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:15.740429 1051 raft_consensus.cc:3060] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:15.740489 715 leader_election.cc:343] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:15.743494 1051 raft_consensus.cc:2468] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:15.743846 716 leader_election.cc:304] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:15.744220 2608 raft_consensus.cc:2804] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:15.744345 2608 raft_consensus.cc:697] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:15.744602 2608 consensus_queue.cc:237] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:15.747748 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1153) took 1943 ms. Trace:
I20260503 07:53:15.748289 881 rpcz_store.cc:276] 0503 07:53:13.804064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.329604 (+1525540us) service_pool.cc:224] Handling call
0503 07:53:15.503750 (+174146us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x61800000c918. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59f24fd9bd 00007f59f24fd5de 00007f5a061e149d 00007f5a061e143c 00007f5a0238c1f4 00007f5a023647ad 00007f5a022b3171 00007f59fc1426a6 00007f59fc1423d5 00007f59f950810e
0503 07:53:15.503769 (+ 19us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.503785 (+ 16us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.698876 (+195091us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.701449 (+ 2573us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.747735 (+ 46286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46148,"spinlock_wait_cycles":61376384}
I20260503 07:53:15.752031 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:15.752838 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1136) took 1944 ms. Trace:
I20260503 07:53:15.753067 1165 tablet_bootstrap.cc:492] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.753225 1165 ts_tablet_manager.cc:1403] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260503 07:53:15.753067 897 rpcz_store.cc:276] 0503 07:53:13.802844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.317439 (+1514595us) service_pool.cc:224] Handling call
0503 07:53:15.688913 (+371474us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.688935 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.693472 (+ 4537us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.696086 (+ 2614us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.747410 (+ 51324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.753909 1165 raft_consensus.cc:359] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.754107 1165 raft_consensus.cc:385] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.754172 1165 raft_consensus.cc:740] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.754387 1165 consensus_queue.cc:260] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.755119 1165 ts_tablet_manager.cc:1434] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:15.755437 1165 tablet_bootstrap.cc:492] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.756584 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:15.757045 1165 tablet_bootstrap.cc:654] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.696105 893 rpcz_store.cc:276] 0503 07:53:13.156476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.321826 (+2165350us) service_pool.cc:224] Handling call
0503 07:53:15.503590 (+181764us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x61800000c918. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59f24fd9bd 00007f59f24fd5de 00007f5a061e149d 00007f5a061e143c 00007f5a0238c1f4 00007f5a023647ad 00007f5a022b3171 00007f59fc1426a6 00007f59fc1423d5 00007f59f950810e
0503 07:53:15.503626 (+ 36us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.503651 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.693136 (+189485us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.695834 (+ 2698us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.695967 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11195264}
I20260503 07:53:15.757229 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]) successfully deleted
W20260503 07:53:15.757647 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fe059e59c2b24ead87ef36e5b7cac5bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe059e59c2b24ead87ef36e5b7cac5bf already in progress: creating tablet
W20260503 07:53:15.757944 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f2de368e66424e4d9edf7c840ac8071e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2de368e66424e4d9edf7c840ac8071e already in progress: creating tablet
I20260503 07:53:15.758101 1175 ts_tablet_manager.cc:1929] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.758224 1175 log.cc:1199] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bf51c959093d4579a5916c49e1790737
I20260503 07:53:15.758194 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:15.758589 1175 ts_tablet_manager.cc:1950] T bf51c959093d4579a5916c49e1790737 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.759393 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1106) took 4518 ms. Trace:
I20260503 07:53:15.759498 1175 rpcz_store.cc:276] 0503 07:53:11.240448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.443682 (+203234us) service_pool.cc:224] Handling call
0503 07:53:15.707944 (+4264262us) ts_tablet_manager.cc:1151] Deleting tablet bf51c959093d4579a5916c49e1790737
0503 07:53:15.707951 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.716034 (+ 8083us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.758045 (+ 42011us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.759370 (+ 1325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4264114}
I20260503 07:53:15.759809 1175 tablet_replica.cc:333] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.760020 1175 raft_consensus.cc:2243] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.760365 1175 raft_consensus.cc:2272] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.761063 1175 ts_tablet_manager.cc:1916] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.761790 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c7a7ad2250a3414aa5167d54c2c90941 (table default.Table_3c3518b900d542d0bbaa3d961fe42977 [id=fc76a5abf5674e2580813d1563626b93]) successfully deleted
I20260503 07:53:15.762701 1165 tablet_bootstrap.cc:492] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.762830 1165 ts_tablet_manager.cc:1403] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260503 07:53:15.764104 1165 raft_consensus.cc:359] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.764374 1165 raft_consensus.cc:385] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.764477 1165 raft_consensus.cc:740] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.765357 1165 consensus_queue.cc:260] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.766166 1165 ts_tablet_manager.cc:1434] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:15.766505 1165 tablet_bootstrap.cc:492] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.766386 878 rpcz_store.cc:276] 0503 07:53:11.555934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.555995 (+ 61us) service_pool.cc:224] Handling call
0503 07:53:11.679058 (+123063us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x616000191b54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.181054 (+501996us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x6160000a8a54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.545776 (+364722us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x6160000b5954. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.434566 (+2888790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215081856}
I20260503 07:53:15.767717 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.768113 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5eb48844c2a04b5e8b6f73b9986127ee (table default.Table_08ac73e23e35413686867661229a09a6 [id=287a9ed55cc547da8a91b2209e99a201]) successfully deleted
I20260503 07:53:15.768498 1165 tablet_bootstrap.cc:654] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.683511 851 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1158)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1168)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1172)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1182)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1183)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1184)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1185)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1186)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1187)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1188)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1189)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1190)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1191)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1192)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1193)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1194)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1195)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1196)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1197)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1198)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1199)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1200)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1201)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1202)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1205)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1210)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1214)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1228)
I20260503 07:53:15.771266 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 29fe06a56f70487ea7c479b107d83d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:07 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.771469 894 tablet_service.cc:1511] Processing CreateTablet for tablet f1b2ebdcdf1242adbc214ab249cf0da3 (DEFAULT_TABLE table=default.Table_82323a14647f400dbb8478aa5bf61765 [id=52ed2219a3ad4f78ba1ae3f96121d3f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.771893 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b2ebdcdf1242adbc214ab249cf0da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.771938 888 tablet_service.cc:1511] Processing CreateTablet for tablet f77380a1723b46e59b5caba110c8e91a (DEFAULT_TABLE table=default.Table_48488b7948bf4e2ea071f418c80ec3e7 [id=ac585d46c4b54de094d72dc8e4085736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.772382 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77380a1723b46e59b5caba110c8e91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.583469 874 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 179) took 4780 ms. Trace:
I20260503 07:53:15.773819 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet aef746161e6b446ab0d299d37e2151ea (table default.Table_506c091a2d2e43bd85e86b720a60cf1d [id=1d941f58388b4bb9a8c31098dd9532e2]) successfully deleted
W20260503 07:53:15.774094 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2beb13a5d2844d44a3146d7937c8e964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2beb13a5d2844d44a3146d7937c8e964 already in progress: creating tablet
W20260503 07:53:15.774299 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0f707cb0257c4d6182ec331a235ba06c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f707cb0257c4d6182ec331a235ba06c already in progress: creating tablet
I20260503 07:53:15.774477 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 57261ae6531348d7bdd8deb5dfd980b4 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
W20260503 07:53:15.774662 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b38735fd577548b192131a769daa1d78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38735fd577548b192131a769daa1d78 already in progress: creating tablet
W20260503 07:53:15.774849 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 8dbca27f54064345b374b0cea96ca1c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dbca27f54064345b374b0cea96ca1c4 already in progress: creating tablet
I20260503 07:53:15.775530 747 tablet_service.cc:1511] Processing CreateTablet for tablet 03d59ce963824b05b8f15ec3365f13ac (DEFAULT_TABLE table=default.Table_0d3f50d1b6c24d838b7bb7e6fc88e968 [id=fd866dc72a2f428a8b3bcb9871707c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.775643 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ddbc6b58548c48723c8468b3e599e (DEFAULT_TABLE table=default.Table_8e7e8c5538084100b030def99b1fb17d [id=9025f09218724f8e8b7a27b43077ecb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.775936 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d59ce963824b05b8f15ec3365f13ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.776379 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ddbc6b58548c48723c8468b3e599e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.776990 1175 ts_tablet_manager.cc:1929] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.776995 2608 consensus_queue.cc:1048] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:15.777099 1175 log.cc:1199] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/773fca453dac452abc723e49b70111b9
I20260503 07:53:15.777473 1175 ts_tablet_manager.cc:1950] T 773fca453dac452abc723e49b70111b9 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.781282 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1107) took 4540 ms. Trace:
I20260503 07:53:15.781394 1175 rpcz_store.cc:276] 0503 07:53:11.240531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.443843 (+203312us) service_pool.cc:224] Handling call
0503 07:53:15.759767 (+4315924us) ts_tablet_manager.cc:1151] Deleting tablet 773fca453dac452abc723e49b70111b9
0503 07:53:15.759776 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.772126 (+ 12350us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.776942 (+ 4816us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.781264 (+ 4322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2984,"tablet-delete.queue_time_us":4315834}
I20260503 07:53:15.781715 1175 tablet_replica.cc:333] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.781914 1175 raft_consensus.cc:2243] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:15.782059 1175 raft_consensus.cc:2272] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:15.783345 752 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0848a7dc54e42aeae2e712b7ba398 (DEFAULT_TABLE table=default.Table_71a82cc361e244948d83eb8068a52749 [id=28f23d085f204d159440115e413f23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.783739 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0848a7dc54e42aeae2e712b7ba398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.782559 1175 ts_tablet_manager.cc:1916] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:15.783368 1171 raft_consensus.cc:740] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.787038 1171 consensus_queue.cc:260] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.787618 1171 ts_tablet_manager.cc:1434] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.071s user 0.020s sys 0.004s
I20260503 07:53:15.787910 1171 tablet_bootstrap.cc:492] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.789691 1171 tablet_bootstrap.cc:654] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.792910 1165 tablet_bootstrap.cc:492] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.793027 1165 ts_tablet_manager.cc:1403] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260503 07:53:15.793587 1165 raft_consensus.cc:359] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.793738 748 tablet_service.cc:1511] Processing CreateTablet for tablet f72cfc6ddd9a48e8ba451ed54978ea25 (DEFAULT_TABLE table=default.Table_bb7ea1bef84d48a5bbf2d50ec048882d [id=a90d57f0af51434f98aa128c0757b876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.794068 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72cfc6ddd9a48e8ba451ed54978ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.793743 1165 raft_consensus.cc:385] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.795136 1165 raft_consensus.cc:740] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.795301 1175 ts_tablet_manager.cc:1929] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:15.795404 1175 log.cc:1199] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/c1c631d3da8f4ec29690c548097a454b
I20260503 07:53:15.795328 1165 consensus_queue.cc:260] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.795790 1175 ts_tablet_manager.cc:1950] T c1c631d3da8f4ec29690c548097a454b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:15.796736 1165 ts_tablet_manager.cc:1434] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260503 07:53:15.797001 1165 tablet_bootstrap.cc:492] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.797130 1171 tablet_bootstrap.cc:492] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.797441 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 26da686862f44940b13c7790e00ea3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.797859 883 tablet_service.cc:1511] Processing CreateTablet for tablet a4420cdc6cd84207b2bdd6c0a609c97d (DEFAULT_TABLE table=default.Table_b58c977f7f8c484d81e4ce565eea0688 [id=b3390aa704704a4fa51a31b3c20cecb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.798192 1165 tablet_bootstrap.cc:654] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.798276 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4420cdc6cd84207b2bdd6c0a609c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.798609 1171 ts_tablet_manager.cc:1403] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260503 07:53:15.799448 1171 raft_consensus.cc:359] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.799705 1171 raft_consensus.cc:385] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.799816 1171 raft_consensus.cc:740] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.800057 1171 consensus_queue.cc:260] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.800570 1171 ts_tablet_manager.cc:1434] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:15.801644 1165 tablet_bootstrap.cc:492] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.803287 893 tablet_service.cc:1511] Processing CreateTablet for tablet cfdeda899382495fb56a83f3787c9dc6 (DEFAULT_TABLE table=default.Table_73824774ba964016a8a3b4848d08c96e [id=fb1df883c9464f95a7306b35cff31540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.803802 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdeda899382495fb56a83f3787c9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.805254 1165 ts_tablet_manager.cc:1403] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260503 07:53:15.806191 1165 raft_consensus.cc:359] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.806457 1165 raft_consensus.cc:385] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.806577 1165 raft_consensus.cc:740] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.806877 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet baa7721278d14e71aeba005d2bd40ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.806985 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.807173 2816 raft_consensus.cc:493] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.807276 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.807296 2816 raft_consensus.cc:515] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.807221 1165 consensus_queue.cc:260] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.807552 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.807814 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.807811 2816 leader_election.cc:290] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:15.810904 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1161) took 1528 ms. Trace:
I20260503 07:53:15.811270 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc (DEFAULT_TABLE table=default.Table_cc6e51bc0e8043b39f23a978249b8355 [id=48be3ff429864fee8984c171f6add3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.811496 888 rpcz_store.cc:276] 0503 07:53:14.282400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.771747 (+1489347us) service_pool.cc:224] Handling call
0503 07:53:15.772085 (+ 338us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.772112 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.808319 (+ 36207us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.810727 (+ 2408us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.810855 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.811720 1165 ts_tablet_manager.cc:1434] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260503 07:53:15.811848 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 10a29807ce9b4ccabafeb059afb9bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:15.812067 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c5a592a14c3e4659ba81754cbe62c438 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5a592a14c3e4659ba81754cbe62c438 already in progress: creating tablet
I20260503 07:53:15.812222 895 tablet_service.cc:1511] Processing CreateTablet for tablet cb5a17d9b3c94cf0942a1f347edb0b7a (DEFAULT_TABLE table=default.Table_92bee268b15c4d1d83e558a015ad1d99 [id=585f2dc09fa94114bcd477530dbd96d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.812606 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5a17d9b3c94cf0942a1f347edb0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.814626 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1160) took 1532 ms. Trace:
I20260503 07:53:15.814761 893 rpcz_store.cc:276] 0503 07:53:14.282335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.771459 (+1489124us) service_pool.cc:224] Handling call
0503 07:53:15.803499 (+ 32040us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.803531 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.811144 (+ 7613us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.814432 (+ 3288us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.814580 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.815204 893 tablet_service.cc:1511] Processing CreateTablet for tablet 62ecf23448b141ab9962173294d0a6c3 (DEFAULT_TABLE table=default.Table_b34288d750064c589c90e0a4349492e6 [id=3c68035f4db2431aa58fd1ae361b5a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.815608 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ecf23448b141ab9962173294d0a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.820218 880 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b31b3076214d37a744faa4fa8d585b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.820403 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 994d9de9bf5b4dfa9157f84ccd59e294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.820680 879 tablet_service.cc:1511] Processing CreateTablet for tablet 0be9e41a37834a51bee50b917edc1eab (DEFAULT_TABLE table=default.Table_4fe07c3e026f429799ffee480cad8928 [id=654e62d066234ef79e753628c5aaccdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.820971 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be9e41a37834a51bee50b917edc1eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.821157 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df4fefd52434b118e1ed016d5d629bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.821558 893 tablet_service.cc:1511] Processing CreateTablet for tablet c0f80a713d1648109f12e11099ebbb5c (DEFAULT_TABLE table=default.Table_a15db5ec7f114d89bb16c146360e3b3f [id=8f81bf500536452593bff0a689868441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.821909 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f80a713d1648109f12e11099ebbb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.824388 886 tablet_service.cc:1511] Processing CreateTablet for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb (DEFAULT_TABLE table=default.Table_768f2bbd81ba4c42a44e594809b502c6 [id=cc29cdf2141e46659376053724a6ce06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.824759 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.828656 1024 tablet_service.cc:1511] Processing CreateTablet for tablet e14da422aca041ed8d180eadc3be6aab (DEFAULT_TABLE table=default.Table_7d360d20b40243669f2adb98438fb661 [id=4f78e204eeea427e81cac1976c7f314a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.828905 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2816c78c9a4faaa116e55d48408561 (DEFAULT_TABLE table=default.Table_532e0bf3bb9e41edac74e09b1744e9a0 [id=7270f14443ae4297b781533c25bb349e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.829454 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 03d59ce963824b05b8f15ec3365f13ac (DEFAULT_TABLE table=default.Table_0d3f50d1b6c24d838b7bb7e6fc88e968 [id=fd866dc72a2f428a8b3bcb9871707c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.829502 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ececa26cc216425cb6457978d35644f5 (DEFAULT_TABLE table=default.Table_3d8bfac37e6d4024ae18b044b89bff8c [id=eb164c1de9744ea1b99dcac01a4feea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.829815 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ddbc6b58548c48723c8468b3e599e (DEFAULT_TABLE table=default.Table_8e7e8c5538084100b030def99b1fb17d [id=9025f09218724f8e8b7a27b43077ecb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.829847 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 87ab024dd97c48e5a290c7fa64b4891c (DEFAULT_TABLE table=default.Table_21c7a07f359c40da89a6c8624d48ef7a [id=d93e3cb8d9024935b237fb2272e4b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.830189 1023 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0848a7dc54e42aeae2e712b7ba398 (DEFAULT_TABLE table=default.Table_71a82cc361e244948d83eb8068a52749 [id=28f23d085f204d159440115e413f23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.830302 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.830499 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f72cfc6ddd9a48e8ba451ed54978ea25 (DEFAULT_TABLE table=default.Table_bb7ea1bef84d48a5bbf2d50ec048882d [id=a90d57f0af51434f98aa128c0757b876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.830695 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e36b8bb09d5849cea5ba5b67155b590a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.831197 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 918d98225bd44da9afef237fb836b6b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.831427 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 394a15d5cd2d44f5a0ea411cef1e2b48 (DEFAULT_TABLE table=default.Table_6afc9e653bc742d0acfb720ab4f56658 [id=5f0cb5784a464cd9820c826585ed17db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.829840 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 48bf766b113a4d069131410e06c44c41 (DEFAULT_TABLE table=default.Table_918a7bdc4b7244a597fd0afb8c8a7adf [id=50f6edd713ad4513a5f79973703432fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.831682 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0adce7db64cc8a216e2dd4295a472 (DEFAULT_TABLE table=default.Table_bb75a18a02be4bab9e1e6e736d47dc76 [id=043594af9c754996b9d52757589bc90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.832134 885 tablet_service.cc:1511] Processing CreateTablet for tablet 582afcb966544e408824d08422aca361 (DEFAULT_TABLE table=default.Table_50c245acca104d69a65c531ca977cb1e [id=2b0abef9c9c74f1bbfd2194e4a82447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.832383 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9816136452d14647aeda8398eb5e6864 (DEFAULT_TABLE table=default.Table_1ab085f9bb854edaa2ebdc4cb085db34 [id=028d95c90bd74c11a0c4c1470cc4707d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.832538 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 582afcb966544e408824d08422aca361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.832633 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f95e49dfec744da94a6db8c46475302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.832988 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 378cc6d613584f308d3c0fb68b31f26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.833200 1165 tablet_bootstrap.cc:492] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.833463 1173 ts_tablet_manager.cc:1929] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:15.833557 1173 log.cc:1199] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/c9457d5693eb4f3da5501a0e581fe75c
I20260503 07:53:15.833880 1173 ts_tablet_manager.cc:1950] T c9457d5693eb4f3da5501a0e581fe75c P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:15.834014 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62 (DEFAULT_TABLE table=default.Table_3096be03a61e425a99a8086b09e4c157 [id=54f49e3f978e4ce8a0df42c79f9b2ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.834472 1165 tablet_bootstrap.cc:654] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.834472 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 481f1729dfb24abcbeb5b1e43fe8151c (DEFAULT_TABLE table=default.Table_c80939a7093c450d9c329f058eb4f6e6 [id=dfe2aabecebe40388adbbe88b6e916d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.834914 1017 tablet_service.cc:1511] Processing CreateTablet for tablet dc7c6a20531e484b997e666f47a34976 (DEFAULT_TABLE table=default.Table_3f26e2bf724b4df49cf01f05597312b2 [id=f16ff44fbafc4f6bba9d43f77eb6ee84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.835573 1018 tablet_service.cc:1511] Processing CreateTablet for tablet b7f0fbfb3737498c81739f9b99eeb69a (DEFAULT_TABLE table=default.Table_c385c133b5ff4ec7bfd4073f7e175538 [id=35c3bd87ad1c43b9a5db159f3ebd3ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.836081 1020 tablet_service.cc:1511] Processing CreateTablet for tablet a0aae05395da4c2e9b14b6d619d7453d (DEFAULT_TABLE table=default.Table_557490923aff4617bea08659402eddf8 [id=166f863b86ed40acba50a5d7eb4c404b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.836145 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2acd372a2b6943118994a3e26d4ac61e (DEFAULT_TABLE table=default.Table_8306df6ff4d74da7baa4a439498cdb5f [id=ef415e0cb4894c2faee669463f7647b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.836404 889 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef452f8361c4aedbac532c5f7669612 (DEFAULT_TABLE table=default.Table_c9c4f91172e64186b6c083959ecc2b32 [id=63099743f58a4e16b0748ada82fbfd48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.836782 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef452f8361c4aedbac532c5f7669612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.840302 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0aae05395da4c2e9b14b6d619d7453d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.832067 874 rpcz_store.cc:276] 0503 07:53:10.802659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.802715 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:10.974775 (+172060us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x6160001e2e54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:11.225214 (+250439us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x616000191b54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:11.365260 (+140046us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x6160001e2854. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.309756 (+944496us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x6160000a8a54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.583421 (+3273665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3032316288}
I20260503 07:53:15.844412 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14da422aca041ed8d180eadc3be6aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.844444 1171 tablet_bootstrap.cc:492] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.846021 1171 tablet_bootstrap.cc:654] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.847849 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4 (DEFAULT_TABLE table=default.Table_b68f6201a8c74e3db86c941d919bf8de [id=6372cd13dae84e1b812f5f6eaed249eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.848127 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.849690 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acd372a2b6943118994a3e26d4ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.851311 761 tablet_service.cc:1511] Processing CreateTablet for tablet 394a15d5cd2d44f5a0ea411cef1e2b48 (DEFAULT_TABLE table=default.Table_6afc9e653bc742d0acfb720ab4f56658 [id=5f0cb5784a464cd9820c826585ed17db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.851389 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0adce7db64cc8a216e2dd4295a472 (DEFAULT_TABLE table=default.Table_bb75a18a02be4bab9e1e6e736d47dc76 [id=043594af9c754996b9d52757589bc90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.851650 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394a15d5cd2d44f5a0ea411cef1e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.851742 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.852021 760 tablet_service.cc:1511] Processing CreateTablet for tablet dc7c6a20531e484b997e666f47a34976 (DEFAULT_TABLE table=default.Table_3f26e2bf724b4df49cf01f05597312b2 [id=f16ff44fbafc4f6bba9d43f77eb6ee84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.852301 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0adce7db64cc8a216e2dd4295a472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.852412 745 tablet_service.cc:1511] Processing CreateTablet for tablet 48bf766b113a4d069131410e06c44c41 (DEFAULT_TABLE table=default.Table_918a7bdc4b7244a597fd0afb8c8a7adf [id=50f6edd713ad4513a5f79973703432fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.852710 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62 (DEFAULT_TABLE table=default.Table_3096be03a61e425a99a8086b09e4c157 [id=54f49e3f978e4ce8a0df42c79f9b2ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.852938 758 tablet_service.cc:1511] Processing CreateTablet for tablet 9816136452d14647aeda8398eb5e6864 (DEFAULT_TABLE table=default.Table_1ab085f9bb854edaa2ebdc4cb085db34 [id=028d95c90bd74c11a0c4c1470cc4707d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.853240 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f95e49dfec744da94a6db8c46475302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.855012 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 378cc6d613584f308d3c0fb68b31f26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.855271 744 tablet_service.cc:1511] Processing CreateTablet for tablet a0aae05395da4c2e9b14b6d619d7453d (DEFAULT_TABLE table=default.Table_557490923aff4617bea08659402eddf8 [id=166f863b86ed40acba50a5d7eb4c404b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.852468 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 918d98225bd44da9afef237fb836b6b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.855867 742 tablet_service.cc:1511] Processing CreateTablet for tablet 2acd372a2b6943118994a3e26d4ac61e (DEFAULT_TABLE table=default.Table_8306df6ff4d74da7baa4a439498cdb5f [id=ef415e0cb4894c2faee669463f7647b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.856276 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ececa26cc216425cb6457978d35644f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.856383 746 tablet_service.cc:1511] Processing CreateTablet for tablet 481f1729dfb24abcbeb5b1e43fe8151c (DEFAULT_TABLE table=default.Table_c80939a7093c450d9c329f058eb4f6e6 [id=dfe2aabecebe40388adbbe88b6e916d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.858345 751 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4 (DEFAULT_TABLE table=default.Table_b68f6201a8c74e3db86c941d919bf8de [id=6372cd13dae84e1b812f5f6eaed249eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.859028 748 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.859315 748 tablet_service.cc:1511] Processing CreateTablet for tablet 2c33a99333ae495aab1fb3361b587238 (DEFAULT_TABLE table=default.Table_575d34ce55254889a874cd08afb29ac1 [id=66807add626a4ca9a214e882f8091dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.860360 755 tablet_service.cc:1511] Processing CreateTablet for tablet b7f0fbfb3737498c81739f9b99eeb69a (DEFAULT_TABLE table=default.Table_c385c133b5ff4ec7bfd4073f7e175538 [id=35c3bd87ad1c43b9a5db159f3ebd3ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.860235 595 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7820f6c21edd44faa101fe8e8594aa93" } modify_external_catalogs: true
I20260503 07:53:15.860571 595 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7820f6c21edd44faa101fe8e8594aa93" } modify_external_catalogs: true
I20260503 07:53:15.860773 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bf766b113a4d069131410e06c44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.866786 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72cfc6ddd9a48e8ba451ed54978ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.866822 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 956600f557b84dac98be63ffe14f4e19 with delete_type TABLET_DATA_DELETED (replaced by tablet 5cc695ff556240299788c02f416410c2) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.867664 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 407a28fbbb9b4678986fdaf761f95271 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.868537 1033 tablet_service.cc:1511] Processing CreateTablet for tablet aec174cc59cf401bb58460eb91eadd25 (DEFAULT_TABLE table=default.Table_692ad5dc212c48819189ebe9e823d551 [id=781f45e9cd1c41aab34b06ce645b659b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.868834 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394a15d5cd2d44f5a0ea411cef1e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.869128 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec174cc59cf401bb58460eb91eadd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.852720 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bf766b113a4d069131410e06c44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.869397 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7c6a20531e484b997e666f47a34976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.869562 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c33a99333ae495aab1fb3361b587238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.869557 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0848a7dc54e42aeae2e712b7ba398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.870582 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9816136452d14647aeda8398eb5e6864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.871562 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.872339 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.872485 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481f1729dfb24abcbeb5b1e43fe8151c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.876107 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ddbc6b58548c48723c8468b3e599e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.876402 595 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c2a8057297cc4a16813a545fc2b947d4
I20260503 07:53:15.879716 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d59ce963824b05b8f15ec3365f13ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.857897 879 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e40b7ef514f448bcf83837656149d (DEFAULT_TABLE table=default.Table_812b51710d0c47159b3d5e3a9fd3eaea [id=637b9ae06f274fb2b437106ef85bbf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.858836 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4 (DEFAULT_TABLE table=default.Table_253eaeecc7a64835a66c6d4b0d0d1265 [id=24f3b86affa94a89b6639bf1283ffbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.858886 898 tablet_service.cc:1511] Processing CreateTablet for tablet 00553b47c50d476dad6fc66517ec7597 (DEFAULT_TABLE table=default.Table_0195509e330240618611fc0d78414554 [id=d975ac2575594357849223a88417cf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.858964 882 tablet_service.cc:1511] Processing CreateTablet for tablet 587dd9dc4f46439e89f216a448118b40 (DEFAULT_TABLE table=default.Table_e53d2641455c498bb608719816f52f01 [id=3a198bbb1b4f421b83a7f0c01d3cf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.881953 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00553b47c50d476dad6fc66517ec7597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.884352 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0aae05395da4c2e9b14b6d619d7453d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.887482 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 88bde0d32a0648f885503259d5ab3d76 (DEFAULT_TABLE table=default.Table_b3e72ade570e4453a358a772d6c9717e [id=07dcc3e6cdbf4d4d97273f89827fbbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.887787 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bde0d32a0648f885503259d5ab3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.888449 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f0fbfb3737498c81739f9b99eeb69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.889945 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1164) took 1607 ms. Trace:
I20260503 07:53:15.890009 898 rpcz_store.cc:276] 0503 07:53:14.282611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.799060 (+1516449us) service_pool.cc:224] Handling call
0503 07:53:15.881726 (+ 82666us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.881766 (+ 40us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.886618 (+ 4852us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.889827 (+ 3209us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.889931 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.890400 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff73f8a6895419eb45a0a3ceee477ea (DEFAULT_TABLE table=default.Table_e71826e4a2b64189a1bb50edfa1c12ff [id=5c1a154ba31f4c56b592ad82058a764c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.890700 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff73f8a6895419eb45a0a3ceee477ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.891418 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ffacb1497a724fcaaca3aa64ec3ba612 (DEFAULT_TABLE table=default.Table_59ec796d480b44249426d1dfc637aee5 [id=25fbc7b0afff44d5a0f34eb3be1f50a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.891719 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffacb1497a724fcaaca3aa64ec3ba612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.858989 881 tablet_service.cc:1511] Processing CreateTablet for tablet 532037d672cf49afac0be969e6978589 (DEFAULT_TABLE table=default.Table_09c8eef9feea45f19f8b5829ef46557a [id=e5090a30fd5f4f7c9cab1d33f0bcb6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.892364 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acd372a2b6943118994a3e26d4ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.892449 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532037d672cf49afac0be969e6978589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.894491 743 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2816c78c9a4faaa116e55d48408561 (DEFAULT_TABLE table=default.Table_532e0bf3bb9e41edac74e09b1744e9a0 [id=7270f14443ae4297b781533c25bb349e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.894816 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2816c78c9a4faaa116e55d48408561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.858975 890 tablet_service.cc:1511] Processing CreateTablet for tablet 5c121ab35371482b9906b19508862b79 (DEFAULT_TABLE table=default.Table_c7766fda640c49a2afed2609e29794d0 [id=d39cea352e7e4a80b8f05678086f7c75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.863814 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f8d3ed6f8cec419b9f581435941e6120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.871424 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1171) took 1588 ms. Trace:
I20260503 07:53:15.896490 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c121ab35371482b9906b19508862b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.896404 885 rpcz_store.cc:276] 0503 07:53:14.283122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.799377 (+1516255us) service_pool.cc:224] Handling call
0503 07:53:15.832337 (+ 32960us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.832377 (+ 40us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.834984 (+ 2607us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.871269 (+ 36285us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.871408 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.896565 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:15.896845 885 tablet_service.cc:1511] Processing CreateTablet for tablet 4935dc4ab7b2476f8bc220c16cfdf353 (DEFAULT_TABLE table=default.Table_128e633d864f4d9bac761565fd8d18ef [id=f29177da29f341f88d4bdfa10865e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.897161 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935dc4ab7b2476f8bc220c16cfdf353. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:15.897992 988 consensus_peers.cc:597] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:15.900803 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 64c6dad26de642879307b7dca6ae85f5 (table default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]) successfully deleted
W20260503 07:53:15.901026 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 949c2dc3bcb144578739aec2ea066fdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949c2dc3bcb144578739aec2ea066fdf already in progress: creating tablet
W20260503 07:53:15.901198 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 0bffda3cc5e8484ea1666c788a11a6a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bffda3cc5e8484ea1666c788a11a6a3 already in progress: creating tablet
W20260503 07:53:15.901353 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2f9a23702aa5493ea8712f904af96755 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f9a23702aa5493ea8712f904af96755 already in progress: creating tablet
W20260503 07:53:15.901501 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 35ca011a011a44ad9447f2d5b19a63ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ca011a011a44ad9447f2d5b19a63ba already in progress: creating tablet
W20260503 07:53:15.901640 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6c615cb123224ceda51d68d5980a2323 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c615cb123224ceda51d68d5980a2323 already in progress: creating tablet
I20260503 07:53:15.901760 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bf51c959093d4579a5916c49e1790737 (table default.Table_a740af6e2f844b129450e16ac9bd0a46 [id=c3ebb0451cd043b3881233a5cc019e07]) successfully deleted
I20260503 07:53:15.901901 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 773fca453dac452abc723e49b70111b9 (table default.Table_c8d970f11c484c07994854adfe178e80 [id=1b5a88d781d14f7d9ed7d8941e1571be]) successfully deleted
I20260503 07:53:15.902257 1171 tablet_bootstrap.cc:492] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.902278 1165 tablet_bootstrap.cc:492] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:15.902387 1165 ts_tablet_manager.cc:1403] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.005s
I20260503 07:53:15.902382 1171 ts_tablet_manager.cc:1403] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.002s
I20260503 07:53:15.885255 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1165) took 1602 ms. Trace:
I20260503 07:53:15.877257 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea1e16f84064001824c3e25ca7ece28 (DEFAULT_TABLE table=default.Table_de122583f1d04569a8cd54a86be61adb [id=62a9fbe1d345474996aea52f3ba9389b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.902980 1165 raft_consensus.cc:359] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.903134 1165 raft_consensus.cc:385] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.903066 1171 raft_consensus.cc:359] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.903206 1171 raft_consensus.cc:385] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:15.903190 1165 raft_consensus.cc:740] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.903261 1171 raft_consensus.cc:740] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:15.903394 1165 consensus_queue.cc:260] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.903422 1171 consensus_queue.cc:260] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.880847 893 tablet_service.cc:1511] Processing CreateTablet for tablet c1717089130c4302b8e5456e1d23e257 (DEFAULT_TABLE table=default.Table_db2dde7023504a5884e4c6b3901587ea [id=696141a3180e435c8f263c760479f09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.881443 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1162) took 1598 ms. Trace:
I20260503 07:53:15.903868 1165 ts_tablet_manager.cc:1434] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260503 07:53:15.903873 895 rpcz_store.cc:276] 0503 07:53:14.282471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.790972 (+1508501us) service_pool.cc:224] Handling call
0503 07:53:15.812398 (+ 21426us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.812421 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.815526 (+ 3105us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.881273 (+ 65747us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.881429 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.904116 1165 tablet_bootstrap.cc:492] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:15.904506 753 tablet_service.cc:1511] Processing CreateTablet for tablet ececa26cc216425cb6457978d35644f5 (DEFAULT_TABLE table=default.Table_3d8bfac37e6d4024ae18b044b89bff8c [id=eb164c1de9744ea1b99dcac01a4feea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.904800 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ececa26cc216425cb6457978d35644f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.905362 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9816136452d14647aeda8398eb5e6864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.905540 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ab024dd97c48e5a290c7fa64b4891c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.905949 756 tablet_service.cc:1511] Processing CreateTablet for tablet e14da422aca041ed8d180eadc3be6aab (DEFAULT_TABLE table=default.Table_7d360d20b40243669f2adb98438fb661 [id=4f78e204eeea427e81cac1976c7f314a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.906483 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14da422aca041ed8d180eadc3be6aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.907004 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_54f67bdae2284d7e8da41e63d8f74ba0" } new_table_name: "default.Table_4595da5353284616ba93b971aedf4f59" modify_external_catalogs: true
I20260503 07:53:15.908347 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0adce7db64cc8a216e2dd4295a472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.908618 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_548c6c8421cb445fa919d72e2514e4e3" } new_table_name: "default.Table_919323efeab448fdb48bb6148fd36d07" modify_external_catalogs: true
I20260503 07:53:15.909750 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_5eb67445b84f47009db70743ef0767ab" } new_table_name: "default.Table_b70ef2dd4f2344d5aec48b3c2f8a2a79" modify_external_catalogs: true
I20260503 07:53:15.911020 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4fb4db2b8ace4ddda4bf4b7b2d861208"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.911604 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fb4db2b8ace4ddda4bf4b7b2d861208 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.912635 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_575d34ce55254889a874cd08afb29ac1" } modify_external_catalogs: true
I20260503 07:53:15.912768 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_575d34ce55254889a874cd08afb29ac1" } modify_external_catalogs: true
I20260503 07:53:15.914098 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.914115 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_69cd921a9fd947eeab7249ecdfb5f4cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.914539 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69cd921a9fd947eeab7249ecdfb5f4cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.915576 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f89fa20db6e543d1a83c7a8454c9a9da" } modify_external_catalogs: true
I20260503 07:53:15.915731 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f89fa20db6e543d1a83c7a8454c9a9da" } modify_external_catalogs: true
I20260503 07:53:15.916337 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aa999d66f9e14901b5b5fe467b2d501f" } modify_external_catalogs: true
I20260503 07:53:15.916484 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aa999d66f9e14901b5b5fe467b2d501f" } modify_external_catalogs: true
I20260503 07:53:15.916877 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481f1729dfb24abcbeb5b1e43fe8151c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.917193 2608 raft_consensus.cc:493] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.917315 2608 raft_consensus.cc:515] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.917551 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_99baf3ec9d5447008144100f62c5529b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:15.917968 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99baf3ec9d5447008144100f62c5529b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:15.919909 2897 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:53:15.920073 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7c6a20531e484b997e666f47a34976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.922986 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:15.923141 1050 raft_consensus.cc:2468] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:15.923465 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f0fbfb3737498c81739f9b99eeb69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.924853 716 leader_election.cc:304] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:15.925102 2708 raft_consensus.cc:2804] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:15.925159 2708 raft_consensus.cc:493] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:15.925208 2708 raft_consensus.cc:3060] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:15.926761 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2816c78c9a4faaa116e55d48408561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.927608 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 2c33a99333ae495aab1fb3361b587238 (DEFAULT_TABLE table=default.Table_575d34ce55254889a874cd08afb29ac1 [id=66807add626a4ca9a214e882f8091dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.927901 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c33a99333ae495aab1fb3361b587238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.929775 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c56e8742f614c4a89c913a415cbb1fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:15.931978 716 consensus_peers.cc:597] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1c631d3da8f4ec29690c548097a454b. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:15.932211 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e36b8bb09d5849cea5ba5b67155b590a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.933063 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1104) took 4692 ms. Trace:
I20260503 07:53:15.933145 1175 rpcz_store.cc:276] 0503 07:53:11.240277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.409081 (+168804us) service_pool.cc:224] Handling call
0503 07:53:15.781677 (+4372596us) ts_tablet_manager.cc:1151] Deleting tablet c1c631d3da8f4ec29690c548097a454b
0503 07:53:15.781686 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.792349 (+ 10663us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.795251 (+ 2902us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.933046 (+137795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968,"tablet-delete.queue_time_us":4298901}
I20260503 07:53:15.933482 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1105) took 4693 ms. Trace:
I20260503 07:53:15.933544 1175 rpcz_store.cc:276] 0503 07:53:11.240359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.412594 (+172235us) service_pool.cc:224] Handling call
0503 07:53:15.933402 (+4520808us) ts_tablet_manager.cc:1151] Deleting tablet 5deea77f36d540bb8f721657b7e3500e
0503 07:53:15.933410 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.933468 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4447607}
I20260503 07:53:15.933756 1175 tablet_replica.cc:333] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:15.933929 1175 raft_consensus.cc:2243] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:15.934648 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:15.935972 1174 ts_tablet_manager.cc:1929] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:15.936146 1174 log.cc:1199] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/efbf07a603be411895839aece99fa78c
I20260503 07:53:15.936982 1174 ts_tablet_manager.cc:1950] T efbf07a603be411895839aece99fa78c P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:15.937839 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 948) took 6742 ms. Trace:
I20260503 07:53:15.937976 1174 rpcz_store.cc:276] 0503 07:53:09.195741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.197782 (+ 2041us) service_pool.cc:224] Handling call
0503 07:53:15.715917 (+6518135us) ts_tablet_manager.cc:1151] Deleting tablet efbf07a603be411895839aece99fa78c
0503 07:53:15.715928 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.754152 (+ 38224us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.935923 (+181771us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.937821 (+ 1898us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6517821}
I20260503 07:53:15.938398 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 947) took 6745 ms. Trace:
I20260503 07:53:15.940521 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.940665 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 7439917c2a764658bfa8bf62ba67e34f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.940763 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.940853 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 9158409f18204903b0a2203e6bb8b924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.941118 1023 tablet_service.cc:1511] Processing CreateTablet for tablet d5a121de0d054f8e884045a11b9dd9af (DEFAULT_TABLE table=default.Table_37f7ff2ff96a48d8a1786b2a10ac567b [id=7f42953f01cb46f3a3aa1c6d6766ad3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.941448 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a121de0d054f8e884045a11b9dd9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.942469 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 39bd6a4378ba4949ac0c0968044bd596 (DEFAULT_TABLE table=default.Table_cb525444d6554724a8ff74e0892ddb33 [id=3dca018a8ded4e53b9941f09861a692a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.942741 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bd6a4378ba4949ac0c0968044bd596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.944773 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d9d62dfad9f0448faa5ff20d891d65db (DEFAULT_TABLE table=default.Table_f51cbfb98b0c49c5a7b4c1d93174b7f5 [id=0e63b3547291485aa86d4ba2f337be60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.945068 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d62dfad9f0448faa5ff20d891d65db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.947762 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 4424fbafc85e4f559295c2443685c390 (DEFAULT_TABLE table=default.Table_c1bede5f6a154557b54f60570220730c [id=5ad96fa208fe464686b76ffaf0a85ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.948015 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4424fbafc85e4f559295c2443685c390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.948729 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f79085c25d43e58f221af146d252cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.949076 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 34548b04a8b744a2994bc25d9f5649ed (DEFAULT_TABLE table=default.Table_06bbe98616f24b8ba5461549c8af26d4 [id=c4597d30ba234280ba534b2a02662c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.949396 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34548b04a8b744a2994bc25d9f5649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.952795 1171 ts_tablet_manager.cc:1434] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.050s user 0.002s sys 0.002s
I20260503 07:53:15.953071 1171 tablet_bootstrap.cc:492] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:15.953837 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 217c6a1dac20496e98c947c56746fe91 (DEFAULT_TABLE table=default.Table_c876deb5a4444105bbfcbab543509877 [id=e7a06a38336e41e288de8d2e3ca61cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.954528 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c2a8057297cc4a16813a545fc2b947d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:15.955317 1171 tablet_bootstrap.cc:654] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:15.956445 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217c6a1dac20496e98c947c56746fe91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.956959 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d (DEFAULT_TABLE table=default.Table_4e50c697b3d540baa679fe0efe2c6f66 [id=54910ba0f75a422398d3e582327fffc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.957535 888 tablet_service.cc:1511] Processing CreateTablet for tablet 66d715f739ae4cfe857f91a29917c438 (DEFAULT_TABLE table=default.Table_259468e6a8024773bb49c811211d3bfe [id=281e06a9808a4af589140e54c96b0f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.957885 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 17db30b1109845d783ade7c4860a3d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:15.958204 880 tablet_service.cc:1511] Processing CreateTablet for tablet 98eee8cb05dc4e0fae5385f83fb99c13 (DEFAULT_TABLE table=default.Table_62d5856bc94e4d9a89760cf91368cb1b [id=aa2d9dead47c4d7c81567d22327be700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.958880 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1121) took 2819 ms. Trace:
I20260503 07:53:15.959026 896 rpcz_store.cc:276] 0503 07:53:13.120546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.323185 (+2202639us) service_pool.cc:224] Handling call
0503 07:53:15.504408 (+181223us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x61800000c918. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59f24fd9bd 00007f59f24fd5de 00007f5a061e149d 00007f5a061e143c 00007f5a0238c1f4 00007f5a023647ad 00007f5a022b3171 00007f59fc1426a6 00007f59fc1423d5 00007f59f950810e
0503 07:53:15.504436 (+ 28us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.504456 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.709615 (+205159us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.712162 (+ 2547us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.939722 (+227560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194315,"spinlock_wait_cycles":19424128}
I20260503 07:53:15.959568 896 tablet_service.cc:1511] Processing CreateTablet for tablet e924c5f6c05d4566b6ad073bb5b5a8a1 (DEFAULT_TABLE table=default.Table_13b0c985ac174d199a61e7b3c26061c5 [id=14ebd5d2b7a94bd3888420cda1ab59dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:15.961608 2644 fs_manager.cc:730] Time spent opening block manager: real 0.281s user 0.006s sys 0.007s
I20260503 07:53:15.961831 2644 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data,/tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
uuid: "cd4eda3aaddc4d46a7e8b24b782a7e5c"
format_stamp: "Formatted at 2026-05-03 07:52:44 on dist-test-slave-xxz1"
I20260503 07:53:15.962973 2644 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:53:15.966271 2917 raft_consensus.cc:493] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:15.966476 2917 raft_consensus.cc:515] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.967226 2917 leader_election.cc:290] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:15.967814 425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 44763.7us
I20260503 07:53:15.986204 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 904) took 7584 ms. Trace:
I20260503 07:53:15.985677 1171 tablet_bootstrap.cc:492] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:15.990140 1171 ts_tablet_manager.cc:1403] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.003s
I20260503 07:53:15.987771 1173 rpcz_store.cc:276] 0503 07:53:08.400950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.402371 (+ 1421us) service_pool.cc:224] Handling call
0503 07:53:15.727937 (+7325566us) ts_tablet_manager.cc:1151] Deleting tablet c9457d5693eb4f3da5501a0e581fe75c
0503 07:53:15.730597 (+ 2660us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.813771 (+ 83174us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.833391 (+ 19620us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.985620 (+152229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7325389}
I20260503 07:53:15.993388 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1163) took 1679 ms. Trace:
I20260503 07:53:15.993508 890 rpcz_store.cc:276] 0503 07:53:14.282542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.798724 (+1516182us) service_pool.cc:224] Handling call
0503 07:53:15.896319 (+ 97595us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.896339 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.899247 (+ 2908us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.961569 (+ 62322us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.962075 (+ 506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:15.844563 875 rpcz_store.cc:276] 0503 07:53:11.285238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.285303 (+ 65us) service_pool.cc:224] Handling call
0503 07:53:11.364992 (+ 79689us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x6160001e2854. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.315982 (+950990us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x6160000a8a54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:12.686720 (+370738us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x6160001c1554. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:13.197383 (+510663us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x6160000b5954. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:15.385442 (+2188059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166887936}
I20260503 07:53:15.998402 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea1e16f84064001824c3e25ca7ece28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.000581 1171 raft_consensus.cc:359] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.002874 1171 raft_consensus.cc:385] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.003818 1171 raft_consensus.cc:740] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:16.005668 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 107536us
W20260503 07:53:16.005885 988 leader_election.cc:343] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.006011 988 leader_election.cc:304] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.006515 2916 raft_consensus.cc:2749] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:16.006619 988 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.006901 988 leader_election.cc:304] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.007406 1175 raft_consensus.cc:2272] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.007580 2917 raft_consensus.cc:2749] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:16.007728 988 leader_election.cc:343] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.007055 2916 consensus_queue.cc:1059] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260503 07:53:16.007979 988 leader_election.cc:343] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.008318 988 leader_election.cc:343] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.008913 2816 raft_consensus.cc:3055] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Stepping down as leader of term 1
W20260503 07:53:16.008970 988 leader_election.cc:343] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.009207 2816 raft_consensus.cc:740] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
W20260503 07:53:16.010249 988 leader_election.cc:343] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.010730 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet c1c631d3da8f4ec29690c548097a454b (table default.Table_82a4b1a149d1448588fbc0ce1e44754d [id=95fc3e91893c440e8498f12f6dfd56d2]) successfully deleted
I20260503 07:53:16.010082 2816 consensus_queue.cc:260] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:16.011549 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5deea77f36d540bb8f721657b7e3500e because the tablet was not found. No further retry: Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:16.015340 2816 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:53:16.017257 2915 raft_consensus.cc:493] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.017388 2915 raft_consensus.cc:515] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.017907 2915 leader_election.cc:290] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.006884 1171 consensus_queue.cc:260] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.025472 2915 raft_consensus.cc:493] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.025606 2915 raft_consensus.cc:515] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:15.917778 2608 leader_election.cc:290] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.025941 2608 raft_consensus.cc:493] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.026008 2915 leader_election.cc:290] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.026101 2608 raft_consensus.cc:515] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.026803 2608 leader_election.cc:290] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:15.952123 750 tablet_service.cc:1511] Processing CreateTablet for tablet 87ab024dd97c48e5a290c7fa64b4891c (DEFAULT_TABLE table=default.Table_21c7a07f359c40da89a6c8624d48ef7a [id=d93e3cb8d9024935b237fb2272e4b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.027709 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.027897 1051 raft_consensus.cc:2468] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.028153 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3e560a7ea14a75b6935ce7593db586 (DEFAULT_TABLE table=default.Table_37a701dfcbd8445493c2a2886382c756 [id=bdae77253b44493b86bc80e27ae72e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.028271 716 leader_election.cc:304] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.027953 1171 ts_tablet_manager.cc:1434] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.036s user 0.000s sys 0.003s
I20260503 07:53:16.028505 2608 raft_consensus.cc:2804] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.028579 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3e560a7ea14a75b6935ce7593db586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:15.956452 2908 raft_consensus.cc:493] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:16.017904 715 consensus_peers.cc:597] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:16.026373 889 rpcz_store.cc:276] 0503 07:53:14.282673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.798804 (+1516131us) service_pool.cc:224] Handling call
0503 07:53:15.836617 (+ 37813us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.836646 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.847021 (+ 10375us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.885136 (+ 38115us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.885242 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.029336 2908 raft_consensus.cc:515] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.030153 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f8052841d42838ca1df445f275d05 (DEFAULT_TABLE table=default.Table_6787181f2fc0489d974cbf840a50adbe [id=4daec9958e314f7fb789cca6f9b2a502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.030222 2908 leader_election.cc:290] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.030489 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f8052841d42838ca1df445f275d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.030572 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.030699 1051 raft_consensus.cc:2468] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.031010 716 leader_election.cc:304] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.036557 1174 rpcz_store.cc:276] 0503 07:53:09.192721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.202231 (+ 9510us) service_pool.cc:224] Handling call
0503 07:53:15.938293 (+6736062us) ts_tablet_manager.cc:1151] Deleting tablet baf176bdc6d54088846ee5eaf5e61447
0503 07:53:15.938303 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:15.938384 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6735818}
I20260503 07:53:16.041144 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ab024dd97c48e5a290c7fa64b4891c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.044217 1171 tablet_bootstrap.cc:492] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.044958 1025 tablet_service.cc:1511] Processing CreateTablet for tablet cb2f595922f64b658fbc8d4c71add546 (DEFAULT_TABLE table=default.Table_f001df33442b490ea5a1b97fbca5f4f8 [id=d5e013d9707d458bbafa78f50a155105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.045418 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 53ac8ebc0f1843b689c90f22448dd9f4 (DEFAULT_TABLE table=default.Table_578fbd130e20482fa133085f79be8f91 [id=f6bde052c50c46198161802521e04302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.045768 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f595922f64b658fbc8d4c71add546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.046068 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ac8ebc0f1843b689c90f22448dd9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.047117 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 7c98a0c2688e412b952f40cf8324ae25 (DEFAULT_TABLE table=default.Table_417934ccc822402683f4260861be498c [id=7aef35a9b8c743169a4b009dad21e60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.047451 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c98a0c2688e412b952f40cf8324ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.048781 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6d7e50111d4e7ab01a7f3149a55379 (DEFAULT_TABLE table=default.Table_b5eef1ddf8be416fbf3acc015a033854 [id=6a2ef296925944128884f4d6575949d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.049118 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6d7e50111d4e7ab01a7f3149a55379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.052412 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 939d2af7fc3c4c8495043484c7435d6b (DEFAULT_TABLE table=default.Table_3856e2648e8b44cfbf93659c8e183931 [id=ec2c1f5da0f94af583617f405c944a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.052697 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939d2af7fc3c4c8495043484c7435d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.056337 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c44b8094c42441fd8dcf10baa6ba2bd9 (DEFAULT_TABLE table=default.Table_3561bb0d844c4640b2e28ee803269589 [id=1ec18c51cb4d4a73ac960dad530bb039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.056666 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44b8094c42441fd8dcf10baa6ba2bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.046921 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 20cdab298eec48ab93f842106bfdb63a (DEFAULT_TABLE table=default.Table_6b85f9b0c8a34996b7dde81cda8493bb [id=09f81da09f2d4153bf85a42ac86cc309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.061679 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cdab298eec48ab93f842106bfdb63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.069159 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 949) took 6839 ms. Trace:
I20260503 07:53:16.069458 1174 rpcz_store.cc:276] 0503 07:53:09.229794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.233194 (+ 3400us) service_pool.cc:224] Handling call
0503 07:53:16.037373 (+6804179us) ts_tablet_manager.cc:1151] Deleting tablet 91b9a724c6354a9eb17cc024c8f84669
0503 07:53:16.043780 (+ 6407us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.069097 (+ 25317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6803894}
I20260503 07:53:16.070845 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 950) took 6724 ms. Trace:
I20260503 07:53:16.071221 1174 rpcz_store.cc:276] 0503 07:53:09.346351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.432912 (+ 86561us) service_pool.cc:224] Handling call
0503 07:53:16.070190 (+6637278us) ts_tablet_manager.cc:1151] Deleting tablet fe059e59c2b24ead87ef36e5b7cac5bf
0503 07:53:16.070317 (+ 127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.070605 (+ 288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6636889}
I20260503 07:53:16.072135 1174 tablet_replica.cc:333] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:16.074772 1171 tablet_bootstrap.cc:654] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.078370 2816 raft_consensus.cc:493] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.078902 2816 raft_consensus.cc:515] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.028570 2608 raft_consensus.cc:493] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.087251 2608 raft_consensus.cc:3060] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.097160 2912 raft_consensus.cc:2804] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.097270 2912 raft_consensus.cc:493] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.097333 2912 raft_consensus.cc:3060] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.098031 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d715f739ae4cfe857f91a29917c438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.099604 886 tablet_service.cc:1511] Processing CreateTablet for tablet f18bf0f400b142bf8d11b0ceb13a3097 (DEFAULT_TABLE table=default.Table_a3110562e44a4af585a25ffb2275d993 [id=4c78b32117f34259bcbceaffa37d617b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.099838 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1717089130c4302b8e5456e1d23e257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.100641 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1157) took 1643 ms. Trace:
I20260503 07:53:16.101501 2915 raft_consensus.cc:493] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.101678 2915 raft_consensus.cc:515] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.102473 2915 leader_election.cc:290] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.104063 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 407a28fbbb9b4678986fdaf761f95271 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.104496 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 722411278ae148d5b3d082d95683d12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.104593 742 tablet_service.cc:1511] Processing CreateTablet for tablet 88bde0d32a0648f885503259d5ab3d76 (DEFAULT_TABLE table=default.Table_b3e72ade570e4453a358a772d6c9717e [id=07dcc3e6cdbf4d4d97273f89827fbbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.104694 752 tablet_service.cc:1558] Processing DeleteTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.104988 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bde0d32a0648f885503259d5ab3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.105796 745 tablet_service.cc:1511] Processing CreateTablet for tablet ffacb1497a724fcaaca3aa64ec3ba612 (DEFAULT_TABLE table=default.Table_59ec796d480b44249426d1dfc637aee5 [id=25fbc7b0afff44d5a0f34eb3be1f50a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.106307 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18bf0f400b142bf8d11b0ceb13a3097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.106484 1175 ts_tablet_manager.cc:1916] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.108069 895 tablet_service.cc:1511] Processing CreateTablet for tablet 16bb8f0632c944c8a5cb5d7393d1cd04 (DEFAULT_TABLE table=default.Table_7b1ed7918954467387a0d2e03aa226d7 [id=a40c2d4cbfe343cb90e2ec85e6ccfa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.109004 743 tablet_service.cc:1511] Processing CreateTablet for tablet aec174cc59cf401bb58460eb91eadd25 (DEFAULT_TABLE table=default.Table_692ad5dc212c48819189ebe9e823d551 [id=781f45e9cd1c41aab34b06ce645b659b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.109669 892 tablet_service.cc:1511] Processing CreateTablet for tablet c7f3ae4fae1445d6a824afe9ff194a6f (DEFAULT_TABLE table=default.Table_87ef1230f42d4b7799cc13d03622ec6a [id=88357b84ef264101bedafaffb91bed4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.111059 883 tablet_service.cc:1511] Processing CreateTablet for tablet 51bc007378534ee6ac8c64bfc41ebcd3 (DEFAULT_TABLE table=default.Table_bba9ffa84f1f430391d8720c5069f67d [id=043db8f8057a4ef79a82683ba0d699be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.112361 1175 ts_tablet_manager.cc:1929] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:16.112534 1175 log.cc:1199] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8ffec630db9a430fa3006268b0e28fcd
I20260503 07:53:16.112990 1175 ts_tablet_manager.cc:1950] T 8ffec630db9a430fa3006268b0e28fcd P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:16.113307 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e924c5f6c05d4566b6ad073bb5b5a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.113564 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f3ae4fae1445d6a824afe9ff194a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.113814 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bb8f0632c944c8a5cb5d7393d1cd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.114284 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51bc007378534ee6ac8c64bfc41ebcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.115097 1171 tablet_bootstrap.cc:492] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.115231 1171 ts_tablet_manager.cc:1403] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.084s user 0.001s sys 0.007s
I20260503 07:53:16.115526 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffacb1497a724fcaaca3aa64ec3ba612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.115710 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec174cc59cf401bb58460eb91eadd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.115981 1171 raft_consensus.cc:359] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.116207 1171 raft_consensus.cc:385] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.116274 1171 raft_consensus.cc:740] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.116472 1171 consensus_queue.cc:260] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.116892 1171 ts_tablet_manager.cc:1434] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260503 07:53:16.117942 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 903) took 7634 ms. Trace:
I20260503 07:53:16.118153 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3f95e49dfec744da94a6db8c46475302 (DEFAULT_TABLE table=default.Table_d4b95589e7ea46c792a7f069992951a8 [id=2c351024ec3a4339bcf5a45e2bf2eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.127295 884 rpcz_store.cc:276] 0503 07:53:14.282072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.676145 (+1394073us) service_pool.cc:224] Handling call
0503 07:53:15.676656 (+ 511us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.676680 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:15.754932 (+ 78252us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:15.924559 (+169627us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:15.925785 (+ 1226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.127398 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4877210ebe478db776bffc52050164 (DEFAULT_TABLE table=default.Table_e4637a8b90ee4ac88da954efe295d605 [id=67c9b9e0ba0f43dbb982382fdce9670a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.127681 888 tablet_service.cc:1511] Processing CreateTablet for tablet 41c0a9d223b040bdb8cd55629914357b (DEFAULT_TABLE table=default.Table_ee2d7a044dfb46aea48bf51119a4a3e3 [id=24de47e4e38845c6adbd7ac7ad444ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.130023 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587dd9dc4f46439e89f216a448118b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.131358 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7439917c2a764658bfa8bf62ba67e34f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.131633 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.131845 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9158409f18204903b0a2203e6bb8b924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.132380 752 tablet_service.cc:1511] Processing CreateTablet for tablet d5a121de0d054f8e884045a11b9dd9af (DEFAULT_TABLE table=default.Table_37f7ff2ff96a48d8a1786b2a10ac567b [id=7f42953f01cb46f3a3aa1c6d6766ad3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.132688 757 tablet_service.cc:1511] Processing CreateTablet for tablet 39bd6a4378ba4949ac0c0968044bd596 (DEFAULT_TABLE table=default.Table_cb525444d6554724a8ff74e0892ddb33 [id=3dca018a8ded4e53b9941f09861a692a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.133005 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bd6a4378ba4949ac0c0968044bd596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.137084 744 tablet_service.cc:1511] Processing CreateTablet for tablet d9d62dfad9f0448faa5ff20d891d65db (DEFAULT_TABLE table=default.Table_f51cbfb98b0c49c5a7b4c1d93174b7f5 [id=0e63b3547291485aa86d4ba2f337be60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.137435 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d62dfad9f0448faa5ff20d891d65db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.138280 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.138631 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f79085c25d43e58f221af146d252cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.139106 754 tablet_service.cc:1511] Processing CreateTablet for tablet 34548b04a8b744a2994bc25d9f5649ed (DEFAULT_TABLE table=default.Table_06bbe98616f24b8ba5461549c8af26d4 [id=c4597d30ba234280ba534b2a02662c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.139467 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34548b04a8b744a2994bc25d9f5649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.139876 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4424fbafc85e4f559295c2443685c390 (DEFAULT_TABLE table=default.Table_c1bede5f6a154557b54f60570220730c [id=5ad96fa208fe464686b76ffaf0a85ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.140344 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4424fbafc85e4f559295c2443685c390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.142170 1173 rpcz_store.cc:276] 0503 07:53:08.367952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.439482 (+ 71530us) service_pool.cc:224] Handling call
0503 07:53:15.999654 (+7560172us) ts_tablet_manager.cc:1151] Deleting tablet 78b3210d1ecd42198e080b02a8b594a5
0503 07:53:15.999669 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.002597 (+ 2928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7541280}
I20260503 07:53:16.142570 1173 tablet_replica.cc:333] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:16.142776 1173 raft_consensus.cc:2243] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.142976 1173 raft_consensus.cc:2272] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.143661 1173 ts_tablet_manager.cc:1916] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.143813 885 tablet_service.cc:1511] Processing CreateTablet for tablet f00c438eeec14086b33909f29b5cc329 (DEFAULT_TABLE table=default.Table_ef6b39ff3b694d45b0661a39a3daf4d4 [id=1e2f898fbeff444aa372f6ec8dc118a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.144536 884 tablet_service.cc:1511] Processing CreateTablet for tablet f1c95ddbfb634c1997a0e0acdd45ffc3 (DEFAULT_TABLE table=default.Table_2e37a8c4a2614022a6d259ed634fb982 [id=c4006849d6d14ccb8f23fb02548147f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.146031 2608 raft_consensus.cc:515] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.146670 2608 leader_election.cc:290] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.147029 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a121de0d054f8e884045a11b9dd9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.148211 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.148404 1051 raft_consensus.cc:3060] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.151139 1051 raft_consensus.cc:2468] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.151568 716 leader_election.cc:304] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.152100 2608 raft_consensus.cc:2804] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.152271 2608 raft_consensus.cc:697] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.152515 2608 consensus_queue.cc:237] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.154331 881 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6bdac8d0c6484da94b93775edbe4d9 (DEFAULT_TABLE table=default.Table_83bd2416af9c471d84f650f125aa4f20 [id=20fdd5f8780748a0bfaa862feaab2030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.159379 883 tablet_service.cc:1511] Processing CreateTablet for tablet 7833f2abd0ff48e88fe7c5fbdaac037e (DEFAULT_TABLE table=default.Table_456974f93b2c49cd8e91e745926dc00d [id=9ab90119696c440aafc26eacd50cce6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.160583 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f95e49dfec744da94a6db8c46475302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.164510 2708 raft_consensus.cc:515] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.165167 2708 leader_election.cc:290] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.169090 2898 raft_consensus.cc:493] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.169206 2898 raft_consensus.cc:515] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.169756 2898 leader_election.cc:290] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.172363 892 tablet_service.cc:1511] Processing CreateTablet for tablet b4b91ecd211b450583f9e0d22da62641 (DEFAULT_TABLE table=default.Table_19a81c8e549449b5bfc271441e17a3ba [id=7c84f7a8993b41b3aa4645b937885def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.172377 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.172463 1166 ts_tablet_manager.cc:1434] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.486s user 0.004s sys 0.025s
I20260503 07:53:16.172678 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6bdac8d0c6484da94b93775edbe4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.172840 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8170f14d34d642ebaaf9cfaf7d08f1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.173305 1166 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:16.179044 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.179348 1051 raft_consensus.cc:3060] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.179561 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eee8cb05dc4e0fae5385f83fb99c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.181085 1166 tablet_bootstrap.cc:654] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.182446 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b91ecd211b450583f9e0d22da62641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.188087 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0f3152281bf44946a4ae806f253ecd85 (table default.Table_86a6421c8e9145449dc4483b0fd936b3 [id=dbdd7a759dc44fffb0dc1211d97713ca]). Expected version 1 got 0
I20260503 07:53:16.191131 1051 raft_consensus.cc:2468] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.191972 716 leader_election.cc:304] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.192499 2608 raft_consensus.cc:2804] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.192636 2608 raft_consensus.cc:697] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.192881 2608 consensus_queue.cc:237] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.196412 755 tablet_service.cc:1511] Processing CreateTablet for tablet 217c6a1dac20496e98c947c56746fe91 (DEFAULT_TABLE table=default.Table_c876deb5a4444105bbfcbab543509877 [id=e7a06a38336e41e288de8d2e3ca61cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.196842 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217c6a1dac20496e98c947c56746fe91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.197423 2898 raft_consensus.cc:493] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:16.197619 2898 raft_consensus.cc:515] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:16.198242 2898 leader_election.cc:290] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:16.198307 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.198472 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c2a8057297cc4a16813a545fc2b947d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.198751 1174 raft_consensus.cc:2243] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.198985 1174 raft_consensus.cc:2272] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.199378 743 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.203711 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1101) took 4963 ms. Trace:
I20260503 07:53:16.203820 1175 rpcz_store.cc:276] 0503 07:53:11.239985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.386319 (+146334us) service_pool.cc:224] Handling call
0503 07:53:15.933716 (+4547397us) ts_tablet_manager.cc:1151] Deleting tablet 8ffec630db9a430fa3006268b0e28fcd
0503 07:53:15.933725 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.007200 (+ 73475us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x61700005d2f0. stack: 00007fe1a7f78086 00007fe1a7f77e40 00007fe1a6f313ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fe1b3d9a91f 00007fe1b3e4b46c 00007fe1b3ebb8c3 00007fe1b520f283 00007fe1b7dd4a77 00007fe1b7e07b44 00007fe1b7de8560 00007fe1b7de82ed 0000000000aa4cac 00007fe1a7fbdf6f
0503 07:53:16.109579 (+102379us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.112314 (+ 2735us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.203684 (+ 91370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167614336,"tablet-delete.queue_time_us":4446935}
I20260503 07:53:16.204321 1175 tablet_replica.cc:333] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:16.204564 1175 raft_consensus.cc:2243] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:16.204900 1175 raft_consensus.cc:2272] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.205477 1175 ts_tablet_manager.cc:1916] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.208001 1171 tablet_bootstrap.cc:492] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.209987 1171 tablet_bootstrap.cc:654] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.210448 746 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3e560a7ea14a75b6935ce7593db586 (DEFAULT_TABLE table=default.Table_37a701dfcbd8445493c2a2886382c756 [id=bdae77253b44493b86bc80e27ae72e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.210830 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3e560a7ea14a75b6935ce7593db586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.213727 895 tablet_service.cc:1511] Processing CreateTablet for tablet d5053947b21449b08a0fc487a49fb48f (DEFAULT_TABLE table=default.Table_23080564cfaa4f5ca50f2fee8c6d5f87 [id=aec650477ed548c485ee0b7d677d0af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.220480 1175 ts_tablet_manager.cc:1929] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:16.220788 1175 log.cc:1199] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/bdd151f5e0d54bdab58423c24186b38d
I20260503 07:53:16.221534 1175 ts_tablet_manager.cc:1950] T bdd151f5e0d54bdab58423c24186b38d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:16.222749 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1103) took 4982 ms. Trace:
I20260503 07:53:16.222949 1175 rpcz_store.cc:276] 0503 07:53:11.240189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.421476 (+181287us) service_pool.cc:224] Handling call
0503 07:53:16.204252 (+4782776us) ts_tablet_manager.cc:1151] Deleting tablet bdd151f5e0d54bdab58423c24186b38d
0503 07:53:16.204278 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.214693 (+ 10415us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.220407 (+ 5714us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.222707 (+ 2300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4716456}
I20260503 07:53:16.226765 897 tablet_service.cc:1511] Processing CreateTablet for tablet af2210af3e8b41c283da360610c5e805 (DEFAULT_TABLE table=default.Table_0eeec067673744d58cdb5243c65ca773 [id=35a1ee8829a847c19c1c0bce035a034b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.227083 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.227842 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00c438eeec14086b33909f29b5cc329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.228145 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c0a9d223b040bdb8cd55629914357b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.230207 760 tablet_service.cc:1511] Processing CreateTablet for tablet 20cdab298eec48ab93f842106bfdb63a (DEFAULT_TABLE table=default.Table_6b85f9b0c8a34996b7dde81cda8493bb [id=09f81da09f2d4153bf85a42ac86cc309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.230243 748 tablet_service.cc:1511] Processing CreateTablet for tablet 7c98a0c2688e412b952f40cf8324ae25 (DEFAULT_TABLE table=default.Table_417934ccc822402683f4260861be498c [id=7aef35a9b8c743169a4b009dad21e60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.230585 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cdab298eec48ab93f842106bfdb63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.231298 759 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f8052841d42838ca1df445f275d05 (DEFAULT_TABLE table=default.Table_6787181f2fc0489d974cbf840a50adbe [id=4daec9958e314f7fb789cca6f9b2a502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.231376 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e40b7ef514f448bcf83837656149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.231626 743 tablet_service.cc:1511] Processing CreateTablet for tablet 53ac8ebc0f1843b689c90f22448dd9f4 (DEFAULT_TABLE table=default.Table_578fbd130e20482fa133085f79be8f91 [id=f6bde052c50c46198161802521e04302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.231782 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5053947b21449b08a0fc487a49fb48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.232115 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4877210ebe478db776bffc52050164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.232316 741 tablet_service.cc:1511] Processing CreateTablet for tablet cb2f595922f64b658fbc8d4c71add546 (DEFAULT_TABLE table=default.Table_f001df33442b490ea5a1b97fbca5f4f8 [id=d5e013d9707d458bbafa78f50a155105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.232568 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7833f2abd0ff48e88fe7c5fbdaac037e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.232888 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c95ddbfb634c1997a0e0acdd45ffc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.234120 898 tablet_service.cc:1511] Processing CreateTablet for tablet 14204e9500de4c23835e82bc2a376b7b (DEFAULT_TABLE table=default.Table_c386b16f4d974890a8fd5df867c9e88f [id=49f1737dbc2e4e009270713ba5acac9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.234193 744 tablet_service.cc:1511] Processing CreateTablet for tablet 939d2af7fc3c4c8495043484c7435d6b (DEFAULT_TABLE table=default.Table_3856e2648e8b44cfbf93659c8e183931 [id=ec2c1f5da0f94af583617f405c944a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.234584 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2210af3e8b41c283da360610c5e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.234935 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14204e9500de4c23835e82bc2a376b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.235723 1171 tablet_bootstrap.cc:492] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.236066 1171 ts_tablet_manager.cc:1403] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260503 07:53:16.236582 1175 tablet_replica.cc:333] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:16.236791 1175 raft_consensus.cc:2243] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.236954 1175 raft_consensus.cc:2272] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.238304 1174 ts_tablet_manager.cc:1916] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.238051 1171 raft_consensus.cc:359] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.238552 1171 raft_consensus.cc:385] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.238744 1171 raft_consensus.cc:740] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.239178 1171 consensus_queue.cc:260] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.240438 747 tablet_service.cc:1511] Processing CreateTablet for tablet c44b8094c42441fd8dcf10baa6ba2bd9 (DEFAULT_TABLE table=default.Table_3561bb0d844c4640b2e28ee803269589 [id=1ec18c51cb4d4a73ac960dad530bb039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.241353 1171 ts_tablet_manager.cc:1434] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260503 07:53:16.243399 2816 leader_election.cc:290] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.245590 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6d7e50111d4e7ab01a7f3149a55379 (DEFAULT_TABLE table=default.Table_b5eef1ddf8be416fbf3acc015a033854 [id=6a2ef296925944128884f4d6575949d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.245671 2912 raft_consensus.cc:515] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.248122 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ac8ebc0f1843b689c90f22448dd9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.248885 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.249061 1050 raft_consensus.cc:3060] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:16.188483 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63f3cee208e54c8d812ad3dc66b9e932 consensus state has no leader
I20260503 07:53:16.251400 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e8b61a046c0640179d065f67343c831e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.251905 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8b61a046c0640179d065f67343c831e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.251927 1050 raft_consensus.cc:2468] T 722411278ae148d5b3d082d95683d12a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.253931 595 catalog_manager.cc:5671] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:16.188544 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a6050ebde3e741a1b551eecf1f704689
I20260503 07:53:16.254827 595 catalog_manager.cc:5671] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:16.256222 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 0a08da2052f5482792c8b3294e9b7332 (table default.Table_11c94f42fdb74455a513cdd269339d90 [id=a8e0e85f02244d0b845242b0d59eedce]). Expected version 2 got 0
I20260503 07:53:16.256464 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:16.256608 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c0ceddd751644d20bcbda15a462d5342 (table default.Table_f753dec874b841f18bf08be5433c6402 [id=36a30c4e7a864127b873fc19a9b9cfd5]). Expected version 1 got 0
I20260503 07:53:16.256767 595 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:16.258528 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b6c0addc188a4a49a17ad33a8f48d12d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.259011 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6c0addc188a4a49a17ad33a8f48d12d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.260001 879 tablet_service.cc:1558] Processing DeleteTablet for tablet af0c0f5999ee4b9cae56cbb3695de12f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.260222 879 tablet_service.cc:1558] Processing DeleteTablet for tablet dab8cc17114146628682a0a8432596d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.260380 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 157bb83e56234f17b906756c0d70868c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.260507 879 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3862d990f14c3f8a084d234d941bfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.260802 879 tablet_service.cc:1511] Processing CreateTablet for tablet d23ff7d87cdf49d5b3c5f367f80d1fff (DEFAULT_TABLE table=default.Table_7e8b1843f23145218ea02f3f48c49572 [id=89cfc291dc4144e4b521be1dd87797a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.261178 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ff7d87cdf49d5b3c5f367f80d1fff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.188686 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16941894d18b490894c0b0a2dda2b24d consensus state has no leader
I20260503 07:53:16.189101 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b9c58f8cbe354c10a6610555b12af3eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.263796 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9c58f8cbe354c10a6610555b12af3eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.195958 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cb43255a95cc4b09bf75bd57ae756fc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.264855 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb43255a95cc4b09bf75bd57ae756fc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.267483 1175 ts_tablet_manager.cc:1916] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.270521 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_37a701dfcbd8445493c2a2886382c756" } new_table_name: "default.Table_4d2c66f031e54abeabc618894d9fd042" modify_external_catalogs: true
I20260503 07:53:16.248412 2912 leader_election.cc:290] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.260449 716 leader_election.cc:304] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.275872 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a6ffba37b4b442829e9093e50b970078" } new_table_name: "default.Table_5afad8a766b042d689eccdeb41107691" modify_external_catalogs: true
I20260503 07:53:16.277158 2912 raft_consensus.cc:2804] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.277328 2912 raft_consensus.cc:697] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.278533 594 master_service.cc:954] ReplaceTablet: received request to replace tablet 703363a7e1544cf694ab05dab855d1d4 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:16.279224 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_143191f2475a48059309728da56ea7a7" } modify_external_catalogs: true
I20260503 07:53:16.279340 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_143191f2475a48059309728da56ea7a7" } modify_external_catalogs: true
I20260503 07:53:16.277588 2912 consensus_queue.cc:237] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.282058 2708 raft_consensus.cc:493] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.282161 2708 raft_consensus.cc:515] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.282647 2708 leader_election.cc:290] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.283331 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.283509 1050 raft_consensus.cc:2468] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.283916 716 leader_election.cc:304] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:16.286154 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5aeb1c5745a47bd9e6a0e0f771d1ecb consensus state has no leader
I20260503 07:53:16.286491 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4432dff538f34ccfa5ff09ffa927936d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.286907 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4432dff538f34ccfa5ff09ffa927936d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.288059 2708 raft_consensus.cc:2804] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.288225 2708 raft_consensus.cc:493] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.288407 2708 raft_consensus.cc:3060] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:16.290688 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a3e560a7ea14a75b6935ce7593db586 consensus state has no leader
I20260503 07:53:16.290977 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_93743c6156a74284a1bc22666cb227da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.291390 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93743c6156a74284a1bc22666cb227da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:16.196260 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e20b84490a354310b510a82b139bc773 consensus state has no leader
I20260503 07:53:16.196357 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 2c33a99333ae495aab1fb3361b587238
I20260503 07:53:16.292644 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cc6e51bc0e8043b39f23a978249b8355" } modify_external_catalogs: true
I20260503 07:53:16.292799 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_cc6e51bc0e8043b39f23a978249b8355" } modify_external_catalogs: true
I20260503 07:53:16.292956 598 master_service.cc:954] ReplaceTablet: received request to replace tablet acb2026ec07045f6b38c86f1d5d22462 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:16.293493 598 master_service.cc:954] ReplaceTablet: received request to replace tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:16.196522 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5aeae993f8894649ac780f266b3b4968
I20260503 07:53:16.297739 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1167) took 2014 ms. Trace:
I20260503 07:53:16.297821 891 rpcz_store.cc:276] 0503 07:53:14.282822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.799151 (+1516329us) service_pool.cc:224] Handling call
0503 07:53:15.904359 (+105208us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.904380 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.206643 (+302263us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.297588 (+ 90945us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.297724 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204032}
I20260503 07:53:16.299141 891 tablet_service.cc:1511] Processing CreateTablet for tablet e7faa40fdb9e4560a7b0759d774e8a9d (DEFAULT_TABLE table=default.Table_b11f056d948f43f5a39c9b846137d9c8 [id=3e6fa244b6204b52bb38c756b3c9ccdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.299477 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7faa40fdb9e4560a7b0759d774e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.305460 425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 65793.7us
I20260503 07:53:16.309312 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet be88fd1af300484989dca8658ea5e090
I20260503 07:53:16.312964 1171 tablet_bootstrap.cc:492] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.314505 880 tablet_service.cc:1511] Processing CreateTablet for tablet 79a662b661114ea4bd986f985a13092d (DEFAULT_TABLE table=default.Table_c37ca51ef812421a90de1ebd88d898a0 [id=4e969940094c480f91b2d58f653cfee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.314898 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a662b661114ea4bd986f985a13092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.271461 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_917ca0375c9a46e3804a45aba6641d83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.320753 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_917ca0375c9a46e3804a45aba6641d83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.322449 879 tablet_service.cc:1511] Processing CreateTablet for tablet 2f948e5d45d347e09ea73c5a52233858 (DEFAULT_TABLE table=default.Table_449c7851c1704ea496ea74632c7ea2da [id=927f1d8020484f559b895c677916204f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.322759 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f948e5d45d347e09ea73c5a52233858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.325213 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44b8094c42441fd8dcf10baa6ba2bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.325910 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6d7e50111d4e7ab01a7f3149a55379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.326052 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c98a0c2688e412b952f40cf8324ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.326184 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f8052841d42838ca1df445f275d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.326550 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939d2af7fc3c4c8495043484c7435d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.326793 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f595922f64b658fbc8d4c71add546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.196717 592 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf]). Expected version 2 got 0
I20260503 07:53:16.217509 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8ffec630db9a430fa3006268b0e28fcd (table default.Table_5927563641d44bc28addfeb760ee7280 [id=62cd8ca8c65b443a87799ad6b3e263a7]) successfully deleted
W20260503 07:53:16.327889 588 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 110390us
I20260503 07:53:16.329202 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet bdd151f5e0d54bdab58423c24186b38d (table default.Table_c1a2ce2e59084b5286d27b3efbd097d1 [id=058fdda874e841b99867dd1ad2fb40d7]) successfully deleted
I20260503 07:53:16.330677 1171 tablet_bootstrap.cc:654] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.331740 1175 ts_tablet_manager.cc:1929] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:16.333674 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet a6050ebde3e741a1b551eecf1f704689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.333807 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c33a99333ae495aab1fb3361b587238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.336117 1175 log.cc:1199] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/8c0bcb9ab72a482ca07447ff392ae49d
I20260503 07:53:16.334079 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334214 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet c11304c2f96f4518bedc07c23af81f50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334453 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet be88fd1af300484989dca8658ea5e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334554 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb with delete_type TABLET_DATA_DELETED (replaced by tablet 822c15b68f61466584eec0702196a5c5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334692 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 053b644e68e04a80966f374883170221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334794 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet cec0b36fdcf64042bc87446977b9dcca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:06 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.334900 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.335007 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.333932 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeae993f8894649ac780f266b3b4968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.336716 1175 ts_tablet_manager.cc:1950] T 8c0bcb9ab72a482ca07447ff392ae49d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:16.336997 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 722411278ae148d5b3d082d95683d12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.337428 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1116) took 5009 ms. Trace:
I20260503 07:53:16.338750 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1169) took 2055 ms. Trace:
I20260503 07:53:16.338840 887 rpcz_store.cc:276] 0503 07:53:14.282985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.799900 (+1516915us) service_pool.cc:224] Handling call
0503 07:53:15.957173 (+157273us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.957200 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.322014 (+364814us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.333287 (+ 11273us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.338734 (+ 5447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.339146 2917 raft_consensus.cc:493] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.339193 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2683448c3f4df3bb0b14683d8b5222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.339251 2917 raft_consensus.cc:515] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.339799 2917 leader_election.cc:290] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.339071 1175 rpcz_store.cc:276] 0503 07:53:11.327575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.646148 (+318573us) service_pool.cc:224] Handling call
0503 07:53:16.236533 (+4590385us) ts_tablet_manager.cc:1151] Deleting tablet 8c0bcb9ab72a482ca07447ff392ae49d
0503 07:53:16.236545 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.270468 (+ 33923us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.331675 (+ 61207us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.337410 (+ 5735us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4404148}
I20260503 07:53:16.349138 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b90ec3eb3894c18825ebe5fb79fa5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.349560 893 tablet_service.cc:1511] Processing CreateTablet for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8 (DEFAULT_TABLE table=default.Table_5eb646eacf084a7dbebf001fe2b34e7d [id=73cf4cb30108407ca87e9fa87f9df305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.349973 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99c5c8eb5bf4f3b8eb65b865b8f89b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.351297 585 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e210e9e635b6449e9d48f3520120ac97 (table default.Table_1b9fc0d8b3e74016af52770b9afcadba [id=33ad67e43c804263bec763baad02d2d0], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e210e9e635b6449e9d48f3520120ac97 consensus state has no leader
I20260503 07:53:16.352154 2644 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:53:16.352321 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 79a662b661114ea4bd986f985a13092d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.347889 1171 tablet_bootstrap.cc:492] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.352764 1171 ts_tablet_manager.cc:1403] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.007s
I20260503 07:53:16.353469 1171 raft_consensus.cc:359] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.353622 1171 raft_consensus.cc:385] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.353672 1171 raft_consensus.cc:740] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.353838 1171 consensus_queue.cc:260] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.354364 1171 ts_tablet_manager.cc:1434] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:16.355629 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 8c0bcb9ab72a482ca07447ff392ae49d (table default.Table_014c7be2e3314cbd9bd3ca3d74c74621 [id=e2094635fa9e46c9876185dd27e3f91c]) successfully deleted
I20260503 07:53:16.356906 2644 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:53:16.361439 891 tablet_service.cc:1558] Processing DeleteTablet for tablet aaef17b7249e4f208b672fde4a284590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.362304 2608 raft_consensus.cc:493] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.363121 2608 raft_consensus.cc:515] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.364610 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.364781 1050 raft_consensus.cc:2468] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.357198 2644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:53:16.365139 716 leader_election.cc:304] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.365447 2908 raft_consensus.cc:2804] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.365522 2908 raft_consensus.cc:493] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.365594 2908 raft_consensus.cc:3060] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.364707 2608 leader_election.cc:290] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.376885 2938 tablet.cc:1724] T 0f3152281bf44946a4ae806f253ecd85 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:16.378575 1165 tablet_bootstrap.cc:654] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.383455 1171 tablet_bootstrap.cc:492] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.385954 1171 tablet_bootstrap.cc:654] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.388155 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1134) took 4873 ms. Trace:
I20260503 07:53:16.388316 1175 rpcz_store.cc:276] 0503 07:53:11.515166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.832397 (+317231us) service_pool.cc:224] Handling call
0503 07:53:16.354516 (+4522119us) ts_tablet_manager.cc:1151] Deleting tablet 3b10183f49464684acfa54e7d10ccee2
0503 07:53:16.387992 (+ 33476us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.388134 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4521997}
I20260503 07:53:16.388737 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1135) took 4873 ms. Trace:
I20260503 07:53:16.388849 1175 rpcz_store.cc:276] 0503 07:53:11.515354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.832527 (+317173us) service_pool.cc:224] Handling call
0503 07:53:16.388643 (+4556116us) ts_tablet_manager.cc:1151] Deleting tablet 01c7925b82934b59839a0e8ddf99356d
0503 07:53:16.388651 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.388723 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4556015}
I20260503 07:53:16.389189 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1136) took 4867 ms. Trace:
I20260503 07:53:16.389307 1175 rpcz_store.cc:276] 0503 07:53:11.521555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.832633 (+311078us) service_pool.cc:224] Handling call
0503 07:53:16.389105 (+4556472us) ts_tablet_manager.cc:1151] Deleting tablet 23b8c1768a15487ba9140acd77c4ff7b
0503 07:53:16.389112 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.389176 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4556392}
I20260503 07:53:16.389644 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1141) took 4856 ms. Trace:
I20260503 07:53:16.389763 1175 rpcz_store.cc:276] 0503 07:53:11.533550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.858363 (+324813us) service_pool.cc:224] Handling call
0503 07:53:16.389557 (+4531194us) ts_tablet_manager.cc:1151] Deleting tablet 63a44b834b1e44a99c2cd3f9747ca13f
0503 07:53:16.389565 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.389629 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531033}
I20260503 07:53:16.390100 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1142) took 4856 ms. Trace:
I20260503 07:53:16.390370 1175 rpcz_store.cc:276] 0503 07:53:11.534137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.858539 (+324402us) service_pool.cc:224] Handling call
0503 07:53:16.390014 (+4531475us) ts_tablet_manager.cc:1151] Deleting tablet 5c23434f3d8f44e581c2ed73aa045d96
0503 07:53:16.390022 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.390087 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531375}
I20260503 07:53:16.390921 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1115) took 5113 ms. Trace:
W20260503 07:53:16.391016 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 3b10183f49464684acfa54e7d10ccee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b10183f49464684acfa54e7d10ccee2 already in progress: creating tablet
W20260503 07:53:16.391256 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 01c7925b82934b59839a0e8ddf99356d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01c7925b82934b59839a0e8ddf99356d already in progress: creating tablet
W20260503 07:53:16.391410 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 23b8c1768a15487ba9140acd77c4ff7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23b8c1768a15487ba9140acd77c4ff7b already in progress: creating tablet
W20260503 07:53:16.391530 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 63a44b834b1e44a99c2cd3f9747ca13f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a44b834b1e44a99c2cd3f9747ca13f already in progress: creating tablet
W20260503 07:53:16.391645 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5c23434f3d8f44e581c2ed73aa045d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c23434f3d8f44e581c2ed73aa045d96 already in progress: creating tablet
I20260503 07:53:16.392895 1175 rpcz_store.cc:276] 0503 07:53:11.277120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.644557 (+367437us) service_pool.cc:224] Handling call
0503 07:53:16.390824 (+4746267us) ts_tablet_manager.cc:1151] Deleting tablet b1450c6bc197438fb8f26418c1aae4a5
0503 07:53:16.390833 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.390907 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4519779}
W20260503 07:53:16.393236 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b1450c6bc197438fb8f26418c1aae4a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1450c6bc197438fb8f26418c1aae4a5 already in progress: creating tablet
I20260503 07:53:16.395177 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 773fca453dac452abc723e49b70111b9 (table default.Table_c8d970f11c484c07994854adfe178e80 [id=1b5a88d781d14f7d9ed7d8941e1571be]) successfully deleted
I20260503 07:53:16.395537 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c0e84285a25e4efa9bc713326e77dc16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.396158 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0e84285a25e4efa9bc713326e77dc16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.397032 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0481de2191144ffc98fc266f156c0f72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:16.397329 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_948a8afda7584de9ba7005c1e0cfe63c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.397450 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0481de2191144ffc98fc266f156c0f72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:16.397675 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_948a8afda7584de9ba7005c1e0cfe63c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.405855 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet fa97597fa7a1435995f13e189db1f3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.406710 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 23ff4e3f16c1413c858ed955c77497c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.407099 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea0110f61ef4a8db59746cfcdd1850a (DEFAULT_TABLE table=default.Table_99baf3ec9d5447008144100f62c5529b [id=8d5ce345426248d29180d43c6d50c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.408311 1171 tablet_bootstrap.cc:492] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.408439 1171 ts_tablet_manager.cc:1403] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260503 07:53:16.409077 1171 raft_consensus.cc:359] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.409222 1171 raft_consensus.cc:385] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.409288 1171 raft_consensus.cc:740] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.409932 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0bcb9ab72a482ca07447ff392ae49d with delete_type TABLET_DATA_DELETED (replaced by tablet 0708cababc844e51ab7da2950664c2c5) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.410930 1171 consensus_queue.cc:260] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.413386 1171 ts_tablet_manager.cc:1434] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 07:53:16.416453 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea0110f61ef4a8db59746cfcdd1850a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.417294 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 538a155055574c25ae45d094cedbed0f (DEFAULT_TABLE table=default.Table_4fb4db2b8ace4ddda4bf4b7b2d861208 [id=9d256c231c10404c9bafd54d0ba42f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.417654 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538a155055574c25ae45d094cedbed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.425179 1175 tablet_replica.cc:333] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
W20260503 07:53:16.426458 986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:53:16.425743 1171 tablet_bootstrap.cc:492] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.428496 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5c56e8742f614c4a89c913a415cbb1fc
I20260503 07:53:16.428659 595 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf]). Expected version 2 got 0
I20260503 07:53:16.431356 2708 raft_consensus.cc:515] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.432440 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.432629 1051 raft_consensus.cc:3060] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.435595 1051 raft_consensus.cc:2468] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.438230 716 leader_election.cc:304] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.438504 2925 raft_consensus.cc:2804] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.438599 2925 raft_consensus.cc:697] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.438803 2925 consensus_queue.cc:237] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.440267 2816 raft_consensus.cc:493] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.440459 2816 raft_consensus.cc:515] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.441300 2708 leader_election.cc:290] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.445394 2816 leader_election.cc:290] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.445602 2816 raft_consensus.cc:493] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.445765 2816 raft_consensus.cc:515] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.453316 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_95acba54e2b94b8886d748f6ffa87d7e" } new_table_name: "default.Table_874915ddcb854143a04ecf55f29be315" modify_external_catalogs: true
I20260503 07:53:16.455185 2816 leader_election.cc:290] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.455615 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.364537 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2df37ced81264092a170c9b9548f01d7 (DEFAULT_TABLE table=default.Table_259899fd21c4432baa40574f11e4e9f0 [id=c5711e571aa2409b87e50e6c5f0757bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.370775 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.371662 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.373359 887 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7fad6661384f2b9a125c1bc7b8345a (DEFAULT_TABLE table=default.Table_e683012f1fc047c3a80ec030733ee2b8 [id=a41c0f5b959049e6a6de8d4c0afe162d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.456725 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7fad6661384f2b9a125c1bc7b8345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.422258 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.458424 2608 raft_consensus.cc:493] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.458549 2608 raft_consensus.cc:515] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.459062 2608 leader_election.cc:290] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.459466 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f368c0422d5446f1862454c59366d214" } modify_external_catalogs: true
I20260503 07:53:16.459605 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f368c0422d5446f1862454c59366d214" } modify_external_catalogs: true
I20260503 07:53:16.460214 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.461061 1051 raft_consensus.cc:2468] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:16.461120 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edfe937339914b29afbceb9cd3cd7c1c consensus state has no leader
I20260503 07:53:16.461454 716 leader_election.cc:304] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.461613 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df37ced81264092a170c9b9548f01d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.429998 897 tablet_service.cc:1511] Processing CreateTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 (DEFAULT_TABLE table=default.Table_1fa913322e01470c9941e894f6a75e75 [id=b77b1075bad04704827e76cf1fa8283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.462822 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79225c2dd80e41bf93ad2fa023b2a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.463068 2948 tablet.cc:1724] T 0f3152281bf44946a4ae806f253ecd85 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:16.465049 2608 raft_consensus.cc:2804] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.465128 2608 raft_consensus.cc:493] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.465199 2608 raft_consensus.cc:3060] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.426360 1175 raft_consensus.cc:2243] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:16.468081 1175 raft_consensus.cc:2272] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.469090 599 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 4bb8d47da511422d9665326520d35601
I20260503 07:53:16.368666 896 tablet_service.cc:1511] Processing CreateTablet for tablet 637af4aa4d0543b1b179cd3a8fdeadca (DEFAULT_TABLE table=default.Table_6704a05ca52c4a8cad6e31d38118f26e [id=bb010ee38e4e4867ac507829a67b57e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.472128 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637af4aa4d0543b1b179cd3a8fdeadca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.472086 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b70ef2dd4f2344d5aec48b3c2f8a2a79" } new_table_name: "default.Table_58cce9f0addf416d83b22a416d2e7ca8" modify_external_catalogs: true
I20260503 07:53:16.474664 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1e9cd3e917c3401c97534f9b3c929429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.475217 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e9cd3e917c3401c97534f9b3c929429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.475404 2908 raft_consensus.cc:515] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.476016 2908 leader_election.cc:290] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.476922 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8d47da511422d9665326520d35601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.477190 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.477402 1051 raft_consensus.cc:3060] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.477344 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_a19960d97e854ff890d7dc2083f0503d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.477849 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a19960d97e854ff890d7dc2083f0503d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:16.478361 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e20b84490a354310b510a82b139bc773 consensus state has no leader
I20260503 07:53:16.480320 1051 raft_consensus.cc:2468] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.480796 716 leader_election.cc:304] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.481081 1175 ts_tablet_manager.cc:1916] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.481163 2908 raft_consensus.cc:2804] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.481277 2908 raft_consensus.cc:697] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.481487 2908 consensus_queue.cc:237] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.487144 887 tablet_service.cc:1511] Processing CreateTablet for tablet 85ce02a2b5984765bbb292b0c3ce8c8a (DEFAULT_TABLE table=default.Table_3688b03b7ca446e8b2d00614a7863d90 [id=63797f54c98a41a2b16de0599719b2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.487268 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]) successfully deleted
I20260503 07:53:16.487486 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ce02a2b5984765bbb292b0c3ce8c8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.487707 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc already in progress: creating tablet
I20260503 07:53:16.488129 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fbc102fc1aae4f6b875dd1dad5add3fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.488628 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbc102fc1aae4f6b875dd1dad5add3fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.489068 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d360d20b40243669f2adb98438fb661" } new_table_name: "default.Table_f25f3e31b4a846349325dce004924645" modify_external_catalogs: true
I20260503 07:53:16.490428 2608 raft_consensus.cc:515] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.490628 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]) successfully deleted
I20260503 07:53:16.491451 1171 tablet_bootstrap.cc:654] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.492348 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.492413 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.492596 1051 raft_consensus.cc:3060] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.492825 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.493597 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.495420 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3d8bfac37e6d4024ae18b044b89bff8c" } new_table_name: "default.Table_aaf5a7e53c5a4d3d9e7ee00cbec7636f" modify_external_catalogs: true
I20260503 07:53:16.504963 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1207) took 1140 ms. Trace:
I20260503 07:53:16.505055 885 rpcz_store.cc:276] 0503 07:53:15.364568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.117666 (+753098us) service_pool.cc:224] Handling call
0503 07:53:16.144032 (+ 26366us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.144054 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.441882 (+297828us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.504834 (+ 62952us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.504949 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.505446 885 tablet_service.cc:1511] Processing CreateTablet for tablet f6227c81b5c54e579d31a966a0e2e531 (DEFAULT_TABLE table=default.Table_4298b47c6c014712adbd5a05a9920de6 [id=21a8a72a90464c2cb20f8b1a70b97c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.505767 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6227c81b5c54e579d31a966a0e2e531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.506434 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1211) took 1141 ms. Trace:
I20260503 07:53:16.506516 892 rpcz_store.cc:276] 0503 07:53:15.365000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.153535 (+788535us) service_pool.cc:224] Handling call
0503 07:53:16.174202 (+ 20667us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.174236 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.373452 (+199216us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.506311 (+132859us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.506422 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.436232 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722411278ae148d5b3d082d95683d12a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.507061 1051 raft_consensus.cc:2468] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.431489 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1206) took 1067 ms. Trace:
I20260503 07:53:16.507337 881 rpcz_store.cc:276] 0503 07:53:15.364393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.115487 (+751094us) service_pool.cc:224] Handling call
0503 07:53:16.154621 (+ 39134us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.154646 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.246254 (+ 91608us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.319512 (+ 73258us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.431474 (+111962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.507640 716 leader_election.cc:304] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.508249 2708 raft_consensus.cc:2804] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.508402 2708 raft_consensus.cc:697] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
W20260503 07:53:16.508670 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet baf176bdc6d54088846ee5eaf5e61447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baf176bdc6d54088846ee5eaf5e61447 already in progress: creating tablet
I20260503 07:53:16.508656 2708 consensus_queue.cc:237] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.438575 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1203) took 1078 ms. Trace:
I20260503 07:53:16.509389 890 rpcz_store.cc:276] 0503 07:53:15.359942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.993738 (+633796us) service_pool.cc:224] Handling call
0503 07:53:16.118384 (+124646us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.118402 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.178989 (+ 60587us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.438385 (+259396us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.438552 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:16.509459 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet fe059e59c2b24ead87ef36e5b7cac5bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe059e59c2b24ead87ef36e5b7cac5bf already in progress: creating tablet
I20260503 07:53:16.439730 879 tablet_service.cc:1511] Processing CreateTablet for tablet f3bdb03e1eea408e983cbf86f9faf007 (DEFAULT_TABLE table=default.Table_f3377c51ac0546ada5f045f337b91110 [id=3bd3dcdf2f5a49e29987e03cff0894d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.509819 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bdb03e1eea408e983cbf86f9faf007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.510291 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f747befb8f140abb67a16b1cbd92762" } modify_external_catalogs: true
I20260503 07:53:16.510443 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f747befb8f140abb67a16b1cbd92762" } modify_external_catalogs: true
I20260503 07:53:16.440441 1166 tablet_bootstrap.cc:492] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:16.510689 1166 ts_tablet_manager.cc:1403] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.337s user 0.007s sys 0.022s
I20260503 07:53:16.444235 886 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c78b3870e4c1e83e9a0625dd3624d (DEFAULT_TABLE table=default.Table_3d7b1b9c33424c509c2224c3d4266ecb [id=143452044f3d4c6694fbb8a20357aa55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.511111 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c78b3870e4c1e83e9a0625dd3624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.444505 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:16.511981 716 consensus_peers.cc:597] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf51c959093d4579a5916c49e1790737. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:16.512332 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_12549670f6814397948d9ba1037b63f7" } new_table_name: "default.Table_88dae099b213498dbfc32c51443990d3" modify_external_catalogs: true
I20260503 07:53:16.512537 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f7d6abb46e1542c2a900101ca6fa5099" } modify_external_catalogs: true
I20260503 07:53:16.512671 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f7d6abb46e1542c2a900101ca6fa5099" } modify_external_catalogs: true
I20260503 07:53:16.513841 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1204) took 1153 ms. Trace:
I20260503 07:53:16.513919 889 rpcz_store.cc:276] 0503 07:53:15.360075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.032930 (+672855us) service_pool.cc:224] Handling call
0503 07:53:16.129846 (+ 96916us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.129866 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.312899 (+183033us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.480955 (+168056us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.513826 (+ 32871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.514026 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fb82179b8b845da88125aa9f32bb9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.514299 889 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed9c2b2604242008415d636a4c273b9 (DEFAULT_TABLE table=default.Table_e753e8572bf746c580f2331da7b73034 [id=8d8f16d90318418aa817026b0f06c3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.516317 601 master_service.cc:954] ReplaceTablet: received request to replace tablet acb2026ec07045f6b38c86f1d5d22462 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:16.520977 2912 consensus_queue.cc:1048] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:16.521409 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4595da5353284616ba93b971aedf4f59" } modify_external_catalogs: true
I20260503 07:53:16.521550 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4595da5353284616ba93b971aedf4f59" } modify_external_catalogs: true
W20260503 07:53:16.525079 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e14da422aca041ed8d180eadc3be6aab consensus state has no leader
W20260503 07:53:16.525674 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ececa26cc216425cb6457978d35644f5 consensus state has no leader
I20260503 07:53:16.526345 2608 leader_election.cc:290] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.531090 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.531358 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9f008243dbcc4893a915b079e1ee9805 (DEFAULT_TABLE table=default.Table_b4ac4f2792ca45aa8fbeb9453bd07d88 [id=94515cdcae5c42a9a3d27b1ac420b4ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.535897 1174 ts_tablet_manager.cc:1929] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:16.536098 1174 log.cc:1199] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c7a7ad2250a3414aa5167d54c2c90941
I20260503 07:53:16.531567 2912 consensus_queue.cc:1048] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260503 07:53:16.538084 1174 ts_tablet_manager.cc:1950] T c7a7ad2250a3414aa5167d54c2c90941 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:16.538448 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 952) took 7033 ms. Trace:
I20260503 07:53:16.539415 2816 raft_consensus.cc:493] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.539459 1174 rpcz_store.cc:276] 0503 07:53:09.504535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.504815 (+ 280us) service_pool.cc:224] Handling call
0503 07:53:16.071992 (+6567177us) ts_tablet_manager.cc:1151] Deleting tablet c7a7ad2250a3414aa5167d54c2c90941
0503 07:53:16.072007 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.462968 (+390961us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.535833 (+ 72865us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.538429 (+ 2596us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126076,"tablet-delete.queue_time_us":6512663}
I20260503 07:53:16.539577 2816 raft_consensus.cc:515] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.539880 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 951) took 7057 ms. Trace:
I20260503 07:53:16.539916 892 tablet_service.cc:1511] Processing CreateTablet for tablet 157f7f12772b4c7189963535a8b86ab8 (DEFAULT_TABLE table=default.Table_3d3a13b279f8478599baeb7f7f4648df [id=60f43ca9dcf44d24b1e23889b47d5a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.539954 1174 rpcz_store.cc:276] 0503 07:53:09.482027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.484466 (+ 2439us) service_pool.cc:224] Handling call
0503 07:53:16.539769 (+7055303us) ts_tablet_manager.cc:1151] Deleting tablet f2de368e66424e4d9edf7c840ac8071e
0503 07:53:16.539780 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.539866 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6980078}
I20260503 07:53:16.540285 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 954) took 6383 ms. Trace:
I20260503 07:53:16.540390 1174 rpcz_store.cc:276] 0503 07:53:10.156406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.156455 (+ 49us) service_pool.cc:224] Handling call
0503 07:53:16.540197 (+6383742us) ts_tablet_manager.cc:1151] Deleting tablet 5deea77f36d540bb8f721657b7e3500e
0503 07:53:16.540207 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.540270 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6383546}
I20260503 07:53:16.541160 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 955) took 6376 ms. Trace:
I20260503 07:53:16.541200 881 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5d03e9f4504a8987128b93d3f296a2 (DEFAULT_TABLE table=default.Table_2509bf88cbff482784e5dae08dde4f3b [id=9b539815642048ebb258668277476738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.541249 2816 leader_election.cc:290] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.541316 1171 tablet_bootstrap.cc:492] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.541438 1171 ts_tablet_manager.cc:1403] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.001s
I20260503 07:53:16.543792 1174 rpcz_store.cc:276] 0503 07:53:10.165129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.165197 (+ 68us) service_pool.cc:224] Handling call
0503 07:53:16.541069 (+6375872us) ts_tablet_manager.cc:1151] Deleting tablet 2beb13a5d2844d44a3146d7937c8e964
0503 07:53:16.541078 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.541147 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6375663}
I20260503 07:53:16.544814 1171 raft_consensus.cc:359] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.545172 890 tablet_service.cc:1511] Processing CreateTablet for tablet ee495f04cf0d49158ccf2358dcc9fad8 (DEFAULT_TABLE table=default.Table_3d890f77dcdf464bba74b7797fb86d79 [id=2f1f230fc0c84406be848d39ebe3216d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.542490 2912 consensus_queue.cc:1048] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:16.545332 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.545723 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1170) took 2262 ms. Trace:
I20260503 07:53:16.545827 882 rpcz_store.cc:276] 0503 07:53:14.283049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.798423 (+1515374us) service_pool.cc:224] Handling call
0503 07:53:15.904261 (+105838us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.904287 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.449668 (+545381us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.545540 (+ 95872us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.545677 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.548123 1166 raft_consensus.cc:359] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.550026 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1213) took 1181 ms. Trace:
I20260503 07:53:16.550134 882 tablet_service.cc:1558] Processing DeleteTablet for tablet baa7721278d14e71aeba005d2bd40ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.550367 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cbd105ef7a3474fa546b4945ddc875a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.550545 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c6b320f8c446a2bee7dc25af7f49c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.551417 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc (DEFAULT_TABLE table=default.Table_cc6e51bc0e8043b39f23a978249b8355 [id=48be3ff429864fee8984c171f6add3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.439036 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.553375 1171 raft_consensus.cc:385] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.553526 1171 raft_consensus.cc:740] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.549306 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 637462b45502433796daa7a9cd8586d3 with delete_type TABLET_DATA_DELETED (replaced by tablet e19d7eab61e24e18a1e4eb600e9d592a) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.555169 1171 consensus_queue.cc:260] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.555989 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8774ffc66c854bcd8d8f394b9bc8a0de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.556208 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed9c2b2604242008415d636a4c273b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.556547 887 tablet_service.cc:1511] Processing CreateTablet for tablet e14da422aca041ed8d180eadc3be6aab (DEFAULT_TABLE table=default.Table_7d360d20b40243669f2adb98438fb661 [id=4f78e204eeea427e81cac1976c7f314a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.556854 1171 ts_tablet_manager.cc:1434] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260503 07:53:16.556981 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14da422aca041ed8d180eadc3be6aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.550143 895 rpcz_store.cc:276] 0503 07:53:15.365140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.176199 (+811059us) service_pool.cc:224] Handling call
0503 07:53:16.214058 (+ 37859us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.214382 (+ 324us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.377758 (+163376us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.546730 (+168972us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.546862 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.558785 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 957) took 6387 ms. Trace:
I20260503 07:53:16.558931 1174 rpcz_store.cc:276] 0503 07:53:10.170871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.170922 (+ 51us) service_pool.cc:224] Handling call
0503 07:53:16.545285 (+6374363us) ts_tablet_manager.cc:1151] Deleting tablet 0f707cb0257c4d6182ec331a235ba06c
0503 07:53:16.548236 (+ 2951us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.558765 (+ 10529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6374202}
I20260503 07:53:16.559326 1174 tablet_replica.cc:333] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:16.559561 1174 raft_consensus.cc:2243] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.559764 1174 raft_consensus.cc:2272] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.560357 1174 ts_tablet_manager.cc:1916] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.561062 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0911e2364ebf4e25bcc3f7420be042bd (DEFAULT_TABLE table=default.Table_9a741073f462488bb9bd48619d464c15 [id=3b67a9092dee4a7195b3ff6160fa176e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.561722 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee495f04cf0d49158ccf2358dcc9fad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.564119 1166 raft_consensus.cc:385] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.566049 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.566576 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f522dc5e8b12409eb9ed1a763d0db741" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.567586 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.568073 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0752eb4fa49a48cf521f9a072689a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.568215 895 tablet_service.cc:1511] Processing CreateTablet for tablet 03d59ce963824b05b8f15ec3365f13ac (DEFAULT_TABLE table=default.Table_0d3f50d1b6c24d838b7bb7e6fc88e968 [id=fd866dc72a2f428a8b3bcb9871707c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.568495 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911e2364ebf4e25bcc3f7420be042bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.569605 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18523493ee4841cb8949826239e2e458" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:16.572227 715 consensus_peers.cc:597] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:16.572220 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d59ce963824b05b8f15ec3365f13ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.572595 715 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.572934 715 consensus_peers.cc:597] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:16.573081 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157f7f12772b4c7189963535a8b86ab8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:16.573127 715 leader_election.cc:343] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.573400 715 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.573745 715 leader_election.cc:343] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.574021 715 leader_election.cc:343] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.574496 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
W20260503 07:53:16.575155 715 leader_election.cc:343] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.575496 715 leader_election.cc:343] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.575886 715 leader_election.cc:343] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.576143 715 leader_election.cc:343] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.576519 715 leader_election.cc:343] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.576797 715 leader_election.cc:343] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.577193 715 leader_election.cc:343] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.584462 1171 tablet_bootstrap.cc:492] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.584685 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c56e8742f614c4a89c913a415cbb1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.584625 1166 raft_consensus.cc:740] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.584901 1166 consensus_queue.cc:260] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.584656 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90ec3eb3894c18825ebe5fb79fa5be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.585508 1166 ts_tablet_manager.cc:1434] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.075s user 0.001s sys 0.000s
I20260503 07:53:16.585700 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f008243dbcc4893a915b079e1ee9805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.586567 1166 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:16.590020 1171 tablet_bootstrap.cc:654] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.590991 2908 raft_consensus.cc:493] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.591220 2908 raft_consensus.cc:515] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.593324 913 raft_consensus.cc:3060] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.594702 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.594966 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5d03e9f4504a8987128b93d3f296a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.596451 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef666aa007504682bc044cbd0b56060d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.602906 600 master_service.cc:954] ReplaceTablet: received request to replace tablet 86d052abe9234579b450cc6e92b6ddf6 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:16.603188 2908 leader_election.cc:290] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:16.614874 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1217) took 1239 ms. Trace:
I20260503 07:53:16.614990 880 rpcz_store.cc:276] 0503 07:53:15.375145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.231088 (+855943us) service_pool.cc:224] Handling call
0503 07:53:16.314691 (+ 83603us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.314719 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.355829 (+ 41110us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.614690 (+258861us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.614829 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.615479 880 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0848a7dc54e42aeae2e712b7ba398 (DEFAULT_TABLE table=default.Table_71a82cc361e244948d83eb8068a52749 [id=28f23d085f204d159440115e413f23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.615885 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0848a7dc54e42aeae2e712b7ba398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.618547 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1208) took 1253 ms. Trace:
I20260503 07:53:16.618719 888 rpcz_store.cc:276] 0503 07:53:15.364683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.124844 (+760161us) service_pool.cc:224] Handling call
0503 07:53:16.129947 (+ 5103us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.129971 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.419903 (+289932us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.618396 (+198493us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.618509 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.619232 888 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2816c78c9a4faaa116e55d48408561 (DEFAULT_TABLE table=default.Table_532e0bf3bb9e41edac74e09b1744e9a0 [id=7270f14443ae4297b781533c25bb349e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.621277 1165 tablet_bootstrap.cc:492] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:16.625386 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2816c78c9a4faaa116e55d48408561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.626291 1165 ts_tablet_manager.cc:1403] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.722s user 0.009s sys 0.012s
I20260503 07:53:16.627539 1165 raft_consensus.cc:359] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.629791 890 tablet_service.cc:1511] Processing CreateTablet for tablet f72cfc6ddd9a48e8ba451ed54978ea25 (DEFAULT_TABLE table=default.Table_bb7ea1bef84d48a5bbf2d50ec048882d [id=a90d57f0af51434f98aa128c0757b876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.629879 1165 raft_consensus.cc:385] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.630126 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72cfc6ddd9a48e8ba451ed54978ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.630330 1165 raft_consensus.cc:740] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.631004 1165 consensus_queue.cc:260] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.631464 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_840c32ea51014f56a1ccff214018c934"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.631994 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_840c32ea51014f56a1ccff214018c934 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.633751 896 tablet_service.cc:1511] Processing CreateTablet for tablet 87ab024dd97c48e5a290c7fa64b4891c (DEFAULT_TABLE table=default.Table_21c7a07f359c40da89a6c8624d48ef7a [id=d93e3cb8d9024935b237fb2272e4b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.634104 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ab024dd97c48e5a290c7fa64b4891c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.634114 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet f161b32232b7449493fa616794ad07a5
W20260503 07:53:16.635978 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1f5a6143d1e440d96a9281ab55387bb consensus state has no leader
I20260503 07:53:16.636389 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f161b32232b7449493fa616794ad07a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:16.637959 1173 ts_tablet_manager.cc:1929] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:16.638057 1173 log.cc:1199] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/b5bdaa3dd3a844d8b57def2b9faa03d8
I20260503 07:53:16.638329 1173 ts_tablet_manager.cc:1950] T b5bdaa3dd3a844d8b57def2b9faa03d8 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:16.633157 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:16.638470 762 raft_consensus.cc:3060] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.640357 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ebb0f12d94334be3a5029fb75213499d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:16.640473 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1212) took 1275 ms. Trace:
I20260503 07:53:16.640533 883 rpcz_store.cc:276] 0503 07:53:15.365075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.159174 (+794099us) service_pool.cc:224] Handling call
0503 07:53:16.159575 (+ 401us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.159602 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.430174 (+270572us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.640315 (+210141us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.640459 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.640592 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf72d49cfd24083abee07e0d2190e3e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:16.640739 776 raft_consensus.cc:3060] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.640749 883 tablet_service.cc:1558] Processing DeleteTablet for tablet e36b8bb09d5849cea5ba5b67155b590a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:16.640856 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebb0f12d94334be3a5029fb75213499d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.641070 883 tablet_service.cc:1511] Processing CreateTablet for tablet 394a15d5cd2d44f5a0ea411cef1e2b48 (DEFAULT_TABLE table=default.Table_6afc9e653bc742d0acfb720ab4f56658 [id=5f0cb5784a464cd9820c826585ed17db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.641395 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394a15d5cd2d44f5a0ea411cef1e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.641567 762 raft_consensus.cc:2468] T fc130dcd067f43f08748360a692eb048 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:16.642339 1165 ts_tablet_manager.cc:1434] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260503 07:53:16.642591 1165 tablet_bootstrap.cc:492] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:16.643079 2924 raft_consensus.cc:493] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.643103 776 raft_consensus.cc:2468] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:16.643251 2924 raft_consensus.cc:515] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.644469 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8c9a269d6be94b66a7cfac07dbdbdec5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:16.644577 2924 leader_election.cc:290] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
W20260503 07:53:16.645006 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c9a269d6be94b66a7cfac07dbdbdec5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.645529 593 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4eb95f369ab64235b8e0a908a1475ad9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.645903 593 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eb95f369ab64235b8e0a908a1475ad9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.646317 1165 tablet_bootstrap.cc:654] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.648582 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3862d990f14c3f8a084d234d941bfa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:16.648713 767 raft_consensus.cc:3060] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.650769 895 tablet_service.cc:1511] Processing CreateTablet for tablet 48bf766b113a4d069131410e06c44c41 (DEFAULT_TABLE table=default.Table_918a7bdc4b7244a597fd0afb8c8a7adf [id=50f6edd713ad4513a5f79973703432fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.651923 767 raft_consensus.cc:2468] T ae3862d990f14c3f8a084d234d941bfa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:16.653657 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.654635 893 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0adce7db64cc8a216e2dd4295a472 (DEFAULT_TABLE table=default.Table_bb75a18a02be4bab9e1e6e736d47dc76 [id=043594af9c754996b9d52757589bc90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.655665 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.657886 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 908) took 8171 ms. Trace:
I20260503 07:53:16.659319 1173 rpcz_store.cc:276] 0503 07:53:08.486917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:08.486972 (+ 55us) service_pool.cc:224] Handling call
0503 07:53:16.142525 (+7655553us) ts_tablet_manager.cc:1151] Deleting tablet b5bdaa3dd3a844d8b57def2b9faa03d8
0503 07:53:16.142535 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.433556 (+291021us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.637914 (+204358us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.657867 (+ 19953us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7655367}
I20260503 07:53:16.659757 1173 tablet_replica.cc:333] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:16.660812 1165 tablet_bootstrap.cc:492] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:16.661134 1173 raft_consensus.cc:2243] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.661810 1173 raft_consensus.cc:2272] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.661864 1165 ts_tablet_manager.cc:1403] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260503 07:53:16.662528 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdca8ec33a144e2b44cd9a0c0d61d93" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.662695 1173 ts_tablet_manager.cc:1916] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.663722 1165 raft_consensus.cc:359] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.664716 1165 raft_consensus.cc:385] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.665349 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.665513 1165 raft_consensus.cc:740] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.666185 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:16.666656 987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:53:16.666610 1165 consensus_queue.cc:260] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.659255 1166 tablet_bootstrap.cc:654] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.668788 1165 ts_tablet_manager.cc:1434] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260503 07:53:16.669498 1165 tablet_bootstrap.cc:492] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:16.671589 1165 tablet_bootstrap.cc:654] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.663146 897 tablet_service.cc:1558] Processing DeleteTablet for tablet d2bff2e711dc43a7b8757df95f3173b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.674273 897 tablet_service.cc:1511] Processing CreateTablet for tablet 9816136452d14647aeda8398eb5e6864 (DEFAULT_TABLE table=default.Table_1ab085f9bb854edaa2ebdc4cb085db34 [id=028d95c90bd74c11a0c4c1470cc4707d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.674799 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 596130e78eb1444a96480fc1075478cd (table default.Table_7f279670887e4606ab0d08db41d9affe [id=04182b9dfa4f41738dedf12d85d54147]) successfully deleted
I20260503 07:53:16.675853 879 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ddbc6b58548c48723c8468b3e599e (DEFAULT_TABLE table=default.Table_8e7e8c5538084100b030def99b1fb17d [id=9025f09218724f8e8b7a27b43077ecb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.675887 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.676083 1048 raft_consensus.cc:2468] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.676862 716 leader_election.cc:304] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.677273 2912 raft_consensus.cc:2804] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.677345 2912 raft_consensus.cc:493] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.677408 2912 raft_consensus.cc:3060] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.677811 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0adce7db64cc8a216e2dd4295a472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.680549 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7346da7e4cf147528f16d9ecfdb86c33" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.680696 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bf766b113a4d069131410e06c44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.681057 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.681257 2912 raft_consensus.cc:515] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.681579 883 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62 (DEFAULT_TABLE table=default.Table_3096be03a61e425a99a8086b09e4c157 [id=54f49e3f978e4ce8a0df42c79f9b2ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.682587 2912 leader_election.cc:290] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.686992 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.695017 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90ec3eb3894c18825ebe5fb79fa5be" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.667476 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 918d98225bd44da9afef237fb836b6b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.661715 1174 ts_tablet_manager.cc:1929] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:16.695487 1174 log.cc:1199] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/57261ae6531348d7bdd8deb5dfd980b4
I20260503 07:53:16.695603 891 tablet_service.cc:1511] Processing CreateTablet for tablet dc7c6a20531e484b997e666f47a34976 (DEFAULT_TABLE table=default.Table_3f26e2bf724b4df49cf01f05597312b2 [id=f16ff44fbafc4f6bba9d43f77eb6ee84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.681843 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9816136452d14647aeda8398eb5e6864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.695899 1174 ts_tablet_manager.cc:1950] T 57261ae6531348d7bdd8deb5dfd980b4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:16.696748 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 964) took 6372 ms. Trace:
I20260503 07:53:16.682842 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.684994 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f95e49dfec744da94a6db8c46475302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.700665 889 tablet_service.cc:1511] Processing CreateTablet for tablet a0aae05395da4c2e9b14b6d619d7453d (DEFAULT_TABLE table=default.Table_557490923aff4617bea08659402eddf8 [id=166f863b86ed40acba50a5d7eb4c404b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.701045 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0aae05395da4c2e9b14b6d619d7453d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.701333 882 tablet_service.cc:1511] Processing CreateTablet for tablet 2acd372a2b6943118994a3e26d4ac61e (DEFAULT_TABLE table=default.Table_8306df6ff4d74da7baa4a439498cdb5f [id=ef415e0cb4894c2faee669463f7647b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.701699 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acd372a2b6943118994a3e26d4ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.704257 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ddbc6b58548c48723c8468b3e599e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.706624 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1159) took 2424 ms. Trace:
I20260503 07:53:16.706734 894 rpcz_store.cc:276] 0503 07:53:14.282253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:15.771186 (+1488933us) service_pool.cc:224] Handling call
0503 07:53:15.771657 (+ 471us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:15.771703 (+ 46us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.704420 (+932717us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.706444 (+ 2024us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.706610 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.707131 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4 (DEFAULT_TABLE table=default.Table_b68f6201a8c74e3db86c941d919bf8de [id=6372cd13dae84e1b812f5f6eaed249eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.698340 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.699126 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef666aa007504682bc044cbd0b56060d" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.699576 767 raft_consensus.cc:1275] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:53:16.708143 1174 rpcz_store.cc:276] 0503 07:53:10.324626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.324690 (+ 64us) service_pool.cc:224] Handling call
0503 07:53:16.559280 (+6234590us) ts_tablet_manager.cc:1151] Deleting tablet 57261ae6531348d7bdd8deb5dfd980b4
0503 07:53:16.559290 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.606396 (+ 47106us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.661641 (+ 55245us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.696728 (+ 35087us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6234411}
I20260503 07:53:16.708581 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 965) took 6374 ms. Trace:
I20260503 07:53:16.708669 1174 rpcz_store.cc:276] 0503 07:53:10.334577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.334636 (+ 59us) service_pool.cc:224] Handling call
0503 07:53:16.708469 (+6373833us) ts_tablet_manager.cc:1151] Deleting tablet b38735fd577548b192131a769daa1d78
0503 07:53:16.708478 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.708565 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6373640}
I20260503 07:53:16.708967 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 966) took 6293 ms. Trace:
I20260503 07:53:16.709044 1174 rpcz_store.cc:276] 0503 07:53:10.415132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.415198 (+ 66us) service_pool.cc:224] Handling call
0503 07:53:16.708886 (+6293688us) ts_tablet_manager.cc:1151] Deleting tablet 8dbca27f54064345b374b0cea96ca1c4
0503 07:53:16.708893 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.708951 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6293473}
I20260503 07:53:16.709367 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 967) took 6217 ms. Trace:
I20260503 07:53:16.709442 1174 rpcz_store.cc:276] 0503 07:53:10.492146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.492231 (+ 85us) service_pool.cc:224] Handling call
0503 07:53:16.709265 (+6217034us) ts_tablet_manager.cc:1151] Deleting tablet c5a592a14c3e4659ba81754cbe62c438
0503 07:53:16.709275 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.709353 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6216839}
I20260503 07:53:16.709762 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 968) took 6144 ms. Trace:
I20260503 07:53:16.709842 1174 rpcz_store.cc:276] 0503 07:53:10.565457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.565620 (+ 163us) service_pool.cc:224] Handling call
0503 07:53:16.709662 (+6144042us) ts_tablet_manager.cc:1151] Deleting tablet 6720679e01e44baaa1501c8dbadba08a
0503 07:53:16.709672 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.709747 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6143776}
I20260503 07:53:16.710093 1174 tablet_replica.cc:333] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:16.710322 1174 raft_consensus.cc:2243] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.710496 1174 raft_consensus.cc:2272] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:16.710958 890 tablet_service.cc:1511] Processing CreateTablet for tablet 2c33a99333ae495aab1fb3361b587238 (DEFAULT_TABLE table=default.Table_575d34ce55254889a874cd08afb29ac1 [id=66807add626a4ca9a214e882f8091dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.711117 1174 ts_tablet_manager.cc:1916] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:16.712970 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7346da7e4cf147528f16d9ecfdb86c33" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.713601 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.713873 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 407a28fbbb9b4678986fdaf761f95271 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.714277 896 tablet_service.cc:1511] Processing CreateTablet for tablet aec174cc59cf401bb58460eb91eadd25 (DEFAULT_TABLE table=default.Table_692ad5dc212c48819189ebe9e823d551 [id=781f45e9cd1c41aab34b06ce645b659b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.714720 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.714964 774 raft_consensus.cc:2468] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 0.
I20260503 07:53:16.722545 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.722865 893 tablet_service.cc:1511] Processing CreateTablet for tablet 88bde0d32a0648f885503259d5ab3d76 (DEFAULT_TABLE table=default.Table_b3e72ade570e4453a358a772d6c9717e [id=07dcc3e6cdbf4d4d97273f89827fbbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.687721 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 378cc6d613584f308d3c0fb68b31f26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.723513 885 tablet_service.cc:1511] Processing CreateTablet for tablet ffacb1497a724fcaaca3aa64ec3ba612 (DEFAULT_TABLE table=default.Table_59ec796d480b44249426d1dfc637aee5 [id=25fbc7b0afff44d5a0f34eb3be1f50a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.725807 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.725991 1049 raft_consensus.cc:3060] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.726382 986 leader_election.cc:304] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.726616 2816 raft_consensus.cc:2804] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.726702 2816 raft_consensus.cc:697] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:16.726894 2816 consensus_queue.cc:237] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.691968 898 tablet_service.cc:1511] Processing CreateTablet for tablet 481f1729dfb24abcbeb5b1e43fe8151c (DEFAULT_TABLE table=default.Table_c80939a7093c450d9c329f058eb4f6e6 [id=dfe2aabecebe40388adbbe88b6e916d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.665412 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1216) took 1290 ms. Trace:
I20260503 07:53:16.728518 886 rpcz_store.cc:276] 0503 07:53:15.375075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.229755 (+854680us) service_pool.cc:224] Handling call
0503 07:53:16.510966 (+281211us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.510987 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.619162 (+108175us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.665281 (+ 46119us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.665398 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.728828 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c7263a5d258e4f8ab413a1619ac611f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.729029 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 7439917c2a764658bfa8bf62ba67e34f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.729207 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a1f239e33bc42beb9dad004d5b20c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.729367 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 9158409f18204903b0a2203e6bb8b924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.729663 886 tablet_service.cc:1511] Processing CreateTablet for tablet d5a121de0d054f8e884045a11b9dd9af (DEFAULT_TABLE table=default.Table_37f7ff2ff96a48d8a1786b2a10ac567b [id=7f42953f01cb46f3a3aa1c6d6766ad3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.729734 986 leader_election.cc:304] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.730172 986 leader_election.cc:304] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.730424 2862 raft_consensus.cc:2804] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.730553 2862 raft_consensus.cc:697] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:16.730784 2862 consensus_queue.cc:237] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.730794 2915 raft_consensus.cc:2804] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.731055 2915 raft_consensus.cc:697] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:16.731233 2915 consensus_queue.cc:237] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.732825 889 tablet_service.cc:1511] Processing CreateTablet for tablet 39bd6a4378ba4949ac0c0968044bd596 (DEFAULT_TABLE table=default.Table_cb525444d6554724a8ff74e0892ddb33 [id=3dca018a8ded4e53b9941f09861a692a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.455135 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1209) took 1090 ms. Trace:
I20260503 07:53:16.734180 884 rpcz_store.cc:276] 0503 07:53:15.364835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.129538 (+764703us) service_pool.cc:224] Handling call
0503 07:53:16.144723 (+ 15185us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.144741 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:16.447677 (+302936us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.454942 (+ 7265us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:16.455116 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:16.734558 884 tablet_service.cc:1511] Processing CreateTablet for tablet d9d62dfad9f0448faa5ff20d891d65db (DEFAULT_TABLE table=default.Table_f51cbfb98b0c49c5a7b4c1d93174b7f5 [id=0e63b3547291485aa86d4ba2f337be60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.734849 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df60413555764bcab464b18c6a3370ce" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.736827 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:16.736928 854 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:16.737257 905 raft_consensus.cc:3060] T c1c631d3da8f4ec29690c548097a454b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:16.737403 715 consensus_peers.cc:597] T 956600f557b84dac98be63ffe14f4e19 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:16.737807 715 leader_election.cc:343] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.737924 715 leader_election.cc:304] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.738046 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c7a7ad2250a3414aa5167d54c2c90941 (table default.Table_3c3518b900d542d0bbaa3d961fe42977 [id=fc76a5abf5674e2580813d1563626b93]) successfully deleted
W20260503 07:53:16.738246 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet f2de368e66424e4d9edf7c840ac8071e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2de368e66424e4d9edf7c840ac8071e already in progress: creating tablet
W20260503 07:53:16.738384 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5deea77f36d540bb8f721657b7e3500e because the tablet was not found. No further retry: Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
W20260503 07:53:16.738505 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2beb13a5d2844d44a3146d7937c8e964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2beb13a5d2844d44a3146d7937c8e964 already in progress: creating tablet
I20260503 07:53:16.738536 2924 raft_consensus.cc:2749] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:53:16.738620 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0f707cb0257c4d6182ec331a235ba06c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f707cb0257c4d6182ec331a235ba06c already in progress: creating tablet
W20260503 07:53:16.738652 715 leader_election.cc:343] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.738765 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 57261ae6531348d7bdd8deb5dfd980b4 (table default.Table_c2a784fc0e5442e2b8d0b7531248e09f [id=0547c0e8328d4d80b9c343aaec53178d]) successfully deleted
W20260503 07:53:16.738919 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b38735fd577548b192131a769daa1d78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38735fd577548b192131a769daa1d78 already in progress: creating tablet
W20260503 07:53:16.739076 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8dbca27f54064345b374b0cea96ca1c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dbca27f54064345b374b0cea96ca1c4 already in progress: creating tablet
W20260503 07:53:16.739221 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet c5a592a14c3e4659ba81754cbe62c438 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5a592a14c3e4659ba81754cbe62c438 already in progress: creating tablet
I20260503 07:53:16.740998 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa7721278d14e71aeba005d2bd40ecd" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.745995 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a845e02bdb54952806f90d3f7cd9fb2" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:16.698400 880 tablet_service.cc:1511] Processing CreateTablet for tablet b7f0fbfb3737498c81739f9b99eeb69a (DEFAULT_TABLE table=default.Table_c385c133b5ff4ec7bfd4073f7e175538 [id=35c3bd87ad1c43b9a5db159f3ebd3ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.748387 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4424fbafc85e4f559295c2443685c390 (DEFAULT_TABLE table=default.Table_c1bede5f6a154557b54f60570220730c [id=5ad96fa208fe464686b76ffaf0a85ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.748549 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 3650ec1de28c4f1bafd979257dd2b778 (table default.Table_50b3d54db78b4a0fa4c0735349d51cad [id=d778245ff437405896430039f772e652]) successfully deleted
I20260503 07:53:16.750309 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet c9457d5693eb4f3da5501a0e581fe75c (table default.Table_dd7d9967fbc34ca8bcb7afd287593396 [id=5d74e1e18e8b45e88fd4e85b6214c334]) successfully deleted
W20260503 07:53:16.751204 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 78b3210d1ecd42198e080b02a8b594a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3210d1ecd42198e080b02a8b594a5 already in progress: creating tablet
I20260503 07:53:16.626609 887 tablet_service.cc:1511] Processing CreateTablet for tablet ececa26cc216425cb6457978d35644f5 (DEFAULT_TABLE table=default.Table_3d8bfac37e6d4024ae18b044b89bff8c [id=eb164c1de9744ea1b99dcac01a4feea3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:16.756476 715 consensus_peers.cc:597] T 17b547a24cfa4478a90d3035a59a3381 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260503 07:53:16.756690 715 leader_election.cc:343] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.758935 2924 raft_consensus.cc:493] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.759086 2924 raft_consensus.cc:515] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.759344 2912 raft_consensus.cc:493] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.759485 2912 raft_consensus.cc:515] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.759713 2924 leader_election.cc:290] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.759951 2912 leader_election.cc:290] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.760494 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a6050ebde3e741a1b551eecf1f704689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.760921 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c33a99333ae495aab1fb3361b587238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.761281 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeae993f8894649ac780f266b3b4968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.759948 2924 raft_consensus.cc:493] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.761775 2924 raft_consensus.cc:515] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.762243 2924 leader_election.cc:290] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.762400 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f79085c25d43e58f221af146d252cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.762828 895 tablet_service.cc:1511] Processing CreateTablet for tablet 34548b04a8b744a2994bc25d9f5649ed (DEFAULT_TABLE table=default.Table_06bbe98616f24b8ba5461549c8af26d4 [id=c4597d30ba234280ba534b2a02662c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.772073 741 tablet_service.cc:1558] Processing DeleteTablet for tablet be88fd1af300484989dca8658ea5e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.772498 741 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ef0e849f4d4eb299726b2b094a1dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.772886 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cdca8ec33a144e2b44cd9a0c0d61d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.773494 741 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea0110f61ef4a8db59746cfcdd1850a (DEFAULT_TABLE table=default.Table_99baf3ec9d5447008144100f62c5529b [id=8d5ce345426248d29180d43c6d50c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.773948 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea0110f61ef4a8db59746cfcdd1850a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.780907 741 tablet_service.cc:1511] Processing CreateTablet for tablet 538a155055574c25ae45d094cedbed0f (DEFAULT_TABLE table=default.Table_4fb4db2b8ace4ddda4bf4b7b2d861208 [id=9d256c231c10404c9bafd54d0ba42f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.781590 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538a155055574c25ae45d094cedbed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:16.784140 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.784381 1052 raft_consensus.cc:2468] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.787164 2802 raft_consensus.cc:493] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.793896 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8d47da511422d9665326520d35601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.794090 2802 raft_consensus.cc:515] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.794715 2802 leader_election.cc:290] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:16.794857 743 tablet_service.cc:1558] Processing DeleteTablet for tablet f161b32232b7449493fa616794ad07a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.795435 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.795605 1052 raft_consensus.cc:2468] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.797392 1049 raft_consensus.cc:2468] T baa7721278d14e71aeba005d2bd40ecd P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.799136 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.802507 1166 tablet_bootstrap.cc:492] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:16.802656 1166 ts_tablet_manager.cc:1403] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.216s user 0.012s sys 0.000s
I20260503 07:53:16.803483 1166 raft_consensus.cc:359] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.803685 1166 raft_consensus.cc:385] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.803748 1166 raft_consensus.cc:740] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.803968 1166 consensus_queue.cc:260] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.827195 881 tablet_service.cc:1511] Processing CreateTablet for tablet 217c6a1dac20496e98c947c56746fe91 (DEFAULT_TABLE table=default.Table_c876deb5a4444105bbfcbab543509877 [id=e7a06a38336e41e288de8d2e3ca61cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.828715 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.829388 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.829733 2802 raft_consensus.cc:493] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:16.829881 2802 raft_consensus.cc:515] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.829950 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:16.830536 2802 leader_election.cc:290] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:16.831048 715 leader_election.cc:343] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.831290 715 leader_election.cc:343] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.831463 715 leader_election.cc:343] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.831630 715 consensus_peers.cc:597] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:16.835556 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 104974us
W20260503 07:53:16.835947 986 leader_election.cc:343] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.836072 986 leader_election.cc:304] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.836375 2917 raft_consensus.cc:2749] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.836915 1174 ts_tablet_manager.cc:1929] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:16.838451 1174 log.cc:1199] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/64c6dad26de642879307b7dca6ae85f5
W20260503 07:53:16.839385 986 leader_election.cc:343] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.839608 986 leader_election.cc:304] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.840216 2917 raft_consensus.cc:2749] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.841400 1171 tablet_bootstrap.cc:492] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:16.841543 1171 ts_tablet_manager.cc:1403] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.258s user 0.001s sys 0.009s
I20260503 07:53:16.841768 1174 ts_tablet_manager.cc:1950] T 64c6dad26de642879307b7dca6ae85f5 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:16.842849 716 leader_election.cc:304] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.843158 2924 raft_consensus.cc:2804] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.843252 2924 raft_consensus.cc:493] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.843317 2924 raft_consensus.cc:3060] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.843333 716 leader_election.cc:304] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.843696 716 leader_election.cc:304] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.844113 2964 raft_consensus.cc:2804] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.844201 2964 raft_consensus.cc:493] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.844265 2964 raft_consensus.cc:3060] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.844412 2912 raft_consensus.cc:2804] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.844534 2912 raft_consensus.cc:697] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.844799 2912 consensus_queue.cc:237] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.845920 2924 raft_consensus.cc:515] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.846478 2924 leader_election.cc:290] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.846562 2964 raft_consensus.cc:515] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.847008 2964 leader_election.cc:290] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.842674 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:16.847308 1050 raft_consensus.cc:2468] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:16.847693 716 leader_election.cc:304] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.848042 2925 raft_consensus.cc:2804] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:16.848053 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.848114 2925 raft_consensus.cc:493] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:16.848073 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.848199 2925 raft_consensus.cc:3060] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.848220 1052 raft_consensus.cc:3060] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.848244 1050 raft_consensus.cc:3060] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.850593 2925 raft_consensus.cc:515] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.850772 1050 raft_consensus.cc:2468] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.850867 1052 raft_consensus.cc:2468] T b2ef0e849f4d4eb299726b2b094a1dc3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.851125 2925 leader_election.cc:290] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:16.851836 716 leader_election.cc:304] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.852074 716 leader_election.cc:304] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:16.852663 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:16.852802 1049 raft_consensus.cc:3060] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:16.855093 1049 raft_consensus.cc:2468] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:16.855711 2964 raft_consensus.cc:2804] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.855882 2708 raft_consensus.cc:2804] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.855881 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f31f37e97345bb9187865e38ee1d61" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.855962 2708 raft_consensus.cc:697] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.856195 2708 consensus_queue.cc:237] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.856372 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ef0e849f4d4eb299726b2b094a1dc3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.857124 911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ceddd751644d20bcbda15a462d5342" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:16.857211 2964 raft_consensus.cc:697] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
W20260503 07:53:16.857445 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 96756.1us
I20260503 07:53:16.857538 2964 consensus_queue.cc:237] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:16.858551 988 consensus_peers.cc:597] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:16.858711 988 leader_election.cc:343] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.858884 988 leader_election.cc:343] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.859023 988 leader_election.cc:343] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.859169 988 leader_election.cc:343] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.860224 988 leader_election.cc:343] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.860659 988 consensus_peers.cc:597] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:16.861346 988 leader_election.cc:343] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.861496 3000 raft_consensus.cc:493] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:16.861795 3000 raft_consensus.cc:515] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
W20260503 07:53:16.862586 715 leader_election.cc:343] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.862875 715 leader_election.cc:343] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.863219 715 leader_election.cc:343] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.864334 716 leader_election.cc:304] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:16.864593 2608 raft_consensus.cc:2804] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:16.864686 2608 raft_consensus.cc:697] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:16.864879 2608 consensus_queue.cc:237] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.866387 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3e560a7ea14a75b6935ce7593db586 (DEFAULT_TABLE table=default.Table_37a701dfcbd8445493c2a2886382c756 [id=bdae77253b44493b86bc80e27ae72e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.867569 882 tablet_service.cc:1558] Processing DeleteTablet for tablet c2a8057297cc4a16813a545fc2b947d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:16.868299 882 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f8052841d42838ca1df445f275d05 (DEFAULT_TABLE table=default.Table_6787181f2fc0489d974cbf840a50adbe [id=4daec9958e314f7fb789cca6f9b2a502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.755249 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f1d1baa03e6c4c499fd3b49d191bf2ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:16.785094 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 86d052abe9234579b450cc6e92b6ddf6
I20260503 07:53:16.882153 600 catalog_manager.cc:6741] ReplaceTablet: tablet 86d052abe9234579b450cc6e92b6ddf6 deleted and replaced by tablet b378b4d831c64b0683a280159de56a51
W20260503 07:53:16.882347 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d1baa03e6c4c499fd3b49d191bf2ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.882494 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d23e2aa8107a4c61a4925d15108a821d" } new_table_name: "default.Table_620c8ef1baec47c78c909e8097939f99" modify_external_catalogs: true
I20260503 07:53:16.785817 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fec11078918d4d14825cc855928545ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:16.785985 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 63f3cee208e54c8d812ad3dc66b9e932
W20260503 07:53:16.883047 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fec11078918d4d14825cc855928545ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.883275 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ea5323e983964f1b9698637fd9c7568c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.883685 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea5323e983964f1b9698637fd9c7568c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.786684 594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f6e42e25b016431f818e2d8fd9d3c5ba" } modify_external_catalogs: true
I20260503 07:53:16.884639 594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f6e42e25b016431f818e2d8fd9d3c5ba" } modify_external_catalogs: true
I20260503 07:53:16.785833 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_39f0ef7ba18e450e8d9d7e33ef6c1fa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.885234 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39f0ef7ba18e450e8d9d7e33ef6c1fa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.801854 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_99baf3ec9d5447008144100f62c5529b" } new_table_name: "default.Table_a8c3df7af778443b9df5660f019095ce" modify_external_catalogs: true
I20260503 07:53:16.866394 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80eb2da5ac354508bb67257f45284795" } modify_external_catalogs: true
I20260503 07:53:16.886780 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_80eb2da5ac354508bb67257f45284795" } modify_external_catalogs: true
I20260503 07:53:16.890349 3000 leader_election.cc:290] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:16.895895 851 leader_election.cc:343] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 376e9889ca584931ac1d91a9af2c0689
I20260503 07:53:16.896347 851 leader_election.cc:304] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:16.896875 851 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:16.897037 851 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:16.897444 851 leader_election.cc:343] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:16.897605 851 leader_election.cc:304] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:16.898028 851 leader_election.cc:343] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 296541e4c2fc4bc193d6f4cee8e65da0
I20260503 07:53:16.898177 851 leader_election.cc:304] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:16.898608 851 leader_election.cc:343] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:16.898777 851 leader_election.cc:304] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.899433 2990 raft_consensus.cc:2749] T 376e9889ca584931ac1d91a9af2c0689 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.899675 2990 raft_consensus.cc:2749] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:16.899871 2990 raft_consensus.cc:2749] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.900080 2990 raft_consensus.cc:2749] T 296541e4c2fc4bc193d6f4cee8e65da0 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.900487 2990 raft_consensus.cc:2749] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:16.900787 587 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 149579us
I20260503 07:53:16.904026 1166 ts_tablet_manager.cc:1434] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.101s user 0.004s sys 0.000s
I20260503 07:53:16.904346 1166 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:16.904721 1165 tablet_bootstrap.cc:492] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:16.904908 1165 ts_tablet_manager.cc:1403] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.235s user 0.016s sys 0.030s
I20260503 07:53:16.906838 1165 raft_consensus.cc:359] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.907105 1165 raft_consensus.cc:385] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.907213 1165 raft_consensus.cc:740] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.907490 1165 consensus_queue.cc:260] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.908109 1165 ts_tablet_manager.cc:1434] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 07:53:16.908447 1165 tablet_bootstrap.cc:492] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:16.910185 1165 tablet_bootstrap.cc:654] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:16.910516 1171 raft_consensus.cc:359] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.910696 1171 raft_consensus.cc:385] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.910753 1171 raft_consensus.cc:740] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.910950 1171 consensus_queue.cc:260] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.912266 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 with delete_type TABLET_DATA_DELETED (replaced by tablet b378b4d831c64b0683a280159de56a51) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.914620 986 leader_election.cc:304] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.915380 2816 raft_consensus.cc:2749] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.915658 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 969) took 6337 ms. Trace:
I20260503 07:53:16.915809 1174 rpcz_store.cc:276] 0503 07:53:10.578311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.578378 (+ 67us) service_pool.cc:224] Handling call
0503 07:53:16.710046 (+6131668us) ts_tablet_manager.cc:1151] Deleting tablet 64c6dad26de642879307b7dca6ae85f5
0503 07:53:16.710056 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.804936 (+ 94880us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.836303 (+ 31367us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.915639 (+ 79336us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6131471}
I20260503 07:53:16.924158 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 991) took 5849 ms. Trace:
I20260503 07:53:16.925077 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:16.925046 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_eef39281b2734e50aab81f408f1eaa70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:16.925633 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eef39281b2734e50aab81f408f1eaa70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:16.924775 1174 rpcz_store.cc:276] 0503 07:53:11.074273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.075663 (+ 1390us) service_pool.cc:224] Handling call
0503 07:53:16.923375 (+5847712us) ts_tablet_manager.cc:1151] Deleting tablet 949c2dc3bcb144578739aec2ea066fdf
0503 07:53:16.923386 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.924019 (+ 633us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5847448}
W20260503 07:53:16.925751 986 leader_election.cc:343] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.926579 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 993) took 5852 ms. Trace:
I20260503 07:53:16.926672 1174 rpcz_store.cc:276] 0503 07:53:11.074442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.075844 (+ 1402us) service_pool.cc:224] Handling call
0503 07:53:16.926400 (+5850556us) ts_tablet_manager.cc:1151] Deleting tablet 0bffda3cc5e8484ea1666c788a11a6a3
0503 07:53:16.926410 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.926542 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5850406}
I20260503 07:53:16.926551 986 leader_election.cc:304] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.927414 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 983) took 5853 ms. Trace:
I20260503 07:53:16.927578 1174 rpcz_store.cc:276] 0503 07:53:11.073598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.076353 (+ 2755us) service_pool.cc:224] Handling call
0503 07:53:16.927212 (+5850859us) ts_tablet_manager.cc:1151] Deleting tablet 2f9a23702aa5493ea8712f904af96755
0503 07:53:16.927222 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.927358 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5850635}
I20260503 07:53:16.928218 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 999) took 5807 ms. Trace:
I20260503 07:53:16.928155 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_8e07bd717fe1461494b19abec87c60c1" } new_table_name: "default.Table_739dc5964ec340578d982f126c869c63" modify_external_catalogs: true
I20260503 07:53:16.928390 1174 rpcz_store.cc:276] 0503 07:53:11.120568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.699796 (+579228us) service_pool.cc:224] Handling call
0503 07:53:16.927956 (+5228160us) ts_tablet_manager.cc:1151] Deleting tablet 35ca011a011a44ad9447f2d5b19a63ba
0503 07:53:16.928062 (+ 106us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.928202 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5227909}
I20260503 07:53:16.929215 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1000) took 5808 ms. Trace:
I20260503 07:53:16.929428 2816 raft_consensus.cc:2749] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.929409 1174 rpcz_store.cc:276] 0503 07:53:11.120688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.700068 (+579380us) service_pool.cc:224] Handling call
0503 07:53:16.929066 (+5228998us) ts_tablet_manager.cc:1151] Deleting tablet 6c615cb123224ceda51d68d5980a2323
0503 07:53:16.929077 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.929199 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5228754}
I20260503 07:53:16.929929 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1021) took 5723 ms. Trace:
I20260503 07:53:16.930115 1174 rpcz_store.cc:276] 0503 07:53:11.206156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.730829 (+524673us) service_pool.cc:224] Handling call
0503 07:53:16.929801 (+5198972us) ts_tablet_manager.cc:1151] Deleting tablet 5eb48844c2a04b5e8b6f73b9986127ee
0503 07:53:16.929833 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.929914 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5198767}
I20260503 07:53:16.930584 1174 tablet_replica.cc:333] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:16.931526 1174 raft_consensus.cc:2243] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:16.937618 1165 tablet_bootstrap.cc:492] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:16.937820 1165 ts_tablet_manager.cc:1403] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.004s
I20260503 07:53:16.938146 1174 raft_consensus.cc:2272] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:16.937937 986 leader_election.cc:343] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.938593 1165 raft_consensus.cc:359] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.938774 1165 raft_consensus.cc:385] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:16.938854 1165 raft_consensus.cc:740] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:16.939071 1165 consensus_queue.cc:260] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:16.939630 1165 ts_tablet_manager.cc:1434] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:16.939906 1165 tablet_bootstrap.cc:492] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:16.939404 986 leader_election.cc:304] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.942446 2987 raft_consensus.cc:2749] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.945001 1174 ts_tablet_manager.cc:1916] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:16.952719 986 leader_election.cc:343] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.955565 2999 tablet.cc:1724] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:16.953960 986 leader_election.cc:304] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.956480 1171 ts_tablet_manager.cc:1434] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.115s user 0.001s sys 0.001s
I20260503 07:53:16.956779 1171 tablet_bootstrap.cc:492] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:16.958375 1171 tablet_bootstrap.cc:654] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:16.960935 851 leader_election.cc:343] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 61316b7a521e42a59bf955179b080f40
I20260503 07:53:16.961104 851 leader_election.cc:304] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:16.962381 851 leader_election.cc:343] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5ce16dd96cf04ae293601108381a2a47
I20260503 07:53:16.962548 2708 consensus_queue.cc:1048] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:16.966318 851 leader_election.cc:304] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.966889 2988 raft_consensus.cc:2749] T 5ce16dd96cf04ae293601108381a2a47 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.962659 2997 raft_consensus.cc:2749] T 61316b7a521e42a59bf955179b080f40 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.922390 888 tablet_service.cc:1511] Processing CreateTablet for tablet cb2f595922f64b658fbc8d4c71add546 (DEFAULT_TABLE table=default.Table_f001df33442b490ea5a1b97fbca5f4f8 [id=d5e013d9707d458bbafa78f50a155105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:16.958601 2987 raft_consensus.cc:2749] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:16.862125 988 leader_election.cc:343] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:16.975119 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 112991us
W20260503 07:53:16.962688 986 leader_election.cc:343] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.975962 986 leader_election.cc:304] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.976591 2987 raft_consensus.cc:2749] T 7b90ec3eb3894c18825ebe5fb79fa5be P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:16.979138 988 leader_election.cc:343] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:16.985919 1174 ts_tablet_manager.cc:1929] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:16.986578 1174 log.cc:1199] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/2be28ad252ff47879caa1021fdf5db66
I20260503 07:53:16.989423 2862 consensus_queue.cc:1048] T b4df94a7071f472c8962206d51c44429 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:16.989480 1174 ts_tablet_manager.cc:1950] T 2be28ad252ff47879caa1021fdf5db66 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:16.967722 851 leader_election.cc:343] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:16.990602 851 leader_election.cc:304] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.991132 851 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:16.991374 2997 raft_consensus.cc:2749] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:16.996642 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1022) took 5790 ms. Trace:
I20260503 07:53:16.998469 1165 tablet_bootstrap.cc:654] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:17.000437 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b769c5cb48d147fd82aac92492b18af6 consensus state has no leader
W20260503 07:53:17.002768 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ea0110f61ef4a8db59746cfcdd1850a consensus state has no leader
I20260503 07:53:17.003240 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 64c6dad26de642879307b7dca6ae85f5 (table default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]) successfully deleted
W20260503 07:53:17.003607 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 949c2dc3bcb144578739aec2ea066fdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949c2dc3bcb144578739aec2ea066fdf already in progress: creating tablet
W20260503 07:53:17.003908 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 0bffda3cc5e8484ea1666c788a11a6a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bffda3cc5e8484ea1666c788a11a6a3 already in progress: creating tablet
W20260503 07:53:17.004208 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2f9a23702aa5493ea8712f904af96755 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f9a23702aa5493ea8712f904af96755 already in progress: creating tablet
W20260503 07:53:17.004573 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 35ca011a011a44ad9447f2d5b19a63ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ca011a011a44ad9447f2d5b19a63ba already in progress: creating tablet
W20260503 07:53:17.005136 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6c615cb123224ceda51d68d5980a2323 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c615cb123224ceda51d68d5980a2323 already in progress: creating tablet
W20260503 07:53:17.005818 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5eb48844c2a04b5e8b6f73b9986127ee because the tablet was not found. No further retry: Not found: Tablet not found: 5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:53:17.006275 598 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 6a845e02bdb54952806f90d3f7cd9fb2 (table default.Table_14a08dabe9314680b800b584272ace6b [id=62580342c555493caaba1c75cf31eadf]). Expected version 2 got 0
I20260503 07:53:17.007200 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e5559d16a8e243dab7cd61db43c0d0c2" } new_table_name: "default.Table_de76f437c87a45deb4dbfccb52dcb632" modify_external_catalogs: true
I20260503 07:53:17.008472 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b519db3a4e724196a866ea51ea0b86f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.009070 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b519db3a4e724196a866ea51ea0b86f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.009652 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet b5bdaa3dd3a844d8b57def2b9faa03d8 (table default.Table_e163878262b2436381f0eb9403e7acce [id=b9f8cf1c443f4792931934c1552feb06]) successfully deleted
I20260503 07:53:17.010372 592 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7052813ac0e842698977de0865a32a09" } modify_external_catalogs: true
I20260503 07:53:17.010514 592 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7052813ac0e842698977de0865a32a09" } modify_external_catalogs: true
I20260503 07:53:17.011051 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_3d7b1b9c33424c509c2224c3d4266ecb" } new_table_name: "default.Table_5f2b954a75e54ff7b8b445acf1cb5a18" modify_external_catalogs: true
I20260503 07:53:16.997505 1174 rpcz_store.cc:276] 0503 07:53:11.206226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.731060 (+524834us) service_pool.cc:224] Handling call
0503 07:53:16.930515 (+5199455us) ts_tablet_manager.cc:1151] Deleting tablet 2be28ad252ff47879caa1021fdf5db66
0503 07:53:16.930547 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.968802 (+ 38255us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.985520 (+ 16718us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:16.996010 (+ 10490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199258}
I20260503 07:53:17.012398 1174 tablet_replica.cc:333] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.012610 1174 raft_consensus.cc:2243] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.012964 1174 raft_consensus.cc:2272] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.013558 1174 ts_tablet_manager.cc:1916] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:17.016840 586 consensus_peers.cc:597] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874 -> Peer cd4eda3aaddc4d46a7e8b24b782a7e5c (127.0.105.61:41759): Couldn't send request to peer cd4eda3aaddc4d46a7e8b24b782a7e5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.61:41759: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 07:53:17.024971 715 consensus_peers.cc:597] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.025816 2997 raft_consensus.cc:2749] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260503 07:53:17.026435 851 leader_election.cc:343] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:17.026621 851 leader_election.cc:304] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.026906 2997 raft_consensus.cc:2749] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:17.027916 851 leader_election.cc:343] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5c30f15ad13340c89df3f5c8d65d63c7
I20260503 07:53:17.028115 851 leader_election.cc:304] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.028904 2997 raft_consensus.cc:2749] T 5c30f15ad13340c89df3f5c8d65d63c7 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:17.028580 988 leader_election.cc:343] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:17.031538 851 leader_election.cc:343] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: a117f416c611418a96963db600da1d04
I20260503 07:53:17.032477 851 leader_election.cc:304] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.033579 2997 raft_consensus.cc:2749] T a117f416c611418a96963db600da1d04 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:17.039177 986 leader_election.cc:343] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.042481 986 leader_election.cc:304] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.047068 851 leader_election.cc:304] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.047726 2987 raft_consensus.cc:2749] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:17.048027 988 leader_election.cc:343] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.048875 1171 tablet_bootstrap.cc:492] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.050766 1171 ts_tablet_manager.cc:1403] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260503 07:53:17.051820 1171 raft_consensus.cc:359] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.054454 1171 raft_consensus.cc:385] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.054507 1171 raft_consensus.cc:740] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:17.051796 986 leader_election.cc:343] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.057873 1174 ts_tablet_manager.cc:1929] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260503 07:53:17.058712 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 19055009ccee4912868eb09094d5e0c5 consensus state has no leader
I20260503 07:53:17.062963 596 catalog_manager.cc:5671] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:17.063434 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:17.065915 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9a7af140ce144bc8b2e147dad98ac201
I20260503 07:53:17.060510 1171 consensus_queue.cc:260] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.086355 1171 ts_tablet_manager.cc:1434] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260503 07:53:17.088227 1171 tablet_bootstrap.cc:492] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.092269 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec0b36fdcf64042bc87446977b9dcca" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.092758 2997 raft_consensus.cc:2749] T 6a845e02bdb54952806f90d3f7cd9fb2 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.093104 2997 raft_consensus.cc:493] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
W20260503 07:53:17.093653 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 46821.8us
W20260503 07:53:17.094496 851 leader_election.cc:343] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:17.095165 851 leader_election.cc:304] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.096709 2988 raft_consensus.cc:2749] T e662fd10883b401c8f0d4a45735e2639 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:17.091450 986 leader_election.cc:304] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.099639 2987 raft_consensus.cc:2749] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.100327 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.104681 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 2be28ad252ff47879caa1021fdf5db66 (table default.Table_b15c133b67274af2aadcda424ddb5ed7 [id=a448d69588b945efb94698de1acb0565]) successfully deleted
W20260503 07:53:17.106201 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 55195.3us
I20260503 07:53:17.093318 2997 raft_consensus.cc:515] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.109948 2997 leader_election.cc:290] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.112028 2987 consensus_queue.cc:1048] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.082952 2608 consensus_queue.cc:1048] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.083566 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:17.114533 715 consensus_peers.cc:597] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.114764 1174 log.cc:1199] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/db13f91ef1d740c387bacbb689ddf1a8
I20260503 07:53:17.116631 2608 consensus_queue.cc:1048] T 1cdca8ec33a144e2b44cd9a0c0d61d93 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.117368 1174 ts_tablet_manager.cc:1950] T db13f91ef1d740c387bacbb689ddf1a8 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.117406 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 with delete_type TABLET_DATA_DELETED (replaced by tablet b378b4d831c64b0683a280159de56a51) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:17.117249 986 leader_election.cc:343] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.125095 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.124763 986 leader_election.cc:304] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.128541 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.129657 2987 raft_consensus.cc:2749] T 7346da7e4cf147528f16d9ecfdb86c33 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.134821 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d2b114c9425a4bb282bf4e119705dfa9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.135406 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b114c9425a4bb282bf4e119705dfa9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.136389 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_3f182695451a4d33ba5f605d385c7d66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.136777 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f182695451a4d33ba5f605d385c7d66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.140815 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_0128dcc99f864f339ff3d691fa227789"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.141263 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0128dcc99f864f339ff3d691fa227789 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:17.142437 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d1c78b3870e4c1e83e9a0625dd3624d consensus state has no leader
I20260503 07:53:17.142745 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6e11ba9c722c484597b0a43360dc2d28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.143146 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e11ba9c722c484597b0a43360dc2d28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:17.144892 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25c586dc2fb74270a9669de65e2328b0 consensus state has no leader
I20260503 07:53:17.148412 594 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 477d24ea5c8c42e1a8614f30859e36df
I20260503 07:53:17.149559 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1024) took 5943 ms. Trace:
I20260503 07:53:17.152532 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 03ab0202f6ef4999a7746b3faef6f5b6 (DEFAULT_TABLE table=default.Table_c0e84285a25e4efa9bc713326e77dc16 [id=00787394e03d4e76b3bc76f704e16cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.152953 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ab0202f6ef4999a7746b3faef6f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:17.162371 986 leader_election.cc:343] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.164578 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 257bd97e53254034a76e699d8926e21e (DEFAULT_TABLE table=default.Table_e8b61a046c0640179d065f67343c831e [id=475502d115d7404e962af53729e1214b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.165215 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257bd97e53254034a76e699d8926e21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.168826 1174 rpcz_store.cc:276] 0503 07:53:11.206372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.731512 (+525140us) service_pool.cc:224] Handling call
0503 07:53:17.012342 (+5280830us) ts_tablet_manager.cc:1151] Deleting tablet db13f91ef1d740c387bacbb689ddf1a8
0503 07:53:17.012356 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.055076 (+ 42720us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.057826 (+ 2750us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.149536 (+ 91710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5280636}
I20260503 07:53:17.168951 986 leader_election.cc:304] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.171356 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb (DEFAULT_TABLE table=default.Table_b9c58f8cbe354c10a6610555b12af3eb [id=3b66adf0ef774692aa2ae47293a1be1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.171698 2987 raft_consensus.cc:2749] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.171777 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.173425 1030 tablet_service.cc:1511] Processing CreateTablet for tablet dd5ce350ddb947328d4b173dae9b8e11 (DEFAULT_TABLE table=default.Table_cb43255a95cc4b09bf75bd57ae756fc0 [id=f823b167a2e5487086be003638bdebc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.173782 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5ce350ddb947328d4b173dae9b8e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.178277 1174 tablet_replica.cc:333] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.182497 1174 raft_consensus.cc:2243] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.186045 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 477d24ea5c8c42e1a8614f30859e36df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.188490 1174 raft_consensus.cc:2272] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.189476 986 leader_election.cc:304] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:17.193523 1174 ts_tablet_manager.cc:1916] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.194799 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5528f495ce534d989a0e370549c8f528
I20260503 07:53:17.201870 2987 raft_consensus.cc:2804] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.201952 2987 raft_consensus.cc:493] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.202006 2987 raft_consensus.cc:3060] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.204842 2987 raft_consensus.cc:515] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.205370 2987 leader_election.cc:290] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.209657 1171 tablet_bootstrap.cc:654] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.215231 2908 consensus_queue.cc:1048] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.218117 747 tablet_service.cc:1511] Processing CreateTablet for tablet 257bd97e53254034a76e699d8926e21e (DEFAULT_TABLE table=default.Table_e8b61a046c0640179d065f67343c831e [id=475502d115d7404e962af53729e1214b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.218144 741 tablet_service.cc:1511] Processing CreateTablet for tablet 03ab0202f6ef4999a7746b3faef6f5b6 (DEFAULT_TABLE table=default.Table_c0e84285a25e4efa9bc713326e77dc16 [id=00787394e03d4e76b3bc76f704e16cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.218559 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257bd97e53254034a76e699d8926e21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.218813 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ab0202f6ef4999a7746b3faef6f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.219084 743 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb (DEFAULT_TABLE table=default.Table_b9c58f8cbe354c10a6610555b12af3eb [id=3b66adf0ef774692aa2ae47293a1be1a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:17.219164 715 consensus_peers.cc:597] T 722411278ae148d5b3d082d95683d12a P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.219388 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.222465 2997 raft_consensus.cc:493] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:17.222605 2997 raft_consensus.cc:515] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.223151 2997 leader_election.cc:290] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.223448 2997 raft_consensus.cc:493] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:17.223544 2997 raft_consensus.cc:515] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.223950 2997 leader_election.cc:290] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.225664 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528f495ce534d989a0e370549c8f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:17.227588 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec0b36fdcf64042bc87446977b9dcca" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.228456 748 tablet_service.cc:1511] Processing CreateTablet for tablet dd5ce350ddb947328d4b173dae9b8e11 (DEFAULT_TABLE table=default.Table_cb43255a95cc4b09bf75bd57ae756fc0 [id=f823b167a2e5487086be003638bdebc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.228857 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5ce350ddb947328d4b173dae9b8e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.230949 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.232299 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 477d24ea5c8c42e1a8614f30859e36df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:17.232419 758 tablet_service.cc:1511] Processing CreateTablet for tablet 64e4347cef16419f806765f3bf677e59 (DEFAULT_TABLE table=default.Table_b6c0addc188a4a49a17ad33a8f48d12d [id=aec86f653a7849adb7ec16c85e1a99da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.232748 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e4347cef16419f806765f3bf677e59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:17.232497 988 leader_election.cc:343] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.235733 1165 tablet_bootstrap.cc:492] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:17.235854 1165 ts_tablet_manager.cc:1403] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.296s user 0.011s sys 0.000s
I20260503 07:53:17.236534 2964 raft_consensus.cc:493] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.236634 2964 raft_consensus.cc:515] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.236670 1165 raft_consensus.cc:359] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.236824 1165 raft_consensus.cc:385] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.236877 1165 raft_consensus.cc:740] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.237064 1165 consensus_queue.cc:260] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.237229 2964 leader_election.cc:290] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:17.237532 1165 ts_tablet_manager.cc:1434] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:17.237818 1165 tablet_bootstrap.cc:492] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:17.238775 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.238970 1051 raft_consensus.cc:2468] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:17.236980 988 leader_election.cc:343] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.239351 1165 tablet_bootstrap.cc:654] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.239573 716 leader_election.cc:304] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.239914 2908 raft_consensus.cc:2804] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.240015 2908 raft_consensus.cc:493] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.240108 2908 raft_consensus.cc:3060] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.241425 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.243968 2908 raft_consensus.cc:515] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:17.244467 715 leader_election.cc:343] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.261193 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:17.261382 767 raft_consensus.cc:3060] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.263509 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.263679 1051 raft_consensus.cc:3060] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.263976 767 raft_consensus.cc:2468] T f376fbfbfd804ffcad30dcd55b7afc6a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 1.
I20260503 07:53:17.264575 2908 leader_election.cc:290] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:17.264885 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2683448c3f4df3bb0b14683d8b5222" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:17.265404 715 leader_election.cc:343] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.266011 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376fbfbfd804ffcad30dcd55b7afc6a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:17.275388 2862 raft_consensus.cc:493] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.275552 2862 raft_consensus.cc:515] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.276196 2862 leader_election.cc:290] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.278455 1171 tablet_bootstrap.cc:492] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.278589 1171 ts_tablet_manager.cc:1403] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.191s user 0.006s sys 0.002s
I20260503 07:53:17.278841 1051 raft_consensus.cc:2468] T ea2683448c3f4df3bb0b14683d8b5222 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.279078 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528f495ce534d989a0e370549c8f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.279505 716 leader_election.cc:304] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:17.280306 2908 raft_consensus.cc:2804] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.280598 2908 raft_consensus.cc:697] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.280886 2908 consensus_queue.cc:237] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.281710 1171 raft_consensus.cc:359] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.282192 1171 raft_consensus.cc:385] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.282410 1171 raft_consensus.cc:740] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:17.286978 854 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 1bf42130a55744429d2c64ed55671507
I20260503 07:53:17.289052 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb82179b8b845da88125aa9f32bb9fd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.290904 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 64e4347cef16419f806765f3bf677e59 (DEFAULT_TABLE table=default.Table_b6c0addc188a4a49a17ad33a8f48d12d [id=aec86f653a7849adb7ec16c85e1a99da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.291958 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e4347cef16419f806765f3bf677e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.300266 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 16aa59d4fdd94bdd82a441af4d665f2c (DEFAULT_TABLE table=default.Table_69cd921a9fd947eeab7249ecdfb5f4cc [id=aa7b4a7abf9b46c6bf68b5af2faf328e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.300464 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 86cee3f40f75423780bc320dbac4bf3c (DEFAULT_TABLE table=default.Table_4432dff538f34ccfa5ff09ffa927936d [id=80baba4e4cec471ca7158fe63075e95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.300653 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16aa59d4fdd94bdd82a441af4d665f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.300801 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86cee3f40f75423780bc320dbac4bf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.300269 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9656dfbaad40359a7ff4dc58b76e71 (DEFAULT_TABLE table=default.Table_917ca0375c9a46e3804a45aba6641d83 [id=58db6c4ebcc141e0af42a02acc44f5c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.304129 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9656dfbaad40359a7ff4dc58b76e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.304200 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb82179b8b845da88125aa9f32bb9fd" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:17.305970 988 leader_election.cc:343] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.309115 913 raft_consensus.cc:3060] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:17.315745 854 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: aef746161e6b446ab0d299d37e2151ea
I20260503 07:53:17.316057 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e68de86584803a449d63609f4b2c5 (DEFAULT_TABLE table=default.Table_0481de2191144ffc98fc266f156c0f72 [id=e03bda0e8eaa44f49d76c03efbf9e905]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.316622 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e68de86584803a449d63609f4b2c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:17.320307 986 leader_election.cc:343] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.319207 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 079289f87d4d41b5a9482b581a8b7ef6 (DEFAULT_TABLE table=default.Table_93743c6156a74284a1bc22666cb227da [id=ee967f6e41204bd3a40c1d7def3d390d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.322422 986 leader_election.cc:304] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.324683 1165 tablet_bootstrap.cc:492] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:17.324818 1165 ts_tablet_manager.cc:1403] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.000s
I20260503 07:53:17.325491 1165 raft_consensus.cc:359] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.325664 1165 raft_consensus.cc:385] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.325714 1165 raft_consensus.cc:740] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.325915 1165 consensus_queue.cc:260] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.326364 2862 raft_consensus.cc:2749] T cec0b36fdcf64042bc87446977b9dcca P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.326442 1165 ts_tablet_manager.cc:1434] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:17.326732 1165 tablet_bootstrap.cc:492] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:17.327008 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079289f87d4d41b5a9482b581a8b7ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.329784 2862 raft_consensus.cc:493] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.329949 2862 raft_consensus.cc:515] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.330544 2862 leader_election.cc:290] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.283025 1171 consensus_queue.cc:260] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.336005 2908 raft_consensus.cc:493] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.336047 2997 raft_consensus.cc:493] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a924c2134c54fa0bb164825da53bdd0)
I20260503 07:53:17.336124 2908 raft_consensus.cc:515] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.336195 2997 raft_consensus.cc:515] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.336757 2908 leader_election.cc:290] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.336911 2997 leader_election.cc:290] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.337329 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.337373 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.337488 1049 raft_consensus.cc:2468] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:17.337880 716 leader_election.cc:304] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.338152 2908 raft_consensus.cc:2804] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.338213 2908 raft_consensus.cc:493] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.338276 2908 raft_consensus.cc:3060] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:17.334583 986 leader_election.cc:343] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.339395 986 leader_election.cc:304] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.339812 2862 raft_consensus.cc:2749] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.340669 2908 raft_consensus.cc:515] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:17.341563 715 leader_election.cc:343] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.342188 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.342319 1049 raft_consensus.cc:3060] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.342314 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11304c2f96f4518bedc07c23af81f50" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:17.343972 1171 ts_tablet_manager.cc:1434] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.065s user 0.004s sys 0.000s
I20260503 07:53:17.344615 1049 raft_consensus.cc:2468] T c11304c2f96f4518bedc07c23af81f50 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.345037 716 leader_election.cc:304] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.345274 2925 raft_consensus.cc:2804] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.345372 2925 raft_consensus.cc:697] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.345562 2925 consensus_queue.cc:237] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.345603 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8354f765ffc44d5aafbbfcbd93fe795e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.346117 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8354f765ffc44d5aafbbfcbd93fe795e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.346419 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_56f922fc85dd426ba4e06b6e29bd0c66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.346563 715 leader_election.cc:343] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:17.346818 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56f922fc85dd426ba4e06b6e29bd0c66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.347224 2908 leader_election.cc:290] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.347975 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1fa913322e01470c9941e894f6a75e75" } modify_external_catalogs: true
I20260503 07:53:17.350634 2987 raft_consensus.cc:493] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.350765 2987 raft_consensus.cc:515] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.351332 2987 leader_election.cc:290] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.357385 1165 tablet_bootstrap.cc:654] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:17.364049 988 leader_election.cc:343] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.365763 2997 raft_consensus.cc:493] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:17.365921 2997 raft_consensus.cc:515] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.366532 2997 leader_election.cc:290] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:17.366891 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 42c82dbdf98947fca0b8aaa9f47f13db (table default.Table_868eb376b61f485b8831572b35e6f606 [id=51d560668ca44003adb4451c0c69b70a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 42c82dbdf98947fca0b8aaa9f47f13db consensus state has no leader
I20260503 07:53:17.382206 1171 tablet_bootstrap.cc:492] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.387997 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.388975 758 tablet_service.cc:1511] Processing CreateTablet for tablet 079289f87d4d41b5a9482b581a8b7ef6 (DEFAULT_TABLE table=default.Table_93743c6156a74284a1bc22666cb227da [id=ee967f6e41204bd3a40c1d7def3d390d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.389400 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079289f87d4d41b5a9482b581a8b7ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.390574 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1efb53c5e184a618316a759b8e7d38e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.392105 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1fa913322e01470c9941e894f6a75e75" } modify_external_catalogs: true
I20260503 07:53:17.392189 592 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb
I20260503 07:53:17.396143 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_80d0e570c9f248a58f7c014824dcc3c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.396714 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80d0e570c9f248a58f7c014824dcc3c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.399652 2925 consensus_queue.cc:1048] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.400267 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ec0807d8f4dd447fb9870d3327bd93cc" } new_table_name: "default.Table_ca2623cc71274d698f8bb0751b58276b" modify_external_catalogs: true
I20260503 07:53:17.402455 2925 raft_consensus.cc:493] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.402588 2925 raft_consensus.cc:515] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.403134 2925 leader_election.cc:290] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:17.403600 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.403980 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.404179 1051 raft_consensus.cc:2468] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:17.404686 715 leader_election.cc:343] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.405112 716 leader_election.cc:304] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:17.405650 2925 raft_consensus.cc:2804] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.405726 2925 raft_consensus.cc:493] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.405790 2925 raft_consensus.cc:3060] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.407742 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet db13f91ef1d740c387bacbb689ddf1a8 (table default.Table_e4ae69024f594a199dc5ccabcf7cdddb [id=040b2bdef1584c959f5b5f1f2eaa8429]) successfully deleted
W20260503 07:53:17.408422 715 consensus_peers.cc:597] T 9a7af140ce144bc8b2e147dad98ac201 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260503 07:53:17.408844 2925 raft_consensus.cc:515] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.409883 748 tablet_service.cc:1511] Processing CreateTablet for tablet 16aa59d4fdd94bdd82a441af4d665f2c (DEFAULT_TABLE table=default.Table_69cd921a9fd947eeab7249ecdfb5f4cc [id=aa7b4a7abf9b46c6bf68b5af2faf328e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.410053 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:17.410286 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16aa59d4fdd94bdd82a441af4d665f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.412443 743 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9656dfbaad40359a7ff4dc58b76e71 (DEFAULT_TABLE table=default.Table_917ca0375c9a46e3804a45aba6641d83 [id=58db6c4ebcc141e0af42a02acc44f5c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.412725 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9656dfbaad40359a7ff4dc58b76e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.415755 747 tablet_service.cc:1511] Processing CreateTablet for tablet 86cee3f40f75423780bc320dbac4bf3c (DEFAULT_TABLE table=default.Table_4432dff538f34ccfa5ff09ffa927936d [id=80baba4e4cec471ca7158fe63075e95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.416080 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86cee3f40f75423780bc320dbac4bf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.420912 986 leader_election.cc:304] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:17.426492 2987 raft_consensus.cc:2804] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.426642 2987 raft_consensus.cc:697] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:17.426905 2987 consensus_queue.cc:237] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.426874 758 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e68de86584803a449d63609f4b2c5 (DEFAULT_TABLE table=default.Table_0481de2191144ffc98fc266f156c0f72 [id=e03bda0e8eaa44f49d76c03efbf9e905]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.428531 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.428697 1051 raft_consensus.cc:3060] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.431605 1051 raft_consensus.cc:2468] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.432230 716 leader_election.cc:304] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.432694 2908 raft_consensus.cc:2804] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.432788 2908 raft_consensus.cc:697] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.432983 2908 consensus_queue.cc:237] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.434000 1165 tablet_bootstrap.cc:492] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:17.434145 1165 ts_tablet_manager.cc:1403] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.107s user 0.000s sys 0.003s
I20260503 07:53:17.434891 1165 raft_consensus.cc:359] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.435030 1165 raft_consensus.cc:385] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.435133 1165 raft_consensus.cc:740] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.435318 1165 consensus_queue.cc:260] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.435930 1165 ts_tablet_manager.cc:1434] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:17.436198 1165 tablet_bootstrap.cc:492] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:17.436880 1175 ts_tablet_manager.cc:1929] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:17.436993 1175 log.cc:1199] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/5e9d50a71c1a4bf799de34af1064597d
I20260503 07:53:17.437345 1175 ts_tablet_manager.cc:1950] T 5e9d50a71c1a4bf799de34af1064597d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.427652 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e68de86584803a449d63609f4b2c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:17.439131 988 leader_election.cc:343] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:17.439311 988 leader_election.cc:343] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.439688 1165 tablet_bootstrap.cc:654] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.440075 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:17.441464 986 leader_election.cc:343] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.441586 986 leader_election.cc:304] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.442260 2916 raft_consensus.cc:2749] T 2fb82179b8b845da88125aa9f32bb9fd P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.445417 1174 ts_tablet_manager.cc:1929] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.445524 1174 log.cc:1199] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/e2dcbb5010e346fca99dffdbdbb337f4
I20260503 07:53:17.445883 1174 ts_tablet_manager.cc:1950] T e2dcbb5010e346fca99dffdbdbb337f4 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.445946 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_16176b61076a48f2aca2c31b5e457323"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.446552 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16176b61076a48f2aca2c31b5e457323 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.446657 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1025) took 6240 ms. Trace:
I20260503 07:53:17.446746 1174 rpcz_store.cc:276] 0503 07:53:11.206432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.731723 (+525291us) service_pool.cc:224] Handling call
0503 07:53:17.178224 (+5446501us) ts_tablet_manager.cc:1151] Deleting tablet e2dcbb5010e346fca99dffdbdbb337f4
0503 07:53:17.178237 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.437479 (+259242us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.445372 (+ 7893us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.446637 (+ 1265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5446321}
I20260503 07:53:17.447129 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1026) took 6240 ms. Trace:
I20260503 07:53:17.447206 1174 rpcz_store.cc:276] 0503 07:53:11.206493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.731915 (+525422us) service_pool.cc:224] Handling call
0503 07:53:17.447020 (+5715105us) ts_tablet_manager.cc:1151] Deleting tablet 8c25addae8c94554a83344f07a11362f
0503 07:53:17.447031 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.447112 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5714921}
I20260503 07:53:17.447444 1174 tablet_replica.cc:333] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.447619 1174 raft_consensus.cc:2243] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.447908 1174 raft_consensus.cc:2272] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.449925 2925 leader_election.cc:290] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:17.450227 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54aaadc3d22437286303caac65c7cb4" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:17.450726 715 leader_election.cc:343] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:17.450975 829 tablet.cc:2404] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260503 07:53:17.464748 1101 tablet.cc:2404] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260503 07:53:17.487257 854 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: efbf07a603be411895839aece99fa78c
W20260503 07:53:17.487649 854 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 64c6dad26de642879307b7dca6ae85f5
W20260503 07:53:17.490921 988 consensus_peers.cc:597] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260503 07:53:17.500347 715 consensus_peers.cc:597] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.506271 1171 tablet_bootstrap.cc:654] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.499508 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet e2dcbb5010e346fca99dffdbdbb337f4 (table default.Table_9ae6c84f1a8340a9858fbed22de8d5bf [id=d50c9bf0f6634d9da120d9ca7265b9b7]) successfully deleted
I20260503 07:53:17.508365 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1170) took 5595 ms. Trace:
I20260503 07:53:17.508459 1175 rpcz_store.cc:276] 0503 07:53:11.913106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.350421 (+437315us) service_pool.cc:224] Handling call
0503 07:53:16.393998 (+4043577us) ts_tablet_manager.cc:1151] Deleting tablet 5e9d50a71c1a4bf799de34af1064597d
0503 07:53:16.413473 (+ 19475us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.483958 (+ 70485us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.436805 (+952847us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.508342 (+ 71537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70138,"tablet-delete.queue_time_us":4043393}
I20260503 07:53:17.508863 1175 tablet_replica.cc:333] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.509080 1175 raft_consensus.cc:2243] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.509352 1175 raft_consensus.cc:2272] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:17.509132 585 catalog_manager.cc:4969] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8c25addae8c94554a83344f07a11362f because the tablet was not found. No further retry: Not found: Tablet not found: 8c25addae8c94554a83344f07a11362f
I20260503 07:53:17.509917 1175 ts_tablet_manager.cc:1916] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.516466 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]) successfully deleted
I20260503 07:53:17.518585 2862 raft_consensus.cc:493] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.518793 2862 raft_consensus.cc:515] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.519474 2862 leader_election.cc:290] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.521909 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bde0d32a0648f885503259d5ab3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.522092 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffacb1497a724fcaaca3aa64ec3ba612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.522508 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f595922f64b658fbc8d4c71add546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.524297 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481f1729dfb24abcbeb5b1e43fe8151c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.524636 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34548b04a8b744a2994bc25d9f5649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.524966 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec174cc59cf401bb58460eb91eadd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.527208 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ececa26cc216425cb6457978d35644f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.528371 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7c6a20531e484b997e666f47a34976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.529179 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0fffe2c1964f27b64e5f6b9bf62fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.532260 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f0fbfb3737498c81739f9b99eeb69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.533609 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1280) took 1078 ms. Trace:
I20260503 07:53:17.537361 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_640cca1d1d6b403b83ee91f29f629f22" } new_table_name: "default.Table_dbbd6408455f4eaa9a772b5b7d85d445" modify_external_catalogs: true
I20260503 07:53:17.550858 3056 tablet.cc:1724] T 0a08da2052f5482792c8b3294e9b7332 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:17.554495 1165 tablet_bootstrap.cc:492] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:17.554678 1165 ts_tablet_manager.cc:1403] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.119s user 0.004s sys 0.000s
I20260503 07:53:17.555557 1165 raft_consensus.cc:359] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.555796 1165 raft_consensus.cc:385] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.555866 1165 raft_consensus.cc:740] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.563160 1174 ts_tablet_manager.cc:1916] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.536268 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3e560a7ea14a75b6935ce7593db586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.568305 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a121de0d054f8e884045a11b9dd9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.577349 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1279) took 1121 ms. Trace:
I20260503 07:53:17.537066 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:17.541587 854 leader_election.cc:343] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: bf51c959093d4579a5916c49e1790737
W20260503 07:53:17.578150 854 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 56749914e1a349f0876f52157affdf69
W20260503 07:53:17.580132 988 leader_election.cc:343] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.578703 898 rpcz_store.cc:276] 0503 07:53:16.455429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.691730 (+236301us) service_pool.cc:224] Handling call
0503 07:53:16.728394 (+ 36664us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.728413 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.574717 (+846304us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.577202 (+ 2485us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.577330 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:53:17.581434 851 service_pool.cc:136] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items [suppressed 13 similar messages]
I20260503 07:53:17.581511 851 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:39898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1309)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1310)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1311)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1312)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1313)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1314)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1315)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1316)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1317)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1318)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1319)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1320)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1321)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1322)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1323)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1324)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1325)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1326)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1327)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1328)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1329)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1330)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1331)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1332)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1333)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1334)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1335)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1336)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1337)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1338)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1339)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1340)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1341)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1342)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1343)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1344)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1345)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1346)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1347)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1348)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1349)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1350)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1351)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 1352)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1357)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1353)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1354)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1355)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1356)
I20260503 07:53:17.563513 891 rpcz_store.cc:276] 0503 07:53:16.455531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.695439 (+239908us) service_pool.cc:224] Handling call
0503 07:53:16.695815 (+ 376us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.695835 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.531127 (+835292us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.533439 (+ 2312us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.533590 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.583412 891 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6d7e50111d4e7ab01a7f3149a55379 (DEFAULT_TABLE table=default.Table_b5eef1ddf8be416fbf3acc015a033854 [id=6a2ef296925944128884f4d6575949d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.583706 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf51c959093d4579a5916c49e1790737" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.585389 2988 raft_consensus.cc:493] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
W20260503 07:53:17.585286 851 leader_election.cc:343] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 1bf42130a55744429d2c64ed55671507
W20260503 07:53:17.585564 714 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.0.105.61:41759, user_credentials={real_user=slave}} blocked reactor thread for 88099.3us
I20260503 07:53:17.587661 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.587918 2608 consensus_queue.cc:1048] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.588158 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1efb53c5e184a618316a759b8e7d38e" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.590392 1171 tablet_bootstrap.cc:492] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.590539 1171 ts_tablet_manager.cc:1403] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.210s user 0.005s sys 0.001s
I20260503 07:53:17.591341 1171 raft_consensus.cc:359] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.591511 1171 raft_consensus.cc:385] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.591557 1171 raft_consensus.cc:740] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.591737 1171 consensus_queue.cc:260] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.592957 2608 consensus_queue.cc:1048] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.593608 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_b4c599303f71469d9bbcb9477bda1b8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.594182 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4c599303f71469d9bbcb9477bda1b8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.595633 1171 ts_tablet_manager.cc:1434] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260503 07:53:17.596799 1171 tablet_bootstrap.cc:492] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.598870 1171 tablet_bootstrap.cc:654] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.601588 596 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_86a6421c8e9145449dc4483b0fd936b3 [id=dbdd7a759dc44fffb0dc1211d97713ca] alter complete (version 1)
W20260503 07:53:17.602470 596 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.1:41325 (request call id 189) took 964 ms (client timeout 1000 ms). Trace:
W20260503 07:53:17.602562 596 rpcz_store.cc:269] 0503 07:53:16.637934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.641867 (+ 3933us) service_pool.cc:224] Handling call
0503 07:53:17.602449 (+960582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:17.344740 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:17.346761 (+ 2021us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:17.346769 (+ 8us) write_op.cc:435] Acquired schema lock
0503 07:53:17.346773 (+ 4us) tablet.cc:662] Decoding operations
0503 07:53:17.346956 (+ 183us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:17.346966 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:17.346971 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:17.347069 (+ 98us) tablet.cc:701] Row locks acquired
0503 07:53:17.347071 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:17.347118 (+ 47us) write_op.cc:270] Start()
0503 07:53:17.347412 (+ 294us) write_op.cc:276] Timestamp: P: 1777794797347078 usec, L: 0
0503 07:53:17.360309 (+ 12897us) op_driver.cc:348] REPLICATION: starting
0503 07:53:17.360647 (+ 338us) log.cc:844] Serialized 527 byte log entry
0503 07:53:17.364291 (+ 3644us) op_driver.cc:464] REPLICATION: finished
0503 07:53:17.364459 (+ 168us) write_op.cc:301] APPLY: starting
0503 07:53:17.364476 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:17.364517 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:17.364548 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:17.364604 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:17.364640 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:17.364650 (+ 10us) write_op.cc:312] APPLY: finished
0503 07:53:17.364725 (+ 75us) log.cc:844] Serialized 23 byte log entry
0503 07:53:17.364781 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:17.364801 (+ 20us) write_op.cc:454] Released schema lock
0503 07:53:17.364809 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:17.364883 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:17.364888 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:17.595638 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:17.595935 (+ 297us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:17.595942 (+ 7us) write_op.cc:435] Acquired schema lock
0503 07:53:17.595946 (+ 4us) tablet.cc:662] Decoding operations
0503 07:53:17.596221 (+ 275us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:17.596280 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:17.596288 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:17.596794 (+ 506us) tablet.cc:701] Row locks acquired
0503 07:53:17.596799 (+ 5us) write_op.cc:260] PREPARE: finished
0503 07:53:17.596961 (+ 162us) write_op.cc:270] Start()
0503 07:53:17.597089 (+ 128us) write_op.cc:276] Timestamp: P: 1777794797596934 usec, L: 0
0503 07:53:17.597096 (+ 7us) op_driver.cc:348] REPLICATION: starting
0503 07:53:17.597514 (+ 418us) log.cc:844] Serialized 356 byte log entry
0503 07:53:17.600749 (+ 3235us) op_driver.cc:464] REPLICATION: finished
0503 07:53:17.600971 (+ 222us) write_op.cc:301] APPLY: starting
0503 07:53:17.600990 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:17.601050 (+ 60us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:17.601081 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:17.601146 (+ 65us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:17.601188 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:17.601199 (+ 11us) write_op.cc:312] APPLY: finished
0503 07:53:17.601283 (+ 84us) log.cc:844] Serialized 23 byte log entry
0503 07:53:17.601347 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:17.601368 (+ 21us) write_op.cc:454] Released schema lock
0503 07:53:17.601377 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":118,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":413,"num_ops":1,"prepare.queue_time_us":273906,"prepare.run_cpu_time_us":1046,"prepare.run_wall_time_us":17417,"raft.queue_time_us":88,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":267,"replication_time_us":3949}],["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":1,"prepare.queue_time_us":224912,"raft.queue_time_us":134,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":1564,"replication_time_us":3618}]]}
I20260503 07:53:17.608721 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e1efb53c5e184a618316a759b8e7d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.556114 1165 consensus_queue.cc:260] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.617847 1165 ts_tablet_manager.cc:1434] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.063s user 0.002s sys 0.000s
I20260503 07:53:17.618180 1165 tablet_bootstrap.cc:492] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:17.622629 1171 tablet_bootstrap.cc:492] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.625028 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_63cc09a4856c4cc08931aa979733076a" } new_table_name: "default.Table_e3e0b03821b8462eb3438302013eda36" modify_external_catalogs: true
I20260503 07:53:17.625520 1171 ts_tablet_manager.cc:1403] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
W20260503 07:53:17.636595 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 122924us
I20260503 07:53:17.536485 1173 ts_tablet_manager.cc:1929] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:17.642347 1173 log.cc:1199] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/5a178957514e4f77afe8a1879b57a96b
I20260503 07:53:17.642693 1173 ts_tablet_manager.cc:1950] T 5a178957514e4f77afe8a1879b57a96b P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:17.577682 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c33a99333ae495aab1fb3361b587238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.585520 2988 raft_consensus.cc:515] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.599327 896 tablet_service.cc:1511] Processing CreateTablet for tablet 53ac8ebc0f1843b689c90f22448dd9f4 (DEFAULT_TABLE table=default.Table_578fbd130e20482fa133085f79be8f91 [id=f6bde052c50c46198161802521e04302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.556344 885 tablet_service.cc:1511] Processing CreateTablet for tablet 7c98a0c2688e412b952f40cf8324ae25 (DEFAULT_TABLE table=default.Table_417934ccc822402683f4260861be498c [id=7aef35a9b8c743169a4b009dad21e60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.599602 898 tablet_service.cc:1511] Processing CreateTablet for tablet 939d2af7fc3c4c8495043484c7435d6b (DEFAULT_TABLE table=default.Table_3856e2648e8b44cfbf93659c8e183931 [id=ec2c1f5da0f94af583617f405c944a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.608237 894 tablet_service.cc:1511] Processing CreateTablet for tablet 20cdab298eec48ab93f842106bfdb63a (DEFAULT_TABLE table=default.Table_6b85f9b0c8a34996b7dde81cda8493bb [id=09f81da09f2d4153bf85a42ac86cc309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.643671 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f8052841d42838ca1df445f275d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.643878 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4424fbafc85e4f559295c2443685c390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.643967 851 leader_election.cc:304] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.644181 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d62dfad9f0448faa5ff20d891d65db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.644670 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217c6a1dac20496e98c947c56746fe91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.645424 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b7352e1f84a5b92f08a1bcb23ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.645713 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bd6a4378ba4949ac0c0968044bd596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.646255 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6d7e50111d4e7ab01a7f3149a55379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.642534 1171 raft_consensus.cc:359] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.656929 1171 raft_consensus.cc:385] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.657013 1171 raft_consensus.cc:740] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.657677 3056 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47074 (request call id 1428) took 1305 ms. Trace:
I20260503 07:53:17.658325 3068 tablet.cc:1724] T 0a08da2052f5482792c8b3294e9b7332 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:17.659758 1174 ts_tablet_manager.cc:1929] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.659869 1174 log.cc:1199] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/4de65c754b47440a914f3f2bdb86059c
I20260503 07:53:17.660295 1174 ts_tablet_manager.cc:1950] T 4de65c754b47440a914f3f2bdb86059c P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.660580 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:17.661360 1171 consensus_queue.cc:260] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.663627 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1023) took 6457 ms. Trace:
I20260503 07:53:17.663715 1174 rpcz_store.cc:276] 0503 07:53:11.206311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.731273 (+524962us) service_pool.cc:224] Handling call
0503 07:53:17.447404 (+5716131us) ts_tablet_manager.cc:1151] Deleting tablet 4de65c754b47440a914f3f2bdb86059c
0503 07:53:17.447412 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.602262 (+154850us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.659706 (+ 57444us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.663609 (+ 3903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":5713262}
I20260503 07:53:17.664800 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1036) took 6424 ms. Trace:
I20260503 07:53:17.664880 1174 rpcz_store.cc:276] 0503 07:53:11.240451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.793601 (+553150us) service_pool.cc:224] Handling call
0503 07:53:17.664011 (+5870410us) ts_tablet_manager.cc:1151] Deleting tablet b1450c6bc197438fb8f26418c1aae4a5
0503 07:53:17.664020 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.664784 (+ 764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":5619678}
I20260503 07:53:17.665220 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1037) took 6394 ms. Trace:
I20260503 07:53:17.665287 1174 rpcz_store.cc:276] 0503 07:53:11.270929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:11.875332 (+604403us) service_pool.cc:224] Handling call
0503 07:53:17.665114 (+5789782us) ts_tablet_manager.cc:1151] Deleting tablet 8c0bcb9ab72a482ca07447ff392ae49d
0503 07:53:17.665124 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.665193 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5619828}
I20260503 07:53:17.665570 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1055) took 5620 ms. Trace:
I20260503 07:53:17.665633 1174 rpcz_store.cc:276] 0503 07:53:12.045053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.531509 (+486456us) service_pool.cc:224] Handling call
0503 07:53:17.665491 (+5133982us) ts_tablet_manager.cc:1151] Deleting tablet 23b8c1768a15487ba9140acd77c4ff7b
0503 07:53:17.665499 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.665559 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5133824}
I20260503 07:53:17.665889 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1059) took 5303 ms. Trace:
I20260503 07:53:17.665953 1174 rpcz_store.cc:276] 0503 07:53:12.362028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.558849 (+196821us) service_pool.cc:224] Handling call
0503 07:53:17.665810 (+5106961us) ts_tablet_manager.cc:1151] Deleting tablet 63a44b834b1e44a99c2cd3f9747ca13f
0503 07:53:17.665818 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.665878 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5106813}
I20260503 07:53:17.666172 1165 tablet_bootstrap.cc:654] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.666213 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1060) took 5286 ms. Trace:
I20260503 07:53:17.666287 1174 rpcz_store.cc:276] 0503 07:53:12.379884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.559017 (+179133us) service_pool.cc:224] Handling call
0503 07:53:17.666134 (+5107117us) ts_tablet_manager.cc:1151] Deleting tablet 5c23434f3d8f44e581c2ed73aa045d96
0503 07:53:17.666141 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.666201 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5106973}
I20260503 07:53:17.666527 1174 tablet_replica.cc:333] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.666699 1174 raft_consensus.cc:2243] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.666882 1174 raft_consensus.cc:2272] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.657826 3056 rpcz_store.cc:276] 0503 07:53:16.351916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.351963 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:17.657662 (+1305699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:16.352321 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0503 07:53:16.352412 (+ 91us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0503 07:53:16.352421 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0503 07:53:16.352427 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0503 07:53:16.352458 (+ 31us) alter_schema_op.cc:128] START. Timestamp: 1777794796352350
0503 07:53:16.352461 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:16.352656 (+ 195us) log.cc:844] Serialized 173 byte log entry
0503 07:53:17.500476 (+1147820us) op_driver.cc:464] REPLICATION: finished
0503 07:53:17.550788 (+ 50312us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0503 07:53:17.552148 (+ 1360us) log.cc:844] Serialized 5 byte log entry
0503 07:53:17.657191 (+105043us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.657425 (+ 234us) log.cc:844] Serialized 14 byte log entry
0503 07:53:17.657620 (+ 195us) alter_schema_op.cc:73] Released schema lock
0503 07:53:17.657627 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":50201,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":12071,"prepare.run_wall_time_us":27338,"raft.queue_time_us":35,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":161,"replication_time_us":1147976,"thread_start_us":73665,"threads_started":2,"wal-append.queue_time_us":21579,"wal-append.run_cpu_time_us":392,"wal-append.run_wall_time_us":1000452}]]}
I20260503 07:53:17.674829 1175 ts_tablet_manager.cc:1929] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.675020 1175 log.cc:1199] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/314f539af5e44f048ff42619fcda1943
I20260503 07:53:17.675536 1175 ts_tablet_manager.cc:1950] T 314f539af5e44f048ff42619fcda1943 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.676373 2644 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.61:41759
I20260503 07:53:17.674317 1171 ts_tablet_manager.cc:1434] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260503 07:53:17.676695 1171 tablet_bootstrap.cc:492] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.678210 1174 ts_tablet_manager.cc:1916] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.678562 2644 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/master-1/data/info.pb
I20260503 07:53:17.676110 3071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.61:41759 every 8 connection(s)
I20260503 07:53:17.679854 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1171) took 5766 ms. Trace:
I20260503 07:53:17.680294 593 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 79225c2dd80e41bf93ad2fa023b2a427
I20260503 07:53:17.680207 1175 rpcz_store.cc:276] 0503 07:53:11.913398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.350622 (+437224us) service_pool.cc:224] Handling call
0503 07:53:17.508810 (+5158188us) ts_tablet_manager.cc:1151] Deleting tablet 314f539af5e44f048ff42619fcda1943
0503 07:53:17.508821 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.588367 (+ 79546us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.674778 (+ 86411us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.679837 (+ 5059us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5158065}
I20260503 07:53:17.680080 1171 tablet_bootstrap.cc:654] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.681782 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1176) took 5660 ms. Trace:
I20260503 07:53:17.682727 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 314f539af5e44f048ff42619fcda1943 (table default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]) successfully deleted
I20260503 07:53:17.683390 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:17.685294 1175 rpcz_store.cc:276] 0503 07:53:12.021748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.392765 (+371017us) service_pool.cc:224] Handling call
0503 07:53:17.681662 (+5288897us) ts_tablet_manager.cc:1151] Deleting tablet 56d5a84f62f446c488a7e02be814a26c
0503 07:53:17.681669 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.681766 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5288769}
I20260503 07:53:17.685652 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1177) took 5663 ms. Trace:
I20260503 07:53:17.685750 1175 rpcz_store.cc:276] 0503 07:53:12.021861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.392905 (+371044us) service_pool.cc:224] Handling call
0503 07:53:17.685537 (+5292632us) ts_tablet_manager.cc:1151] Deleting tablet 471d979edca2476bb5787319a442603a
0503 07:53:17.685548 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.685631 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5292493}
I20260503 07:53:17.686045 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1180) took 5663 ms. Trace:
I20260503 07:53:17.686200 1175 rpcz_store.cc:276] 0503 07:53:12.022176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.416850 (+394674us) service_pool.cc:224] Handling call
0503 07:53:17.685964 (+5269114us) ts_tablet_manager.cc:1151] Deleting tablet bda89822863d4f70bc6f115dc2f808c8
0503 07:53:17.685971 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.686032 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5268932}
W20260503 07:53:17.686293 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 56d5a84f62f446c488a7e02be814a26c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56d5a84f62f446c488a7e02be814a26c already in progress: creating tablet
I20260503 07:53:17.686573 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1191) took 5498 ms. Trace:
W20260503 07:53:17.686589 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 471d979edca2476bb5787319a442603a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 471d979edca2476bb5787319a442603a already in progress: creating tablet
I20260503 07:53:17.686658 1175 rpcz_store.cc:276] 0503 07:53:12.188500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.451448 (+262948us) service_pool.cc:224] Handling call
0503 07:53:17.686475 (+5235027us) ts_tablet_manager.cc:1151] Deleting tablet 9648cf6a6c774c05a427a5c1344bfb77
0503 07:53:17.686483 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.686555 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5234862}
I20260503 07:53:17.686911 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1192) took 5480 ms. Trace:
I20260503 07:53:17.686970 1175 rpcz_store.cc:276] 0503 07:53:12.206636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.451624 (+244988us) service_pool.cc:224] Handling call
0503 07:53:17.686840 (+5235216us) ts_tablet_manager.cc:1151] Deleting tablet b56ee573586b49d596592c32c509969f
0503 07:53:17.686846 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.686900 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5235119}
W20260503 07:53:17.687340 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet bda89822863d4f70bc6f115dc2f808c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda89822863d4f70bc6f115dc2f808c8 already in progress: creating tablet
W20260503 07:53:17.687551 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9648cf6a6c774c05a427a5c1344bfb77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9648cf6a6c774c05a427a5c1344bfb77 already in progress: creating tablet
W20260503 07:53:17.687773 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet b56ee573586b49d596592c32c509969f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b56ee573586b49d596592c32c509969f already in progress: creating tablet
I20260503 07:53:17.687923 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskCEB381/build/asan/bin/kudu as pid 2644
I20260503 07:53:17.696125 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1193) took 5420 ms. Trace:
I20260503 07:53:17.696237 1175 rpcz_store.cc:276] 0503 07:53:12.276012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.451731 (+175719us) service_pool.cc:224] Handling call
0503 07:53:17.696028 (+5244297us) ts_tablet_manager.cc:1151] Deleting tablet 6e5283673660476eb689d41ef0daa2d0
0503 07:53:17.696035 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.696110 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5244209}
W20260503 07:53:17.696623 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6e5283673660476eb689d41ef0daa2d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e5283673660476eb689d41ef0daa2d0 already in progress: creating tablet
I20260503 07:53:17.697073 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1194) took 5420 ms. Trace:
I20260503 07:53:17.697142 1175 rpcz_store.cc:276] 0503 07:53:12.276128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.451825 (+175697us) service_pool.cc:224] Handling call
0503 07:53:17.696954 (+5245129us) ts_tablet_manager.cc:1151] Deleting tablet 9b0edcd3617b4c73a419b382492a23aa
0503 07:53:17.696962 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.697060 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5245044}
W20260503 07:53:17.697970 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 9b0edcd3617b4c73a419b382492a23aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b0edcd3617b4c73a419b382492a23aa already in progress: creating tablet
I20260503 07:53:17.700466 1175 tablet_replica.cc:333] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.700742 1175 raft_consensus.cc:2243] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.700937 1175 raft_consensus.cc:2272] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.701572 1175 ts_tablet_manager.cc:1916] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:17.702283 986 leader_election.cc:343] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.702402 986 leader_election.cc:304] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.703058 2987 raft_consensus.cc:2749] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:17.703524 986 leader_election.cc:343] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.703636 986 leader_election.cc:304] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.703949 2987 raft_consensus.cc:2749] T e1efb53c5e184a618316a759b8e7d38e P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.709209 3056 tablet.cc:1724] T 5ba5f770a448465491160fc72f66a830 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:17.709733 1171 tablet_bootstrap.cc:492] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.709862 1171 ts_tablet_manager.cc:1403] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.002s
I20260503 07:53:17.710608 1171 raft_consensus.cc:359] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.710765 1171 raft_consensus.cc:385] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.710896 1171 raft_consensus.cc:740] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.711267 1171 consensus_queue.cc:260] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.711786 1171 ts_tablet_manager.cc:1434] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:17.712071 1171 tablet_bootstrap.cc:492] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.713686 1171 tablet_bootstrap.cc:654] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.716315 2608 raft_consensus.cc:493] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.716447 2608 raft_consensus.cc:515] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.717007 2608 leader_election.cc:290] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.717798 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.717972 1052 raft_consensus.cc:2468] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:17.719466 1175 ts_tablet_manager.cc:1929] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.719548 1175 log.cc:1199] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/1ae4a39d4e3a42db816e592123a6a2e7
I20260503 07:53:17.719853 1175 ts_tablet_manager.cc:1950] T 1ae4a39d4e3a42db816e592123a6a2e7 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.722061 716 leader_election.cc:304] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.722416 2608 raft_consensus.cc:2804] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.722514 2608 raft_consensus.cc:493] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.722608 2608 raft_consensus.cc:3060] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:17.722723 986 leader_election.cc:343] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:17.722812 986 leader_election.cc:304] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.723158 2987 raft_consensus.cc:2749] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:17.725176 2608 raft_consensus.cc:515] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.727344 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.727555 1052 raft_consensus.cc:3060] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.730710 1052 raft_consensus.cc:2468] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.730911 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1195) took 5387 ms. Trace:
I20260503 07:53:17.730988 1175 rpcz_store.cc:276] 0503 07:53:12.343591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.451912 (+108321us) service_pool.cc:224] Handling call
0503 07:53:17.700409 (+5248497us) ts_tablet_manager.cc:1151] Deleting tablet 1ae4a39d4e3a42db816e592123a6a2e7
0503 07:53:17.700420 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.713394 (+ 12974us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.719427 (+ 6033us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.730894 (+ 11467us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5248388}
I20260503 07:53:17.731410 716 leader_election.cc:304] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.731410 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 1ae4a39d4e3a42db816e592123a6a2e7 (table default.Table_a6a85043cd814a5d8d17300cc43be157 [id=c5d1c3d4bc32495a9966899ba145e3cb]) successfully deleted
I20260503 07:53:17.731479 1175 tablet_replica.cc:333] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.731544 1174 ts_tablet_manager.cc:1929] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:17.731631 2924 raft_consensus.cc:493] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.731673 1175 raft_consensus.cc:2243] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.731784 2924 raft_consensus.cc:515] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.731952 1175 raft_consensus.cc:2272] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.732288 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a15db5ec7f114d89bb16c146360e3b3f" } modify_external_catalogs: true
I20260503 07:53:17.732370 2924 leader_election.cc:290] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.732451 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a15db5ec7f114d89bb16c146360e3b3f" } modify_external_catalogs: true
I20260503 07:53:17.732482 1175 ts_tablet_manager.cc:1916] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.732498 2924 raft_consensus.cc:2804] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.732611 2924 raft_consensus.cc:697] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.732874 2924 consensus_queue.cc:237] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.735364 2912 consensus_queue.cc:1048] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.739171 2988 leader_election.cc:290] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.740686 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.740914 1052 raft_consensus.cc:2468] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:17.741330 716 leader_election.cc:304] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.741662 2912 raft_consensus.cc:2804] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.741778 2912 raft_consensus.cc:493] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.741874 2912 raft_consensus.cc:3060] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.745357 2912 raft_consensus.cc:515] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.746543 2912 leader_election.cc:290] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.747107 2608 leader_election.cc:290] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.748059 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.748337 1052 raft_consensus.cc:3060] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.757534 1052 raft_consensus.cc:2468] T 855100ffa19d4fe7a92ae13ca5171adb P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.757987 716 leader_election.cc:304] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.758363 2608 raft_consensus.cc:2804] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.758528 2608 raft_consensus.cc:697] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.758818 2608 consensus_queue.cc:237] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:17.762537 988 consensus_peers.cc:597] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.762931 2708 raft_consensus.cc:493] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.763093 2708 raft_consensus.cc:515] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.763226 1175 ts_tablet_manager.cc:1929] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.763310 1175 log.cc:1199] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/e2dcbb5010e346fca99dffdbdbb337f4
I20260503 07:53:17.763612 1175 ts_tablet_manager.cc:1950] T e2dcbb5010e346fca99dffdbdbb337f4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.763706 2708 leader_election.cc:290] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.764323 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1200) took 5107 ms. Trace:
I20260503 07:53:17.764394 1175 rpcz_store.cc:276] 0503 07:53:12.656557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.656665 (+ 108us) service_pool.cc:224] Handling call
0503 07:53:17.731434 (+5074769us) ts_tablet_manager.cc:1151] Deleting tablet e2dcbb5010e346fca99dffdbdbb337f4
0503 07:53:17.731444 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.736678 (+ 5234us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.763179 (+ 26501us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.764305 (+ 1126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5074545}
I20260503 07:53:17.764819 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1199) took 5108 ms. Trace:
I20260503 07:53:17.764880 1175 rpcz_store.cc:276] 0503 07:53:12.656472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.656982 (+ 510us) service_pool.cc:224] Handling call
0503 07:53:17.764738 (+5107756us) ts_tablet_manager.cc:1151] Deleting tablet 29fe06a56f70487ea7c479b107d83d8b
0503 07:53:17.764746 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.764806 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5107570}
I20260503 07:53:17.765936 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet e2dcbb5010e346fca99dffdbdbb337f4 (table default.Table_9ae6c84f1a8340a9858fbed22de8d5bf [id=d50c9bf0f6634d9da120d9ca7265b9b7]) successfully deleted
W20260503 07:53:17.766224 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 29fe06a56f70487ea7c479b107d83d8b because the tablet was not found. No further retry: Not found: Tablet not found: 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:17.766539 1175 tablet_replica.cc:333] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.766717 1175 raft_consensus.cc:2243] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.766878 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26032d89839340988fce30f458e785fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.766947 1175 raft_consensus.cc:2272] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.767134 1051 raft_consensus.cc:2468] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:17.767478 1175 ts_tablet_manager.cc:1916] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.767725 716 leader_election.cc:304] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.767952 2964 raft_consensus.cc:2804] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.768045 2964 raft_consensus.cc:493] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.768126 2964 raft_consensus.cc:3060] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.771297 2964 raft_consensus.cc:515] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.772296 2964 leader_election.cc:290] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.772884 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26032d89839340988fce30f458e785fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.773128 1051 raft_consensus.cc:3060] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.774731 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 925) took 8749 ms. Trace:
I20260503 07:53:17.774816 1173 rpcz_store.cc:276] 0503 07:53:09.025043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.025322 (+ 279us) service_pool.cc:224] Handling call
0503 07:53:16.659712 (+7634390us) ts_tablet_manager.cc:1151] Deleting tablet 5a178957514e4f77afe8a1879b57a96b
0503 07:53:16.659722 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:16.717231 (+ 57509us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.536439 (+819208us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.774714 (+238275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36534,"tablet-delete.queue_time_us":7634212}
I20260503 07:53:17.775192 1173 tablet_replica.cc:333] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:17.775357 1173 raft_consensus.cc:2243] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.775460 1175 ts_tablet_manager.cc:1929] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.775477 1173 raft_consensus.cc:2272] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.775537 1175 log.cc:1199] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/2be28ad252ff47879caa1021fdf5db66
I20260503 07:53:17.775853 1175 ts_tablet_manager.cc:1950] T 2be28ad252ff47879caa1021fdf5db66 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.775929 1173 ts_tablet_manager.cc:1916] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.775972 1051 raft_consensus.cc:2468] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.776386 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ac8ebc0f1843b689c90f22448dd9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.776485 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1197) took 5120 ms. Trace:
I20260503 07:53:17.776558 2908 raft_consensus.cc:493] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.776625 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c98a0c2688e412b952f40cf8324ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.776551 1175 rpcz_store.cc:276] 0503 07:53:12.656231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.658026 (+ 1795us) service_pool.cc:224] Handling call
0503 07:53:17.765830 (+5107804us) ts_tablet_manager.cc:1151] Deleting tablet 2be28ad252ff47879caa1021fdf5db66
0503 07:53:17.766504 (+ 674us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.770525 (+ 4021us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.775422 (+ 4897us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.776470 (+ 1048us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5107560}
I20260503 07:53:17.776676 2908 raft_consensus.cc:515] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.776784 1175 tablet_replica.cc:333] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.776831 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939d2af7fc3c4c8495043484c7435d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.776926 1175 raft_consensus.cc:2243] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.777032 1175 raft_consensus.cc:2272] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.777180 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cdab298eec48ab93f842106bfdb63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.777189 2908 leader_election.cc:290] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.777396 716 leader_election.cc:304] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.777482 1175 ts_tablet_manager.cc:1916] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.777740 2908 raft_consensus.cc:2804] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.777871 2908 raft_consensus.cc:697] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.778096 2908 consensus_queue.cc:237] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.778487 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 2be28ad252ff47879caa1021fdf5db66 (table default.Table_b15c133b67274af2aadcda424ddb5ed7 [id=a448d69588b945efb94698de1acb0565]) successfully deleted
I20260503 07:53:17.778782 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1301) took 1114 ms. Trace:
I20260503 07:53:17.778855 892 rpcz_store.cc:276] 0503 07:53:16.664364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.866001 (+201637us) service_pool.cc:224] Handling call
0503 07:53:16.866682 (+ 681us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.866714 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.566657 (+699943us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.751980 (+185323us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.778768 (+ 26788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.779181 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1294) took 1186 ms. Trace:
I20260503 07:53:17.731652 1174 log.cc:1199] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/5e9d50a71c1a4bf799de34af1064597d
I20260503 07:53:17.779235 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1300) took 1115 ms. Trace:
I20260503 07:53:17.779255 886 rpcz_store.cc:276] 0503 07:53:16.592670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.729507 (+136837us) service_pool.cc:224] Handling call
0503 07:53:16.729918 (+ 411us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.729938 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.571227 (+841289us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.752147 (+180920us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.779166 (+ 27019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.779302 881 rpcz_store.cc:276] 0503 07:53:16.664270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.826879 (+162609us) service_pool.cc:224] Handling call
0503 07:53:16.875417 (+ 48538us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.875447 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.758366 (+882919us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.761743 (+ 3377us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.779218 (+ 17475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.779548 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:17.779628 1174 ts_tablet_manager.cc:1950] T 5e9d50a71c1a4bf799de34af1064597d P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.779680 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1266) took 1607 ms. Trace:
I20260503 07:53:17.779692 1049 raft_consensus.cc:2468] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:17.779765 887 rpcz_store.cc:276] 0503 07:53:16.171771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.626416 (+454645us) service_pool.cc:224] Handling call
0503 07:53:16.753240 (+126824us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.753276 (+ 36us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.529949 (+776673us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.619800 (+ 89851us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.779668 (+159868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.780036 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1304) took 1115 ms. Trace:
I20260503 07:53:17.780233 716 leader_election.cc:304] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.780412 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1089) took 5229 ms. Trace:
I20260503 07:53:17.780948 2925 raft_consensus.cc:2804] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:17.780941 1174 rpcz_store.cc:276] 0503 07:53:12.551308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.721308 (+170000us) service_pool.cc:224] Handling call
0503 07:53:17.666488 (+4945180us) ts_tablet_manager.cc:1151] Deleting tablet 5e9d50a71c1a4bf799de34af1064597d
0503 07:53:17.666496 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.728550 (+ 62054us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.731481 (+ 2931us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.780371 (+ 48890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4944974}
I20260503 07:53:17.781069 2925 raft_consensus.cc:493] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:17.781158 2925 raft_consensus.cc:3060] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.781250 1174 tablet_replica.cc:333] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.781430 1174 raft_consensus.cc:2243] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.781577 1174 raft_consensus.cc:2272] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.781515 888 rpcz_store.cc:276] 0503 07:53:16.664642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.922060 (+257418us) service_pool.cc:224] Handling call
0503 07:53:16.968059 (+ 45999us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.968094 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.525628 (+557534us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.616708 (+ 91080us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.780024 (+163316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.782039 1174 ts_tablet_manager.cc:1916] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.784811 1166 tablet_bootstrap.cc:654] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.784858 2925 raft_consensus.cc:515] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.784988 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c33a99333ae495aab1fb3361b587238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.785583 2925 leader_election.cc:290] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:17.785362 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeae993f8894649ac780f266b3b4968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.786441 888 tablet_service.cc:1558] Processing DeleteTablet for tablet be88fd1af300484989dca8658ea5e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.786489 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:17.786547 1171 tablet_bootstrap.cc:492] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.786643 1050 raft_consensus.cc:3060] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:17.786671 1171 ts_tablet_manager.cc:1403] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20260503 07:53:17.789183 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c56e8742f614c4a89c913a415cbb1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.789182 1050 raft_consensus.cc:2468] T d08b5135cb77444bb5ff35c5f9d68129 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:17.789841 1171 raft_consensus.cc:359] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.789986 1171 raft_consensus.cc:385] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.790030 1171 raft_consensus.cc:740] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.790201 1171 consensus_queue.cc:260] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.790622 1171 ts_tablet_manager.cc:1434] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:17.790756 716 leader_election.cc:304] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:17.790846 1171 tablet_bootstrap.cc:492] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.791165 2708 raft_consensus.cc:2804] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:17.791316 2708 raft_consensus.cc:697] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:17.791599 2708 consensus_queue.cc:237] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.792495 1171 tablet_bootstrap.cc:654] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.795063 886 tablet_service.cc:1558] Processing DeleteTablet for tablet a6050ebde3e741a1b551eecf1f704689 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:15 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.795488 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8d47da511422d9665326520d35601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:17.796352 988 consensus_peers.cc:597] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.796334 881 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea0110f61ef4a8db59746cfcdd1850a (DEFAULT_TABLE table=default.Table_99baf3ec9d5447008144100f62c5529b [id=8d5ce345426248d29180d43c6d50c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.796638 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea0110f61ef4a8db59746cfcdd1850a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.796998 886 tablet_service.cc:1558] Processing DeleteTablet for tablet f161b32232b7449493fa616794ad07a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.794503 892 tablet_service.cc:1511] Processing CreateTablet for tablet c44b8094c42441fd8dcf10baa6ba2bd9 (DEFAULT_TABLE table=default.Table_3561bb0d844c4640b2e28ee803269589 [id=1ec18c51cb4d4a73ac960dad530bb039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.802138 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44b8094c42441fd8dcf10baa6ba2bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.803550 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 26032d89839340988fce30f458e785fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.806720 2997 raft_consensus.cc:2749] T 1bf42130a55744429d2c64ed55671507 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:17.806954 2997 raft_consensus.cc:493] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:17.807134 2997 raft_consensus.cc:515] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.807837 2997 leader_election.cc:290] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:17.810679 758 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:17.810921 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:17.811394 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 4de65c754b47440a914f3f2bdb86059c (table default.Table_c2d55c4df0b54958ba726afe40ebaa0b [id=b1a0841eeeab4df58c436f38252a4725]) successfully deleted
W20260503 07:53:17.811652 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b1450c6bc197438fb8f26418c1aae4a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1450c6bc197438fb8f26418c1aae4a5 already in progress: creating tablet
W20260503 07:53:17.811833 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 8c0bcb9ab72a482ca07447ff392ae49d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0bcb9ab72a482ca07447ff392ae49d already in progress: creating tablet
W20260503 07:53:17.812011 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 23b8c1768a15487ba9140acd77c4ff7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23b8c1768a15487ba9140acd77c4ff7b already in progress: creating tablet
W20260503 07:53:17.812224 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 63a44b834b1e44a99c2cd3f9747ca13f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a44b834b1e44a99c2cd3f9747ca13f already in progress: creating tablet
I20260503 07:53:17.812237 886 tablet_service.cc:1511] Processing CreateTablet for tablet 1a387b0b4db7488ba83b9a4f83b68a3c (DEFAULT_TABLE table=default.Table_bcb50750ce5b4b47bc4a79e45df1d2aa [id=fcf783f3d6294e6ea87aed598eab4fc8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:17.812397 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5c23434f3d8f44e581c2ed73aa045d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c23434f3d8f44e581c2ed73aa045d96 already in progress: creating tablet
I20260503 07:53:17.812539 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 5e9d50a71c1a4bf799de34af1064597d (table default.Table_6e7c2c4846b846de92b7b4650492d1ea [id=b4769938686e4c029e1acaf768d192e8]) successfully deleted
I20260503 07:53:17.812578 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a387b0b4db7488ba83b9a4f83b68a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.812856 887 tablet_service.cc:1511] Processing CreateTablet for tablet 538a155055574c25ae45d094cedbed0f (DEFAULT_TABLE table=default.Table_4fb4db2b8ace4ddda4bf4b7b2d861208 [id=9d256c231c10404c9bafd54d0ba42f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.813215 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538a155055574c25ae45d094cedbed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.813500 2608 consensus_queue.cc:1048] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.813865 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 6954ec38f7f742eaa7cc05af5b1432d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.815588 888 tablet_service.cc:1511] Processing CreateTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 (DEFAULT_TABLE table=default.Table_54f67bdae2284d7e8da41e63d8f74ba0 [id=7d65cfe5f9334c1a819f114b6177a94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.819931 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f3cee208e54c8d812ad3dc66b9e932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.822916 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1295) took 1230 ms. Trace:
I20260503 07:53:17.822991 889 rpcz_store.cc:276] 0503 07:53:16.592741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.732657 (+139916us) service_pool.cc:224] Handling call
0503 07:53:16.732984 (+ 327us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.733018 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.801595 (+1068577us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.822771 (+ 21176us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.822901 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.823359 889 tablet_service.cc:1511] Processing CreateTablet for tablet a40623d2232f46c19273465065daeede (DEFAULT_TABLE table=default.Table_24b516f2c05c4191af1ebc827eafb9f3 [id=6b79fa8821a141ac91b14cf6c3a4ee07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.823644 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40623d2232f46c19273465065daeede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.829480 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1296) took 1236 ms. Trace:
I20260503 07:53:17.829563 884 rpcz_store.cc:276] 0503 07:53:16.592807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.734375 (+141568us) service_pool.cc:224] Handling call
0503 07:53:16.734708 (+ 333us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.734731 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.755106 (+1020375us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.829336 (+ 74230us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.829463 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.830036 884 tablet_service.cc:1511] Processing CreateTablet for tablet 19055009ccee4912868eb09094d5e0c5 (DEFAULT_TABLE table=default.Table_8e07bd717fe1461494b19abec87c60c1 [id=b50ba4c980834664ab6534b513f16288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.830479 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19055009ccee4912868eb09094d5e0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.831174 3079 sys_catalog.cc:263] Verifying existing consensus state
I20260503 07:53:17.835585 1174 ts_tablet_manager.cc:1929] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.835719 1174 log.cc:1199] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/314f539af5e44f048ff42619fcda1943
I20260503 07:53:17.835811 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:17.837235 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1309) took 1172 ms. Trace:
I20260503 07:53:17.837316 891 rpcz_store.cc:276] 0503 07:53:16.665044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.583159 (+918115us) service_pool.cc:224] Handling call
0503 07:53:17.583759 (+ 600us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.583810 (+ 51us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.826470 (+242660us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.837101 (+ 10631us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.837220 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.837651 891 tablet_service.cc:1511] Processing CreateTablet for tablet 37bd4b226f924db2ad47395ca5a186d0 (DEFAULT_TABLE table=default.Table_154420e661fb4056a6fccefb241138d1 [id=95d1d6253dd54bba80724852afef9781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.837927 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bd4b226f924db2ad47395ca5a186d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.840721 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1285) took 1276 ms. Trace:
I20260503 07:53:17.847468 1165 tablet_bootstrap.cc:492] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:17.847726 1165 ts_tablet_manager.cc:1403] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.230s user 0.004s sys 0.000s
I20260503 07:53:17.840881 890 rpcz_store.cc:276] 0503 07:53:16.564410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.710773 (+146363us) service_pool.cc:224] Handling call
0503 07:53:16.711146 (+ 373us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.711170 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.755219 (+1044049us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.840601 (+ 85382us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.840709 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.850688 890 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:17.851848 890 tablet_service.cc:1511] Processing CreateTablet for tablet dbd64e91efd546cd9e1bcfa45d573399 (DEFAULT_TABLE table=default.Table_8bb00152ef6245dbb9401fb10277a5d3 [id=a0416f7774e64bed884ea84f3cdd6eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.852229 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd64e91efd546cd9e1bcfa45d573399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.853328 2924 consensus_queue.cc:1048] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:17.845652 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1310) took 1180 ms. Trace:
I20260503 07:53:17.859611 892 rpcz_store.cc:276] 0503 07:53:16.665117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.779047 (+1113930us) service_pool.cc:224] Handling call
0503 07:53:17.801940 (+ 22893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.801972 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.823126 (+ 21154us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.845302 (+ 22176us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.845640 (+ 338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.862583 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9132dec40e4392aeb19613daaa80ca (DEFAULT_TABLE table=default.Table_d68d813a0dbc41d092cf879d68d6ef5d [id=b056a5f426874c639a97650838cdf1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.855875 1175 ts_tablet_manager.cc:1929] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.863194 1175 log.cc:1199] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/4de65c754b47440a914f3f2bdb86059c
I20260503 07:53:17.863617 1175 ts_tablet_manager.cc:1950] T 4de65c754b47440a914f3f2bdb86059c P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.872905 1174 ts_tablet_manager.cc:1950] T 314f539af5e44f048ff42619fcda1943 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.873850 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1090) took 5322 ms. Trace:
I20260503 07:53:17.873999 1174 rpcz_store.cc:276] 0503 07:53:12.551379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.721530 (+170151us) service_pool.cc:224] Handling call
0503 07:53:17.781188 (+5059658us) ts_tablet_manager.cc:1151] Deleting tablet 314f539af5e44f048ff42619fcda1943
0503 07:53:17.781197 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.829164 (+ 47967us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.835514 (+ 6350us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.873797 (+ 38283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5059493}
I20260503 07:53:17.877223 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1198) took 5220 ms. Trace:
I20260503 07:53:17.877338 1175 rpcz_store.cc:276] 0503 07:53:12.656375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.658339 (+ 1964us) service_pool.cc:224] Handling call
0503 07:53:17.776748 (+5118409us) ts_tablet_manager.cc:1151] Deleting tablet 4de65c754b47440a914f3f2bdb86059c
0503 07:53:17.776756 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.822078 (+ 45322us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.855827 (+ 33749us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.877203 (+ 21376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5118188}
I20260503 07:53:17.882052 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 4de65c754b47440a914f3f2bdb86059c (table default.Table_c2d55c4df0b54958ba726afe40ebaa0b [id=b1a0841eeeab4df58c436f38252a4725]) successfully deleted
I20260503 07:53:17.882376 1175 tablet_replica.cc:333] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.884783 1175 raft_consensus.cc:2243] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.885591 1175 raft_consensus.cc:2272] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.886104 1175 ts_tablet_manager.cc:1916] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.887696 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1094) took 5336 ms. Trace:
I20260503 07:53:17.887789 1174 rpcz_store.cc:276] 0503 07:53:12.551646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.768224 (+216578us) service_pool.cc:224] Handling call
0503 07:53:17.887539 (+5119315us) ts_tablet_manager.cc:1151] Deleting tablet 56d5a84f62f446c488a7e02be814a26c
0503 07:53:17.887549 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.887659 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5118812}
I20260503 07:53:17.888136 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1096) took 5336 ms. Trace:
I20260503 07:53:17.888257 1174 rpcz_store.cc:276] 0503 07:53:12.551788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.778916 (+227128us) service_pool.cc:224] Handling call
0503 07:53:17.888018 (+5109102us) ts_tablet_manager.cc:1151] Deleting tablet 471d979edca2476bb5787319a442603a
0503 07:53:17.888026 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.888110 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5085010}
I20260503 07:53:17.887833 596 catalog_manager.cc:5671] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:17.888586 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1099) took 5336 ms. Trace:
I20260503 07:53:17.888664 1174 rpcz_store.cc:276] 0503 07:53:12.551989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.834369 (+282380us) service_pool.cc:224] Handling call
0503 07:53:17.888474 (+5054105us) ts_tablet_manager.cc:1151] Deleting tablet bda89822863d4f70bc6f115dc2f808c8
0503 07:53:17.888482 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.888559 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4976137}
I20260503 07:53:17.888757 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c0ceddd751644d20bcbda15a462d5342 (table default.Table_f753dec874b841f18bf08be5433c6402 [id=36a30c4e7a864127b873fc19a9b9cfd5]). Expected version 1 got 0
I20260503 07:53:17.888980 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1109) took 5283 ms. Trace:
I20260503 07:53:17.889111 1174 rpcz_store.cc:276] 0503 07:53:12.605300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.947895 (+342595us) service_pool.cc:224] Handling call
0503 07:53:17.888837 (+4940942us) ts_tablet_manager.cc:1151] Deleting tablet 9648cf6a6c774c05a427a5c1344bfb77
0503 07:53:17.888845 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.888944 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4940779}
I20260503 07:53:17.889233 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:17.889521 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1111) took 5284 ms. Trace:
I20260503 07:53:17.889638 1174 rpcz_store.cc:276] 0503 07:53:12.605453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.965682 (+360229us) service_pool.cc:224] Handling call
0503 07:53:17.889386 (+4923704us) ts_tablet_manager.cc:1151] Deleting tablet 6e5283673660476eb689d41ef0daa2d0
0503 07:53:17.889398 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.889482 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4923496}
I20260503 07:53:17.890002 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1112) took 5284 ms. Trace:
I20260503 07:53:17.890136 1174 rpcz_store.cc:276] 0503 07:53:12.605522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.965938 (+360416us) service_pool.cc:224] Handling call
0503 07:53:17.889882 (+4923944us) ts_tablet_manager.cc:1151] Deleting tablet 9b0edcd3617b4c73a419b382492a23aa
0503 07:53:17.889893 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.889967 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4901511}
I20260503 07:53:17.890509 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1110) took 5285 ms. Trace:
I20260503 07:53:17.890594 1174 rpcz_store.cc:276] 0503 07:53:12.605375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.948081 (+342706us) service_pool.cc:224] Handling call
0503 07:53:17.890384 (+4942303us) ts_tablet_manager.cc:1151] Deleting tablet b56ee573586b49d596592c32c509969f
0503 07:53:17.890395 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.890470 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4867701}
I20260503 07:53:17.890821 1174 tablet_replica.cc:333] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:17.892406 988 consensus_peers.cc:597] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:17.894181 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.896672 1171 tablet_bootstrap.cc:492] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.896785 1171 ts_tablet_manager.cc:1403] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.004s
I20260503 07:53:17.897440 1171 raft_consensus.cc:359] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.897578 1171 raft_consensus.cc:385] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.897621 1171 raft_consensus.cc:740] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.897804 1171 consensus_queue.cc:260] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.898315 1171 ts_tablet_manager.cc:1434] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260503 07:53:17.898545 1171 tablet_bootstrap.cc:492] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.900717 1171 tablet_bootstrap.cc:654] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.905115 592 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_aa13ddecf6574581b4989e7c33515014" } new_table_name: "default.Table_9e6055726aa3438989b2a66cdbc8baf2" modify_external_catalogs: true
I20260503 07:53:17.907397 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1281) took 1403 ms. Trace:
I20260503 07:53:17.907599 880 rpcz_store.cc:276] 0503 07:53:16.504462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.698217 (+193755us) service_pool.cc:224] Handling call
0503 07:53:16.747814 (+ 49597us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.747844 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.535633 (+787789us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.862228 (+326595us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.907372 (+ 45144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.907927 1175 ts_tablet_manager.cc:1929] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.908025 1175 log.cc:1199] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/db13f91ef1d740c387bacbb689ddf1a8
I20260503 07:53:17.908242 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1297) took 1315 ms. Trace:
I20260503 07:53:17.908427 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9132dec40e4392aeb19613daaa80ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.908529 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1288) took 1317 ms. Trace:
I20260503 07:53:17.908591 893 rpcz_store.cc:276] 0503 07:53:16.591340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.722703 (+131363us) service_pool.cc:224] Handling call
0503 07:53:16.723092 (+ 389us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.723115 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.560402 (+837287us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.886187 (+325785us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.908520 (+ 22333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.908242 894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1306) took 1243 ms. Trace:
I20260503 07:53:17.908351 897 rpcz_store.cc:276] 0503 07:53:16.592858 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.748100 (+155242us) service_pool.cc:224] Handling call
0503 07:53:16.749274 (+ 1174us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.749513 (+ 239us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.759450 (+1009937us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.866473 (+107023us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.908230 (+ 41757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.908836 894 rpcz_store.cc:276] 0503 07:53:16.664767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.548010 (+883243us) service_pool.cc:224] Handling call
0503 07:53:17.777011 (+229001us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.777055 (+ 44us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.826926 (+ 49871us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.873111 (+ 46185us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.908233 (+ 35122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.868109 3079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Bootstrap starting.
I20260503 07:53:17.909279 894 tablet_service.cc:1511] Processing CreateTablet for tablet f35ba647f99249dabdb9810805b58877 (DEFAULT_TABLE table=default.Table_eea1b385145a4989855907d5eed02328 [id=d313b10f66254890b5a0c93c8c9136ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:17.915946 599 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87955e94e5c84a5485ac8ec66ff6451e consensus state has no leader
I20260503 07:53:17.922413 3068 tablet.cc:1724] T 5ba5f770a448465491160fc72f66a830 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:17.922909 1174 raft_consensus.cc:2243] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:17.923177 1174 raft_consensus.cc:2272] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.923693 1174 ts_tablet_manager.cc:1916] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.932531 897 tablet_service.cc:1511] Processing CreateTablet for tablet b689cae48af74395a270719e32ff520e (DEFAULT_TABLE table=default.Table_ca0e7ac763ef44d49ee51109f02130ff [id=b709de6d5490447c9260a22f4dd0055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.933175 1171 tablet_bootstrap.cc:492] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.933316 1171 ts_tablet_manager.cc:1403] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260503 07:53:17.934187 1171 raft_consensus.cc:359] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.934360 1171 raft_consensus.cc:385] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.934407 1171 raft_consensus.cc:740] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.934564 1171 consensus_queue.cc:260] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:17.934762 880 tablet_service.cc:1511] Processing CreateTablet for tablet 93c29ea700d94fa695364645895787cd (DEFAULT_TABLE table=default.Table_5098542c58ab427c830fe36eaf5110d7 [id=9f0f7e74af434bd9b2aed228e388391d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.935499 1171 ts_tablet_manager.cc:1434] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:17.935768 1171 tablet_bootstrap.cc:492] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.848882 1165 raft_consensus.cc:359] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.937320 1165 raft_consensus.cc:385] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.937476 1165 raft_consensus.cc:740] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.937979 1171 tablet_bootstrap.cc:654] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.937932 1165 consensus_queue.cc:260] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.938660 1175 ts_tablet_manager.cc:1950] T db13f91ef1d740c387bacbb689ddf1a8 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.938980 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1196) took 5282 ms. Trace:
I20260503 07:53:17.939055 1175 rpcz_store.cc:276] 0503 07:53:12.656108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.670065 (+ 13957us) service_pool.cc:224] Handling call
0503 07:53:17.882317 (+5212252us) ts_tablet_manager.cc:1151] Deleting tablet db13f91ef1d740c387bacbb689ddf1a8
0503 07:53:17.882330 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.904372 (+ 22042us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.907884 (+ 3512us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.938965 (+ 31081us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5209203}
I20260503 07:53:17.939649 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet db13f91ef1d740c387bacbb689ddf1a8 (table default.Table_e4ae69024f594a199dc5ccabcf7cdddb [id=040b2bdef1584c959f5b5f1f2eaa8429]) successfully deleted
I20260503 07:53:17.939843 1175 tablet_replica.cc:333] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:17.939960 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35ba647f99249dabdb9810805b58877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.940060 1175 raft_consensus.cc:2243] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:17.940635 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b689cae48af74395a270719e32ff520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.941269 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c29ea700d94fa695364645895787cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.941990 1175 raft_consensus.cc:2272] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:17.942420 893 tablet_service.cc:1511] Processing CreateTablet for tablet fe34cedd1e694e09bc3bdf1b3a176a9d (DEFAULT_TABLE table=default.Table_cd4cd700b0664401a92371c9ea522087 [id=4ac0e6050fb84703b453f29888fc6c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.942641 1175 ts_tablet_manager.cc:1916] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:17.952414 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd71a81efd3b40c6b96bb77f74e8a4c6" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:17.952950 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe34cedd1e694e09bc3bdf1b3a176a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.953902 1174 ts_tablet_manager.cc:1929] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.957134 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 314f539af5e44f048ff42619fcda1943 (table default.Table_871580894503440db95b41b028601fae [id=56736335da044fb5aa7d2f496ec89e0e]) successfully deleted
W20260503 07:53:17.957520 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 56d5a84f62f446c488a7e02be814a26c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56d5a84f62f446c488a7e02be814a26c already in progress: creating tablet
W20260503 07:53:17.957826 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 471d979edca2476bb5787319a442603a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 471d979edca2476bb5787319a442603a already in progress: creating tablet
I20260503 07:53:17.959100 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d108619bcc194aedb03cc2fbc08be1bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:17.959867 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d108619bcc194aedb03cc2fbc08be1bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:17.960649 1171 tablet_bootstrap.cc:492] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:17.960774 1171 ts_tablet_manager.cc:1403] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260503 07:53:17.961539 1171 raft_consensus.cc:359] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.961691 1171 raft_consensus.cc:385] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.961730 1171 raft_consensus.cc:740] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.961897 1171 consensus_queue.cc:260] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.962272 1166 tablet_bootstrap.cc:492] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:17.962394 1166 ts_tablet_manager.cc:1403] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 1.058s user 0.027s sys 0.043s
I20260503 07:53:17.962466 1171 ts_tablet_manager.cc:1434] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:17.962702 1171 tablet_bootstrap.cc:492] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:17.964324 1171 tablet_bootstrap.cc:654] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:17.967510 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1308) took 1302 ms. Trace:
I20260503 07:53:17.967681 898 rpcz_store.cc:276] 0503 07:53:16.664890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.581413 (+916523us) service_pool.cc:224] Handling call
0503 07:53:17.776705 (+195292us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.776734 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.950205 (+173471us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.967060 (+ 16855us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.967486 (+ 426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.968340 1174 log.cc:1199] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/1ae4a39d4e3a42db816e592123a6a2e7
I20260503 07:53:17.968756 1174 ts_tablet_manager.cc:1950] T 1ae4a39d4e3a42db816e592123a6a2e7 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:17.969660 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1113) took 5364 ms. Trace:
I20260503 07:53:17.969765 1174 rpcz_store.cc:276] 0503 07:53:12.605606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.967572 (+361966us) service_pool.cc:224] Handling call
0503 07:53:17.890768 (+4923196us) ts_tablet_manager.cc:1151] Deleting tablet 1ae4a39d4e3a42db816e592123a6a2e7
0503 07:53:17.890774 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.926956 (+ 36182us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.953814 (+ 26858us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.969626 (+ 15812us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4860047}
I20260503 07:53:17.970146 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1120) took 4797 ms. Trace:
I20260503 07:53:17.970232 1174 rpcz_store.cc:276] 0503 07:53:13.173792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.174208 (+ 416us) service_pool.cc:224] Handling call
0503 07:53:17.970018 (+4795810us) ts_tablet_manager.cc:1151] Deleting tablet 5c25b29188224fbe98ee8c6f6b7b956b
0503 07:53:17.970028 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.970120 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4795425}
I20260503 07:53:17.971889 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1123) took 4771 ms. Trace:
I20260503 07:53:17.971972 1174 rpcz_store.cc:276] 0503 07:53:13.200087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.200226 (+ 139us) service_pool.cc:224] Handling call
0503 07:53:17.971746 (+4771520us) ts_tablet_manager.cc:1151] Deleting tablet fad603dd15f545a999b6e45bcc20bafc
0503 07:53:17.971755 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.971863 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4771331}
I20260503 07:53:17.972275 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1125) took 4772 ms. Trace:
I20260503 07:53:17.972359 1174 rpcz_store.cc:276] 0503 07:53:13.200280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.200467 (+ 187us) service_pool.cc:224] Handling call
0503 07:53:17.972147 (+4771680us) ts_tablet_manager.cc:1151] Deleting tablet 2b12c2f3cbf74edc9caf98853272c8b4
0503 07:53:17.972153 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.972251 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4771543}
I20260503 07:53:17.972611 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1122) took 4772 ms. Trace:
I20260503 07:53:17.972681 1174 rpcz_store.cc:276] 0503 07:53:13.199981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.200664 (+ 683us) service_pool.cc:224] Handling call
0503 07:53:17.972525 (+4771861us) ts_tablet_manager.cc:1151] Deleting tablet 70243e24ae17460f9d3e20720a9bfa53
0503 07:53:17.972531 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.972589 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4771722}
I20260503 07:53:17.972949 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1121) took 4796 ms. Trace:
I20260503 07:53:17.973747 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26032d89839340988fce30f458e785fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.974543 1174 rpcz_store.cc:276] 0503 07:53:13.178269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.209831 (+ 31562us) service_pool.cc:224] Handling call
0503 07:53:17.972848 (+4763017us) ts_tablet_manager.cc:1151] Deleting tablet 5d2f95e3ad844bc39593787e38a45bad
0503 07:53:17.972868 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.972927 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4762845}
I20260503 07:53:17.974854 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1132) took 4705 ms. Trace:
I20260503 07:53:17.974923 1174 rpcz_store.cc:276] 0503 07:53:13.269289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.269423 (+ 134us) service_pool.cc:224] Handling call
0503 07:53:17.974743 (+4705320us) ts_tablet_manager.cc:1151] Deleting tablet 01c7925b82934b59839a0e8ddf99356d
0503 07:53:17.974751 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.974827 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4704839}
I20260503 07:53:17.975180 1174 tablet_replica.cc:333] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:17.975708 1175 ts_tablet_manager.cc:1929] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:17.975792 1175 log.cc:1199] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/2ad24ddc82bd401fb5427e7415af3922
W20260503 07:53:17.976401 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 391090us
W20260503 07:53:17.976603 851 leader_election.cc:343] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: aef746161e6b446ab0d299d37e2151ea
I20260503 07:53:17.976733 851 leader_election.cc:304] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:17.973424 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:17.975993 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855100ffa19d4fe7a92ae13ca5171adb" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:17.979851 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 0a08da2052f5482792c8b3294e9b7332 (table default.Table_11c94f42fdb74455a513cdd269339d90 [id=a8e0e85f02244d0b845242b0d59eedce]). Expected version 2 got 0
I20260503 07:53:17.980219 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:17.980424 596 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 5ba5f770a448465491160fc72f66a830 (table default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616]). Expected version 1 got 0
I20260503 07:53:17.976974 3070 raft_consensus.cc:2749] T aef746161e6b446ab0d299d37e2151ea P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:17.976781 898 tablet_service.cc:1511] Processing CreateTablet for tablet 066e62a9892a450f8a211659fab4bc2b (DEFAULT_TABLE table=default.Table_3879045db74d4863b8f62d2aff4c31ba [id=fa42f9d5a3cc4339b70d5e7d200b807d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.985800 879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1263) took 1814 ms. Trace:
I20260503 07:53:17.985965 879 rpcz_store.cc:276] 0503 07:53:16.171583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.612154 (+440571us) service_pool.cc:224] Handling call
0503 07:53:16.676217 (+ 64063us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.676244 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.841156 (+1164912us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.985622 (+144466us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:17.985781 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:17.976121 1175 ts_tablet_manager.cc:1950] T 2ad24ddc82bd401fb5427e7415af3922 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:17.990768 884 tablet_service.cc:1511] Processing CreateTablet for tablet ae9d435a9c5b4fa786faa765a1cf541c (DEFAULT_TABLE table=default.Table_d35fc80f52954a3b9f7308f0889787cc [id=6bf4cffad9ab4583a9fa29bc219854b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:17.991835 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9d435a9c5b4fa786faa765a1cf541c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.993130 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26032d89839340988fce30f458e785fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:17.994184 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066e62a9892a450f8a211659fab4bc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:17.978214 1166 raft_consensus.cc:359] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:17.995945 1166 raft_consensus.cc:385] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:17.996003 1166 raft_consensus.cc:740] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:17.996209 1166 consensus_queue.cc:260] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:17.977246 851 leader_election.cc:343] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 64c6dad26de642879307b7dca6ae85f5
I20260503 07:53:17.996692 851 leader_election.cc:304] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.005771 1166 ts_tablet_manager.cc:1434] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260503 07:53:17.990284 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1202) took 5290 ms. Trace:
I20260503 07:53:18.008551 1175 rpcz_store.cc:276] 0503 07:53:12.699666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.699705 (+ 39us) service_pool.cc:224] Handling call
0503 07:53:17.939809 (+5240104us) ts_tablet_manager.cc:1151] Deleting tablet 2ad24ddc82bd401fb5427e7415af3922
0503 07:53:17.939816 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.956974 (+ 17158us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.975661 (+ 18687us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:17.990268 (+ 14607us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5239899}
I20260503 07:53:18.009586 1171 tablet_bootstrap.cc:492] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.009704 1171 ts_tablet_manager.cc:1403] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.002s
I20260503 07:53:18.010490 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 2ad24ddc82bd401fb5427e7415af3922 (table default.Table_2b316333c1ba4f2fb97307e35ceff30b [id=d03d86f3d47b407fbd9ac6887dd8ef80]) successfully deleted
I20260503 07:53:18.010357 1171 raft_consensus.cc:359] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.010869 1171 raft_consensus.cc:385] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.010926 1171 raft_consensus.cc:740] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.011104 1171 consensus_queue.cc:260] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.011603 1171 ts_tablet_manager.cc:1434] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:18.012826 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:18.012931 1171 tablet_bootstrap.cc:492] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.015499 2816 consensus_queue.cc:1048] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.016234 2816 consensus_queue.cc:1048] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.016961 2816 consensus_queue.cc:1048] T ae3862d990f14c3f8a084d234d941bfa P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.018232 1175 tablet_replica.cc:333] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.018460 1175 raft_consensus.cc:2243] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.018628 1175 raft_consensus.cc:2272] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.021289 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:18.021432 1171 tablet_bootstrap.cc:654] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:18.022750 851 leader_election.cc:343] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: efbf07a603be411895839aece99fa78c
I20260503 07:53:18.024994 2997 raft_consensus.cc:2749] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:18.026225 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08b5135cb77444bb5ff35c5f9d68129" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.031545 2816 raft_consensus.cc:493] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.031682 2816 raft_consensus.cc:515] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.032375 2816 leader_election.cc:290] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.036054 1166 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:18.036160 851 leader_election.cc:304] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:18.036604 851 leader_election.cc:343] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 56749914e1a349f0876f52157affdf69
I20260503 07:53:18.036724 851 leader_election.cc:304] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.037063 851 leader_election.cc:304] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.037312 3084 raft_consensus.cc:2749] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:18.037508 3084 raft_consensus.cc:2749] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:18.037639 3084 raft_consensus.cc:2749] T bf51c959093d4579a5916c49e1790737 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:53:18.038444 851 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 773fca453dac452abc723e49b70111b9
W20260503 07:53:18.038609 851 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:18.038702 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 5a178957514e4f77afe8a1879b57a96b (table default.Table_7d48574ee8e7473ca1daa0dd9301d7ca [id=761af634682a4a86a00489027062bd33]) successfully deleted
I20260503 07:53:18.041064 1171 tablet_bootstrap.cc:492] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.041181 1171 ts_tablet_manager.cc:1403] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20260503 07:53:18.041797 1171 raft_consensus.cc:359] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.041936 1171 raft_consensus.cc:385] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.041978 1171 raft_consensus.cc:740] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.042157 1171 consensus_queue.cc:260] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.042701 1171 ts_tablet_manager.cc:1434] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260503 07:53:18.042922 1171 tablet_bootstrap.cc:492] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.044123 1171 tablet_bootstrap.cc:654] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.052376 1166 tablet_bootstrap.cc:654] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.058549 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44832fbf224a069d958cf745d914f8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.061419 1171 tablet_bootstrap.cc:492] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.061568 1171 ts_tablet_manager.cc:1403] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20260503 07:53:18.062434 1171 raft_consensus.cc:359] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.062598 1171 raft_consensus.cc:385] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.062644 1171 raft_consensus.cc:740] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.063863 1171 consensus_queue.cc:260] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.064275 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ee2d7a044dfb46aea48bf51119a4a3e3" } new_table_name: "default.Table_b97cc6a1c8be4963954eb7e84d70deb6" modify_external_catalogs: true
I20260503 07:53:18.064460 1171 ts_tablet_manager.cc:1434] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:18.064756 1171 tablet_bootstrap.cc:492] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.066004 1171 tablet_bootstrap.cc:654] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:18.068356 986 leader_election.cc:343] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.070191 1165 ts_tablet_manager.cc:1434] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.222s user 0.002s sys 0.000s
I20260503 07:53:18.070574 1165 tablet_bootstrap.cc:492] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:18.059054 879 tablet_service.cc:1511] Processing CreateTablet for tablet e4068720834a4ff088139dd907ff9cb9 (DEFAULT_TABLE table=default.Table_4f525a07b4e84b15abed3e131a3fedc6 [id=65dccf79b3b347d682d2b53290daa45e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.081933 1174 raft_consensus.cc:2243] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.082340 1174 raft_consensus.cc:2272] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.083117 1174 ts_tablet_manager.cc:1916] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.088088 1171 tablet_bootstrap.cc:492] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.088267 1171 ts_tablet_manager.cc:1403] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260503 07:53:18.089147 1171 raft_consensus.cc:359] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.089375 1171 raft_consensus.cc:385] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.089434 1171 raft_consensus.cc:740] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.089650 1171 consensus_queue.cc:260] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.090994 1171 ts_tablet_manager.cc:1434] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260503 07:53:18.091243 1171 tablet_bootstrap.cc:492] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:18.094287 970 tablet.cc:2404] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:53:18.096025 1171 tablet_bootstrap.cc:654] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.089874 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44832fbf224a069d958cf745d914f8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:18.096570 988 leader_election.cc:343] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.096719 988 leader_election.cc:304] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.097072 2816 raft_consensus.cc:2749] T ab44832fbf224a069d958cf745d914f8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.099501 1173 ts_tablet_manager.cc:1929] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:18.100044 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1307) took 1435 ms. Trace:
I20260503 07:53:18.101121 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1276) took 1671 ms. Trace:
I20260503 07:53:18.101348 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1299) took 1437 ms. Trace:
W20260503 07:53:18.112601 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet bda89822863d4f70bc6f115dc2f808c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda89822863d4f70bc6f115dc2f808c8 already in progress: creating tablet
I20260503 07:53:18.112914 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1303) took 1448 ms. Trace:
W20260503 07:53:18.077831 854 leader_election.cc:343] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 773fca453dac452abc723e49b70111b9
I20260503 07:53:18.115073 889 tablet_service.cc:1511] Processing CreateTablet for tablet b83e492f9445478f890dd9d90321b41a (DEFAULT_TABLE table=default.Table_807644122a02408798de0c8b502b0b07 [id=6f315ff55cc24727a434a90be2ea2b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.115165 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:18.115713 897 tablet_service.cc:1511] Processing CreateTablet for tablet 25c586dc2fb74270a9669de65e2328b0 (DEFAULT_TABLE table=default.Table_e5559d16a8e243dab7cd61db43c0d0c2 [id=6eb28d00cccf4df3961f8c7be4df3c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.099910 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1305) took 1435 ms. Trace:
I20260503 07:53:18.119299 893 tablet_service.cc:1511] Processing CreateTablet for tablet f8672664090a4ab8bc307d6a4efd3806 (DEFAULT_TABLE table=default.Table_71d50bc9af074908b69e040f98a93ba1 [id=cbd85157ff204c6589de86700ac9b9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.133837 1174 ts_tablet_manager.cc:1929] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.133952 1174 log.cc:1199] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/bf51c959093d4579a5916c49e1790737
I20260503 07:53:18.134321 1174 ts_tablet_manager.cc:1950] T bf51c959093d4579a5916c49e1790737 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:18.134639 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1138) took 4844 ms. Trace:
I20260503 07:53:18.134720 1174 rpcz_store.cc:276] 0503 07:53:13.290645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.290687 (+ 42us) service_pool.cc:224] Handling call
0503 07:53:17.975118 (+4684431us) ts_tablet_manager.cc:1151] Deleting tablet bf51c959093d4579a5916c49e1790737
0503 07:53:17.975126 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.086272 (+111146us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.133778 (+ 47506us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.134625 (+ 847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106531,"tablet-delete.queue_time_us":4684263}
I20260503 07:53:18.135003 883 rpcz_store.cc:276] 0503 07:53:16.429807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.681415 (+251608us) service_pool.cc:224] Handling call
0503 07:53:16.695182 (+ 13767us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.695206 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.001667 (+1306461us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.050643 (+ 48976us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.101106 (+ 50463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.135262 1174 tablet_replica.cc:333] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:18.135344 883 tablet_service.cc:1558] Processing DeleteTablet for tablet a3724490a7ed4afc82e4f7ebc1190f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:14 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.135509 883 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.135500 1174 raft_consensus.cc:2243] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.135651 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 86d052abe9234579b450cc6e92b6ddf6 with delete_type TABLET_DATA_DELETED (replaced by tablet b378b4d831c64b0683a280159de56a51) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.135787 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 63f3cee208e54c8d812ad3dc66b9e932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.135779 1174 raft_consensus.cc:2272] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.136415 1174 ts_tablet_manager.cc:1916] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.137713 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1315) took 1446 ms. Trace:
I20260503 07:53:18.137853 881 rpcz_store.cc:276] 0503 07:53:16.665502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.785126 (+1119624us) service_pool.cc:224] Handling call
0503 07:53:17.796491 (+ 11365us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.796514 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.968361 (+171847us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.093241 (+124880us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.112317 (+ 19076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.138150 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a7af140ce144bc8b2e147dad98ac201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.138559 881 tablet_service.cc:1511] Processing CreateTablet for tablet 03ab0202f6ef4999a7746b3faef6f5b6 (DEFAULT_TABLE table=default.Table_c0e84285a25e4efa9bc713326e77dc16 [id=00787394e03d4e76b3bc76f704e16cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.138964 2816 raft_consensus.cc:493] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.139021 896 rpcz_store.cc:276] 0503 07:53:16.664702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.540975 (+876273us) service_pool.cc:224] Handling call
0503 07:53:17.776202 (+235227us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.776240 (+ 38us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.947271 (+171031us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.026730 (+ 79459us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.099893 (+ 73163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.139151 2816 raft_consensus.cc:515] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.139549 896 tablet_service.cc:1511] Processing CreateTablet for tablet 257bd97e53254034a76e699d8926e21e (DEFAULT_TABLE table=default.Table_e8b61a046c0640179d065f67343c831e [id=475502d115d7404e962af53729e1214b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.140352 895 rpcz_store.cc:276] 0503 07:53:16.664137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.762560 (+ 98423us) service_pool.cc:224] Handling call
0503 07:53:16.763135 (+ 575us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.763159 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.794742 (+1031583us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.010117 (+215375us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.054076 (+ 43959us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x61800000c918. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59f24fd9bd 00007f59f24fea2e 00007f5a0622c6ad 00007f5a061ab3d3 00007f5a0236f599 00007f5a02363808 00007f5a0236514b 00007f5a022b3171 00007f59fc1426a6 00007f59fc1423d5
0503 07:53:18.101335 (+ 47259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32964352}
I20260503 07:53:18.140947 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb (DEFAULT_TABLE table=default.Table_b9c58f8cbe354c10a6610555b12af3eb [id=3b66adf0ef774692aa2ae47293a1be1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.141196 2816 leader_election.cc:290] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:18.141786 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3fcb4d83f64f6182a78a1a02da39d6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:18.142225 988 leader_election.cc:343] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.147737 884 tablet_service.cc:1511] Processing CreateTablet for tablet a34d76fc72b042b9a4f682e865f44397 (DEFAULT_TABLE table=default.Table_2a9ae2200bc2451c9be9d6b121e695a7 [id=ee854c21b5ed4afdac616b263e8f2836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.152300 1173 log.cc:1199] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/d3fda3bba9234622b2c391a31c55dc3a
I20260503 07:53:18.152678 1173 ts_tablet_manager.cc:1950] T d3fda3bba9234622b2c391a31c55dc3a P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:18.153008 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 926) took 9127 ms. Trace:
I20260503 07:53:18.153116 1173 rpcz_store.cc:276] 0503 07:53:09.025124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.025510 (+ 386us) service_pool.cc:224] Handling call
0503 07:53:17.775148 (+8749638us) ts_tablet_manager.cc:1151] Deleting tablet d3fda3bba9234622b2c391a31c55dc3a
0503 07:53:17.775156 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:17.975501 (+200345us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.074251 (+ 98750us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.152966 (+ 78715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36459,"tablet-delete.queue_time_us":8749515}
I20260503 07:53:18.153592 1173 tablet_replica.cc:333] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:18.153812 1173 raft_consensus.cc:2243] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.153976 1173 raft_consensus.cc:2272] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.154485 1173 ts_tablet_manager.cc:1916] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.154871 885 rpcz_store.cc:276] 0503 07:53:16.664821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.555943 (+891122us) service_pool.cc:224] Handling call
0503 07:53:17.776478 (+220535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.776511 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.814730 (+ 38219us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.028087 (+213357us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.099991 (+ 71904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.154961 2708 consensus_queue.cc:1048] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.158708 2708 raft_consensus.cc:493] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.158821 2708 raft_consensus.cc:515] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.159461 2708 leader_election.cc:290] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:18.160259 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:18.160449 1052 raft_consensus.cc:2468] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:18.160646 1174 ts_tablet_manager.cc:1929] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.160843 1174 log.cc:1199] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/b269ee59036d4c2f866b6b2bf45c35cf
I20260503 07:53:18.160882 716 leader_election.cc:304] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:18.161285 2708 raft_consensus.cc:2804] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:18.161365 2708 raft_consensus.cc:493] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:18.161437 2708 raft_consensus.cc:3060] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:18.161988 1174 ts_tablet_manager.cc:1950] T b269ee59036d4c2f866b6b2bf45c35cf P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:18.164693 2708 raft_consensus.cc:515] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.165182 882 rpcz_store.cc:276] 0503 07:53:16.664579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.867796 (+203217us) service_pool.cc:224] Handling call
0503 07:53:16.868689 (+ 893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:16.868721 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.964807 (+1096086us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.098990 (+134183us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.112897 (+ 13907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.167164 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:18.167326 1052 raft_consensus.cc:3060] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:18.168015 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1139) took 4876 ms. Trace:
I20260503 07:53:18.168092 1175 ts_tablet_manager.cc:1916] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.170256 1052 raft_consensus.cc:2468] T 2eb33e9818334d4a8ea4e648c3dd7cac P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:18.170678 716 leader_election.cc:304] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:18.170956 2964 raft_consensus.cc:2804] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:18.171129 2964 raft_consensus.cc:697] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:18.171370 2964 consensus_queue.cc:237] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.172689 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4068720834a4ff088139dd907ff9cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.173086 885 tablet_service.cc:1511] Processing CreateTablet for tablet dd5ce350ddb947328d4b173dae9b8e11 (DEFAULT_TABLE table=default.Table_cb43255a95cc4b09bf75bd57ae756fc0 [id=f823b167a2e5487086be003638bdebc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.173660 886 tablet_service.cc:1511] Processing CreateTablet for tablet deda702aaf554fc38e43d719b102754f (DEFAULT_TABLE table=default.Table_3e693dd73ff742449e6a82af7b68f122 [id=cf2a021766f241c3aa3e63fe65a7d876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.169550 1174 rpcz_store.cc:276] 0503 07:53:13.291073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.291116 (+ 43us) service_pool.cc:224] Handling call
0503 07:53:18.135209 (+4844093us) ts_tablet_manager.cc:1151] Deleting tablet b269ee59036d4c2f866b6b2bf45c35cf
0503 07:53:18.135221 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.154443 (+ 19222us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.160562 (+ 6119us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.167606 (+ 7044us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4843904}
W20260503 07:53:18.177052 715 consensus_peers.cc:597] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.174705 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 477d24ea5c8c42e1a8614f30859e36df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.178825 1166 tablet_bootstrap.cc:492] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:18.178934 2708 leader_election.cc:290] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:18.179041 715 consensus_peers.cc:597] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.179481 715 consensus_peers.cc:597] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.179867 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528f495ce534d989a0e370549c8f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:16 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:18.179893 715 leader_election.cc:343] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.176731 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9656dfbaad40359a7ff4dc58b76e71 (DEFAULT_TABLE table=default.Table_917ca0375c9a46e3804a45aba6641d83 [id=58db6c4ebcc141e0af42a02acc44f5c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.179991 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1140) took 4888 ms. Trace:
W20260503 07:53:18.180444 715 consensus_peers.cc:597] T b2ef0e849f4d4eb299726b2b094a1dc3 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.183290 715 leader_election.cc:343] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.183578 715 leader_election.cc:343] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.183907 715 leader_election.cc:343] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.181908 1174 rpcz_store.cc:276] 0503 07:53:13.291402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.291436 (+ 34us) service_pool.cc:224] Handling call
0503 07:53:18.176727 (+4885291us) ts_tablet_manager.cc:1151] Deleting tablet e63ee58b76a24cdc9b701f44aad4d707
0503 07:53:18.176739 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.179725 (+ 2986us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4885139}
W20260503 07:53:18.184320 715 consensus_peers.cc:597] T baa7721278d14e71aeba005d2bd40ecd P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.174842 854 leader_election.cc:304] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:18.184517 715 leader_election.cc:343] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.184857 715 leader_election.cc:343] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.185328 715 leader_election.cc:343] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.129861 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2037b66d5de74f39bdb3761dc0ec5729" } modify_external_catalogs: true
W20260503 07:53:18.185693 715 leader_election.cc:343] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.185671 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_2037b66d5de74f39bdb3761dc0ec5729" } modify_external_catalogs: true
W20260503 07:53:18.186103 715 consensus_peers.cc:597] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.155674 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet d3fda3bba9234622b2c391a31c55dc3a (table default.Table_2852281bb46a43eaa811335946a96990 [id=c0bfd5a5ce304371ac7df8d9da400a3b]) successfully deleted
I20260503 07:53:18.187674 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1131) took 4944 ms. Trace:
I20260503 07:53:18.188733 1174 rpcz_store.cc:276] 0503 07:53:13.243203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.243245 (+ 42us) service_pool.cc:224] Handling call
0503 07:53:18.185694 (+4942449us) ts_tablet_manager.cc:1151] Deleting tablet 3b10183f49464684acfa54e7d10ccee2
0503 07:53:18.186009 (+ 315us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.187285 (+ 1276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4893310}
I20260503 07:53:18.189958 1166 ts_tablet_manager.cc:1403] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.013s
I20260503 07:53:18.190038 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ab0202f6ef4999a7746b3faef6f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.193863 2708 consensus_queue.cc:1048] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.196759 883 tablet_service.cc:1511] Processing CreateTablet for tablet 079289f87d4d41b5a9482b581a8b7ef6 (DEFAULT_TABLE table=default.Table_93743c6156a74284a1bc22666cb227da [id=ee967f6e41204bd3a40c1d7def3d390d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.198807 1166 raft_consensus.cc:359] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.199026 1166 raft_consensus.cc:385] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.199119 1166 raft_consensus.cc:740] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.199378 1166 consensus_queue.cc:260] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.200024 1166 ts_tablet_manager.cc:1434] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260503 07:53:18.199877 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 87285.5us
I20260503 07:53:18.200542 1166 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
W20260503 07:53:18.200965 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9648cf6a6c774c05a427a5c1344bfb77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9648cf6a6c774c05a427a5c1344bfb77 already in progress: creating tablet
I20260503 07:53:18.203668 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:18.206074 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1316) took 1540 ms. Trace:
I20260503 07:53:18.206797 887 rpcz_store.cc:276] 0503 07:53:16.665598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.786373 (+1120775us) service_pool.cc:224] Handling call
0503 07:53:17.813074 (+ 26701us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.813096 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:17.971215 (+158119us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.205568 (+234353us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.205930 (+ 362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.208384 882 tablet_service.cc:1511] Processing CreateTablet for tablet 64e4347cef16419f806765f3bf677e59 (DEFAULT_TABLE table=default.Table_b6c0addc188a4a49a17ad33a8f48d12d [id=aec86f653a7849adb7ec16c85e1a99da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.210249 3070 raft_consensus.cc:2749] T 773fca453dac452abc723e49b70111b9 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:18.215624 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97d7a95b1f449d94fa5f56e7ee53eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.230334 2816 raft_consensus.cc:493] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.230499 2816 raft_consensus.cc:515] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.231087 2816 leader_election.cc:290] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.234421 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d68d813a0dbc41d092cf879d68d6ef5d" } modify_external_catalogs: true
I20260503 07:53:18.234627 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d68d813a0dbc41d092cf879d68d6ef5d" } modify_external_catalogs: true
I20260503 07:53:18.252876 2912 raft_consensus.cc:493] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.253031 2912 raft_consensus.cc:515] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.253633 2912 leader_election.cc:290] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:18.254280 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:18.254472 1052 raft_consensus.cc:2468] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:18.255002 716 leader_election.cc:304] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:18.255359 2912 raft_consensus.cc:2804] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:18.255455 2912 raft_consensus.cc:493] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:18.255522 2912 raft_consensus.cc:3060] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:18.258249 2912 raft_consensus.cc:515] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.259816 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:18.259959 1052 raft_consensus.cc:3060] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:18.250069 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_650313d3ed9447df8706aad925ff5b5b" } modify_external_catalogs: true
I20260503 07:53:18.260955 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_650313d3ed9447df8706aad925ff5b5b" } modify_external_catalogs: true
I20260503 07:53:18.262631 1052 raft_consensus.cc:2468] T c5a6b2fbf1ea4a109a63f0b3d224434a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
W20260503 07:53:18.203405 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 6e5283673660476eb689d41ef0daa2d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e5283673660476eb689d41ef0daa2d0 already in progress: creating tablet
W20260503 07:53:18.263532 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 60189.1us
W20260503 07:53:18.263734 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 9b0edcd3617b4c73a419b382492a23aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b0edcd3617b4c73a419b382492a23aa already in progress: creating tablet
W20260503 07:53:18.263901 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet b56ee573586b49d596592c32c509969f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b56ee573586b49d596592c32c509969f already in progress: creating tablet
I20260503 07:53:18.264035 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 1ae4a39d4e3a42db816e592123a6a2e7 (table default.Table_a6a85043cd814a5d8d17300cc43be157 [id=c5d1c3d4bc32495a9966899ba145e3cb]) successfully deleted
W20260503 07:53:18.264217 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5c25b29188224fbe98ee8c6f6b7b956b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c25b29188224fbe98ee8c6f6b7b956b already in progress: creating tablet
I20260503 07:53:18.263797 1175 ts_tablet_manager.cc:1929] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260503 07:53:18.264395 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet fad603dd15f545a999b6e45bcc20bafc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fad603dd15f545a999b6e45bcc20bafc already in progress: creating tablet
W20260503 07:53:18.264575 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2b12c2f3cbf74edc9caf98853272c8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b12c2f3cbf74edc9caf98853272c8b4 already in progress: creating tablet
I20260503 07:53:18.264825 716 leader_election.cc:304] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:18.265084 2924 raft_consensus.cc:2804] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:18.265189 2924 raft_consensus.cc:697] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:18.265414 2924 consensus_queue.cc:237] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.264726 1175 log.cc:1199] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b8bb85190cd94e8282eec9a1bc0efab4
I20260503 07:53:18.269148 2912 leader_election.cc:290] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:18.271945 1175 ts_tablet_manager.cc:1950] T b8bb85190cd94e8282eec9a1bc0efab4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.279165 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8672664090a4ab8bc307d6a4efd3806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.279431 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079289f87d4d41b5a9482b581a8b7ef6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:18.284224 988 consensus_peers.cc:597] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.284380 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1201) took 5584 ms. Trace:
I20260503 07:53:18.286468 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c586dc2fb74270a9669de65e2328b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.285432 1175 rpcz_store.cc:276] 0503 07:53:12.699550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.700110 (+ 560us) service_pool.cc:224] Handling call
0503 07:53:18.011744 (+5311634us) ts_tablet_manager.cc:1151] Deleting tablet b8bb85190cd94e8282eec9a1bc0efab4
0503 07:53:18.018157 (+ 6413us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.222189 (+204032us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.262972 (+ 40783us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.284358 (+ 21386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5311423}
I20260503 07:53:18.288542 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a36bb4bfd424952aeb4c7dda9ce5dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.289609 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b8bb85190cd94e8282eec9a1bc0efab4 (table default.Table_4735ea34fadb44c6bccac28390513b6e [id=3e2082596479404195cc918c09dfbad7]) successfully deleted
I20260503 07:53:18.290359 898 tablet_service.cc:1511] Processing CreateTablet for tablet 16aa59d4fdd94bdd82a441af4d665f2c (DEFAULT_TABLE table=default.Table_69cd921a9fd947eeab7249ecdfb5f4cc [id=aa7b4a7abf9b46c6bf68b5af2faf328e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.290911 890 tablet_service.cc:1511] Processing CreateTablet for tablet 86cee3f40f75423780bc320dbac4bf3c (DEFAULT_TABLE table=default.Table_4432dff538f34ccfa5ff09ffa927936d [id=80baba4e4cec471ca7158fe63075e95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.291540 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.295660 894 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.295928 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 79225c2dd80e41bf93ad2fa023b2a427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:18.297468 988 leader_election.cc:343] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.290426 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1209) took 5575 ms. Trace:
W20260503 07:53:18.301285 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 218615us
I20260503 07:53:18.302917 2916 raft_consensus.cc:493] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.303049 2916 raft_consensus.cc:515] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.299908 1175 rpcz_store.cc:276] 0503 07:53:12.715043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.715087 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:18.289101 (+5574014us) ts_tablet_manager.cc:1151] Deleting tablet 5c25b29188224fbe98ee8c6f6b7b956b
0503 07:53:18.289350 (+ 249us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.290170 (+ 820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5573867}
I20260503 07:53:18.303545 917 raft_consensus.cc:3060] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:18.303606 2916 leader_election.cc:290] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.305212 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1211) took 5589 ms. Trace:
W20260503 07:53:18.307602 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5c25b29188224fbe98ee8c6f6b7b956b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c25b29188224fbe98ee8c6f6b7b956b already in progress: creating tablet
I20260503 07:53:18.306188 1175 rpcz_store.cc:276] 0503 07:53:12.715749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.715786 (+ 37us) service_pool.cc:224] Handling call
0503 07:53:18.304128 (+5588342us) ts_tablet_manager.cc:1151] Deleting tablet 5d2f95e3ad844bc39593787e38a45bad
0503 07:53:18.304140 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.305193 (+ 1053us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5587998}
W20260503 07:53:18.308614 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 5d2f95e3ad844bc39593787e38a45bad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d2f95e3ad844bc39593787e38a45bad already in progress: creating tablet
I20260503 07:53:18.310824 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1212) took 5594 ms. Trace:
I20260503 07:53:18.311842 1175 rpcz_store.cc:276] 0503 07:53:12.716007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.716044 (+ 37us) service_pool.cc:224] Handling call
0503 07:53:18.309481 (+5593437us) ts_tablet_manager.cc:1151] Deleting tablet 70243e24ae17460f9d3e20720a9bfa53
0503 07:53:18.309495 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.310504 (+ 1009us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5592997}
W20260503 07:53:18.314462 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 70243e24ae17460f9d3e20720a9bfa53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70243e24ae17460f9d3e20720a9bfa53 already in progress: creating tablet
I20260503 07:53:18.316605 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1213) took 5600 ms. Trace:
I20260503 07:53:18.317610 1175 rpcz_store.cc:276] 0503 07:53:12.716320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.716393 (+ 73us) service_pool.cc:224] Handling call
0503 07:53:18.315238 (+5598845us) ts_tablet_manager.cc:1151] Deleting tablet fad603dd15f545a999b6e45bcc20bafc
0503 07:53:18.315251 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.316289 (+ 1038us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5598366}
W20260503 07:53:18.321008 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet fad603dd15f545a999b6e45bcc20bafc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fad603dd15f545a999b6e45bcc20bafc already in progress: creating tablet
I20260503 07:53:18.322785 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1214) took 5572 ms. Trace:
I20260503 07:53:18.323740 1175 rpcz_store.cc:276] 0503 07:53:12.750214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.799542 (+ 49328us) service_pool.cc:224] Handling call
0503 07:53:18.321775 (+5522233us) ts_tablet_manager.cc:1151] Deleting tablet 2b12c2f3cbf74edc9caf98853272c8b4
0503 07:53:18.321786 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.322767 (+ 981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5468585}
W20260503 07:53:18.325608 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2b12c2f3cbf74edc9caf98853272c8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b12c2f3cbf74edc9caf98853272c8b4 already in progress: creating tablet
I20260503 07:53:18.327135 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1219) took 5406 ms. Trace:
I20260503 07:53:18.329291 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e2bbca5c54234a80f23d9399df765" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.328087 1175 rpcz_store.cc:276] 0503 07:53:12.920711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.920925 (+ 214us) service_pool.cc:224] Handling call
0503 07:53:18.326150 (+5405225us) ts_tablet_manager.cc:1151] Deleting tablet e63ee58b76a24cdc9b701f44aad4d707
0503 07:53:18.326452 (+ 302us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.327118 (+ 666us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5404980}
W20260503 07:53:18.330068 988 leader_election.cc:343] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.330547 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e63ee58b76a24cdc9b701f44aad4d707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e63ee58b76a24cdc9b701f44aad4d707 already in progress: creating tablet
I20260503 07:53:18.331955 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1224) took 5349 ms. Trace:
I20260503 07:53:18.332738 1175 rpcz_store.cc:276] 0503 07:53:12.982419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.983749 (+ 1330us) service_pool.cc:224] Handling call
0503 07:53:18.330681 (+5346932us) ts_tablet_manager.cc:1151] Deleting tablet dad4408db9eb47c9bb925fb66b7d8b8b
0503 07:53:18.331007 (+ 326us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.331938 (+ 931us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5346427}
I20260503 07:53:18.335544 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1223) took 5353 ms. Trace:
W20260503 07:53:18.337109 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet dad4408db9eb47c9bb925fb66b7d8b8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dad4408db9eb47c9bb925fb66b7d8b8b already in progress: creating tablet
I20260503 07:53:18.336110 1175 rpcz_store.cc:276] 0503 07:53:12.982340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:12.984056 (+ 1716us) service_pool.cc:224] Handling call
0503 07:53:18.334794 (+5350738us) ts_tablet_manager.cc:1151] Deleting tablet 001ded76f1894772898cb660e501984d
0503 07:53:18.334804 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.335527 (+ 723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5349963}
W20260503 07:53:18.338631 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 001ded76f1894772898cb660e501984d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 001ded76f1894772898cb660e501984d already in progress: creating tablet
I20260503 07:53:18.339314 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1227) took 5000 ms. Trace:
I20260503 07:53:18.339780 1175 rpcz_store.cc:276] 0503 07:53:13.338606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.338645 (+ 39us) service_pool.cc:224] Handling call
0503 07:53:18.338168 (+4999523us) ts_tablet_manager.cc:1151] Deleting tablet 7f523d718ae8475390f78cf2af6758da
0503 07:53:18.338428 (+ 260us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.339130 (+ 702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4999265}
I20260503 07:53:18.343933 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1226) took 5005 ms. Trace:
W20260503 07:53:18.314399 854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 132943us
I20260503 07:53:18.344569 1175 rpcz_store.cc:276] 0503 07:53:13.338391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.339553 (+ 1162us) service_pool.cc:224] Handling call
0503 07:53:18.343010 (+5003457us) ts_tablet_manager.cc:1151] Deleting tablet ccbede2c323a420b8a0ca2434d4ad5b8
0503 07:53:18.343030 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.343915 (+ 885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5003016}
I20260503 07:53:18.347930 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1228) took 4787 ms. Trace:
W20260503 07:53:18.348421 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 7f523d718ae8475390f78cf2af6758da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f523d718ae8475390f78cf2af6758da already in progress: creating tablet
W20260503 07:53:18.348589 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet ccbede2c323a420b8a0ca2434d4ad5b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbede2c323a420b8a0ca2434d4ad5b8 already in progress: creating tablet
W20260503 07:53:18.349483 716 consensus_peers.cc:597] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ad24ddc82bd401fb5427e7415af3922. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.348485 1175 rpcz_store.cc:276] 0503 07:53:13.560456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.560523 (+ 67us) service_pool.cc:224] Handling call
0503 07:53:18.346712 (+4786189us) ts_tablet_manager.cc:1151] Deleting tablet d24ae9e604144ca589008d6697d849df
0503 07:53:18.346988 (+ 276us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.347673 (+ 685us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4785997}
I20260503 07:53:18.352226 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1229) took 4791 ms. Trace:
W20260503 07:53:18.352988 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d24ae9e604144ca589008d6697d849df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d24ae9e604144ca589008d6697d849df already in progress: creating tablet
I20260503 07:53:18.353034 1175 rpcz_store.cc:276] 0503 07:53:13.560562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.560689 (+ 127us) service_pool.cc:224] Handling call
0503 07:53:18.351275 (+4790586us) ts_tablet_manager.cc:1151] Deleting tablet d9269dd6a9af493a8452b7f657355933
0503 07:53:18.351287 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.352207 (+ 920us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4790199}
W20260503 07:53:18.354910 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet d9269dd6a9af493a8452b7f657355933 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9269dd6a9af493a8452b7f657355933 already in progress: creating tablet
I20260503 07:53:18.356489 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1230) took 4783 ms. Trace:
I20260503 07:53:18.357232 1175 rpcz_store.cc:276] 0503 07:53:13.573528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.573642 (+ 114us) service_pool.cc:224] Handling call
0503 07:53:18.355676 (+4782034us) ts_tablet_manager.cc:1151] Deleting tablet e1d0e93ae66c46749c4f7e9e495ae60a
0503 07:53:18.355687 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.356470 (+ 783us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4781605}
I20260503 07:53:18.359871 1175 tablet_replica.cc:333] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.360419 2916 raft_consensus.cc:493] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:18.360638 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e1d0e93ae66c46749c4f7e9e495ae60a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1d0e93ae66c46749c4f7e9e495ae60a already in progress: creating tablet
I20260503 07:53:18.360668 2916 raft_consensus.cc:515] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.361312 2916 leader_election.cc:290] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.362020 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21b0b39717f46f6be352c6361bd01c9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:18.362634 988 leader_election.cc:343] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.363139 1175 raft_consensus.cc:2243] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.364475 1175 raft_consensus.cc:2272] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.366294 887 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e68de86584803a449d63609f4b2c5 (DEFAULT_TABLE table=default.Table_0481de2191144ffc98fc266f156c0f72 [id=e03bda0e8eaa44f49d76c03efbf9e905]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:18.369992 1175 ts_tablet_manager.cc:1916] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.387921 3118 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
W20260503 07:53:18.394125 854 leader_election.cc:343] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 29fe06a56f70487ea7c479b107d83d8b
I20260503 07:53:18.394482 854 leader_election.cc:304] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.395161 3070 raft_consensus.cc:2749] T 29fe06a56f70487ea7c479b107d83d8b P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.408156 1171 tablet_bootstrap.cc:492] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.408113 3118 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:18.408318 1171 ts_tablet_manager.cc:1403] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.317s user 0.004s sys 0.031s
I20260503 07:53:18.409060 1171 raft_consensus.cc:359] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.409228 1171 raft_consensus.cc:385] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.409281 1171 raft_consensus.cc:740] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.409574 1171 consensus_queue.cc:260] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.410066 1171 ts_tablet_manager.cc:1434] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:18.410315 1171 tablet_bootstrap.cc:492] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.410604 3105 raft_consensus.cc:493] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.410765 3105 raft_consensus.cc:515] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.411581 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16bc543b2e84e8ca7df6c00f1acc0f7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.411777 1171 tablet_bootstrap.cc:654] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:18.412014 988 leader_election.cc:343] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.414368 3105 leader_election.cc:290] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:18.422971 588 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d6d1885dda594c1f9c1039111af4ce9b (table default.Table_2e796ff4d91140059cd7db8c8e61727c [id=55bbc9fb8905404abd9fe4fb6621c274], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d6d1885dda594c1f9c1039111af4ce9b consensus state has no leader
I20260503 07:53:18.423288 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.424482 3120 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260503 07:53:18.425107 3119 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:18.425702 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3fcb4d83f64f6182a78a1a02da39d6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.429070 1175 ts_tablet_manager.cc:1929] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:18.429886 1175 log.cc:1199] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/ef666aa007504682bc044cbd0b56060d
I20260503 07:53:18.432327 1175 ts_tablet_manager.cc:1950] T ef666aa007504682bc044cbd0b56060d P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.433889 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1329) took 1134 ms. Trace:
I20260503 07:53:18.433990 892 rpcz_store.cc:276] 0503 07:53:17.299806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.859978 (+560172us) service_pool.cc:224] Handling call
0503 07:53:17.907976 (+ 47998us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.908135 (+ 159us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.118096 (+209961us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.418841 (+300745us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.433872 (+ 15031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.436666 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1232) took 4831 ms. Trace:
I20260503 07:53:18.436846 1175 rpcz_store.cc:276] 0503 07:53:13.605295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.605342 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:18.359362 (+4754020us) ts_tablet_manager.cc:1151] Deleting tablet ef666aa007504682bc044cbd0b56060d
0503 07:53:18.359602 (+ 240us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.393621 (+ 34019us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.428561 (+ 34940us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.436606 (+ 8045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4753504}
I20260503 07:53:18.437511 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet ef666aa007504682bc044cbd0b56060d (table default.Table_6d19f1e09913434d875e3a17f0832791 [id=8e6e8a89691d40948e0dd8e65e7c63fb]) successfully deleted
I20260503 07:53:18.438273 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1323) took 1138 ms. Trace:
I20260503 07:53:18.438441 888 rpcz_store.cc:276] 0503 07:53:17.299305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.814063 (+514758us) service_pool.cc:224] Handling call
0503 07:53:17.819759 (+ 5696us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:17.819786 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.000395 (+180609us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.420909 (+420514us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.438254 (+ 17345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.441390 1175 tablet_replica.cc:333] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.442054 3122 tablet.cc:1724] T c4ba5e9cfe6b4f24a8f91c571416dae3 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:18.443662 1175 raft_consensus.cc:2243] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.445838 1171 tablet_bootstrap.cc:492] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.445986 1171 ts_tablet_manager.cc:1403] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260503 07:53:18.446774 1171 raft_consensus.cc:359] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.446961 1171 raft_consensus.cc:385] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.447047 1171 raft_consensus.cc:740] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.447299 1171 consensus_queue.cc:260] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.447979 1171 ts_tablet_manager.cc:1434] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:18.448304 1171 tablet_bootstrap.cc:492] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.449827 1171 tablet_bootstrap.cc:654] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.458174 1175 raft_consensus.cc:2272] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.460645 1175 ts_tablet_manager.cc:1916] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.469715 2924 consensus_queue.cc:1048] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.479380 1171 tablet_bootstrap.cc:492] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.479686 1171 ts_tablet_manager.cc:1403] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260503 07:53:18.481246 1171 raft_consensus.cc:359] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.481926 1171 raft_consensus.cc:385] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.482056 1171 raft_consensus.cc:740] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.482414 1171 consensus_queue.cc:260] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.485743 1171 ts_tablet_manager.cc:1434] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260503 07:53:18.487562 1171 tablet_bootstrap.cc:492] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.495581 1171 tablet_bootstrap.cc:654] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.507761 1175 ts_tablet_manager.cc:1929] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.508787 1175 log.cc:1199] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/cf24705f7d004254bf8456c063634d65
I20260503 07:53:18.511776 1175 ts_tablet_manager.cc:1950] T cf24705f7d004254bf8456c063634d65 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.516258 3070 raft_consensus.cc:493] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.516409 3070 raft_consensus.cc:515] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.517225 3070 leader_election.cc:290] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:18.518254 851 leader_election.cc:343] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: db13f91ef1d740c387bacbb689ddf1a8
I20260503 07:53:18.523967 1165 tablet_bootstrap.cc:700] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Time spent opening tablet: real 0.301s user 0.000s sys 0.001s
I20260503 07:53:18.524498 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1144) took 5231 ms. Trace:
I20260503 07:53:18.524582 1174 rpcz_store.cc:276] 0503 07:53:13.292559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.292607 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:18.192747 (+4900140us) ts_tablet_manager.cc:1151] Deleting tablet dad4408db9eb47c9bb925fb66b7d8b8b
0503 07:53:18.422987 (+230240us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.524476 (+101489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4898968}
I20260503 07:53:18.525128 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1147) took 5231 ms. Trace:
I20260503 07:53:18.525213 1174 rpcz_store.cc:276] 0503 07:53:13.293875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.293916 (+ 41us) service_pool.cc:224] Handling call
0503 07:53:18.524962 (+5231046us) ts_tablet_manager.cc:1151] Deleting tablet ccbede2c323a420b8a0ca2434d4ad5b8
0503 07:53:18.524974 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.525111 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5226527}
I20260503 07:53:18.528234 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1233) took 4922 ms. Trace:
I20260503 07:53:18.528324 1175 rpcz_store.cc:276] 0503 07:53:13.605440 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.605481 (+ 41us) service_pool.cc:224] Handling call
0503 07:53:18.441307 (+4835826us) ts_tablet_manager.cc:1151] Deleting tablet cf24705f7d004254bf8456c063634d65
0503 07:53:18.441320 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.480135 (+ 38815us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.507474 (+ 27339us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.528207 (+ 20733us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4835202}
I20260503 07:53:18.528676 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1234) took 4922 ms. Trace:
I20260503 07:53:18.528752 1175 rpcz_store.cc:276] 0503 07:53:13.606465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.629187 (+ 22722us) service_pool.cc:224] Handling call
0503 07:53:18.528593 (+4899406us) ts_tablet_manager.cc:1151] Deleting tablet 766799446d1a480ca04246b0aec14852
0503 07:53:18.528602 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.528659 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4899205}
I20260503 07:53:18.528934 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet cf24705f7d004254bf8456c063634d65 (table default.Table_f82ad0b6ce5b4d82bee70b3e41b900ab [id=ef4ceb2db79043d99f04dec314043554]) successfully deleted
I20260503 07:53:18.529103 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1235) took 4899 ms. Trace:
W20260503 07:53:18.529215 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 766799446d1a480ca04246b0aec14852 because the tablet was not found. No further retry: Not found: Tablet not found: 766799446d1a480ca04246b0aec14852
I20260503 07:53:18.529168 1175 rpcz_store.cc:276] 0503 07:53:13.629566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.630627 (+ 1061us) service_pool.cc:224] Handling call
0503 07:53:18.529038 (+4898411us) ts_tablet_manager.cc:1151] Deleting tablet 4f6c9fb96d5a4397b51611254be1a970
0503 07:53:18.529046 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.529090 (+ 44us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4898229}
I20260503 07:53:18.529582 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1236) took 4898 ms. Trace:
I20260503 07:53:18.529656 1175 rpcz_store.cc:276] 0503 07:53:13.630978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.631264 (+ 286us) service_pool.cc:224] Handling call
0503 07:53:18.529501 (+4898237us) ts_tablet_manager.cc:1151] Deleting tablet e662fd10883b401c8f0d4a45735e2639
0503 07:53:18.529511 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.529567 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4898080}
I20260503 07:53:18.529911 1175 tablet_replica.cc:333] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.530130 1175 raft_consensus.cc:2243] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.530912 1175 raft_consensus.cc:2272] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:18.531025 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 4f6c9fb96d5a4397b51611254be1a970 because the tablet was not found. No further retry: Not found: Tablet not found: 4f6c9fb96d5a4397b51611254be1a970
W20260503 07:53:18.531224 588 catalog_manager.cc:4969] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet e662fd10883b401c8f0d4a45735e2639 because the tablet was not found. No further retry: Not found: Tablet not found: e662fd10883b401c8f0d4a45735e2639
I20260503 07:53:18.531610 1175 ts_tablet_manager.cc:1916] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.552119 1165 tablet_bootstrap.cc:654] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:18.266878 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 70243e24ae17460f9d3e20720a9bfa53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70243e24ae17460f9d3e20720a9bfa53 already in progress: creating tablet
W20260503 07:53:18.553869 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 287183us
W20260503 07:53:18.554103 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 5d2f95e3ad844bc39593787e38a45bad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d2f95e3ad844bc39593787e38a45bad already in progress: creating tablet
W20260503 07:53:18.554425 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 01c7925b82934b59839a0e8ddf99356d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01c7925b82934b59839a0e8ddf99356d already in progress: creating tablet
I20260503 07:53:18.554590 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet bf51c959093d4579a5916c49e1790737 (table default.Table_a740af6e2f844b129450e16ac9bd0a46 [id=c3ebb0451cd043b3881233a5cc019e07]) successfully deleted
I20260503 07:53:18.554756 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet b269ee59036d4c2f866b6b2bf45c35cf (table default.Table_63fdff7963d7448389a83100d398dd64 [id=07bab04461974a1088917f8c34d18388]) successfully deleted
W20260503 07:53:18.554922 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e63ee58b76a24cdc9b701f44aad4d707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e63ee58b76a24cdc9b701f44aad4d707 already in progress: creating tablet
W20260503 07:53:18.555091 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 3b10183f49464684acfa54e7d10ccee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b10183f49464684acfa54e7d10ccee2 already in progress: creating tablet
W20260503 07:53:18.555249 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet dad4408db9eb47c9bb925fb66b7d8b8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dad4408db9eb47c9bb925fb66b7d8b8b already in progress: creating tablet
W20260503 07:53:18.555405 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ccbede2c323a420b8a0ca2434d4ad5b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbede2c323a420b8a0ca2434d4ad5b8 already in progress: creating tablet
I20260503 07:53:18.559427 905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.559553 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:18.559768 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb33e9818334d4a8ea4e648c3dd7cac" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:18.560499 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a6b2fbf1ea4a109a63f0b3d224434a" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.562578 2708 consensus_queue.cc:1048] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.563660 1175 ts_tablet_manager.cc:1929] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.563778 1175 log.cc:1199] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b269ee59036d4c2f866b6b2bf45c35cf
W20260503 07:53:18.563877 715 leader_election.cc:343] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.564148 1175 ts_tablet_manager.cc:1950] T b269ee59036d4c2f866b6b2bf45c35cf P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:18.564260 715 leader_election.cc:343] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.564561 715 leader_election.cc:343] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.565068 715 consensus_peers.cc:597] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.565233 715 consensus_peers.cc:597] T ea2683448c3f4df3bb0b14683d8b5222 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.565372 715 consensus_peers.cc:597] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.565500 715 leader_election.cc:343] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.567466 2964 consensus_queue.cc:1048] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.565033 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1237) took 4933 ms. Trace:
I20260503 07:53:18.568361 1175 rpcz_store.cc:276] 0503 07:53:13.631569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.631839 (+ 270us) service_pool.cc:224] Handling call
0503 07:53:18.529864 (+4898025us) ts_tablet_manager.cc:1151] Deleting tablet b269ee59036d4c2f866b6b2bf45c35cf
0503 07:53:18.529873 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.535377 (+ 5504us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.563608 (+ 28231us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.565012 (+ 1404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":616,"tablet-delete.queue_time_us":4897861}
W20260503 07:53:18.567556 986 leader_election.cc:343] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.568817 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b269ee59036d4c2f866b6b2bf45c35cf (table default.Table_63fdff7963d7448389a83100d398dd64 [id=07bab04461974a1088917f8c34d18388]) successfully deleted
I20260503 07:53:18.568848 986 leader_election.cc:304] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.569216 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1240) took 4852 ms. Trace:
I20260503 07:53:18.569310 1175 rpcz_store.cc:276] 0503 07:53:13.716355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.716472 (+ 117us) service_pool.cc:224] Handling call
0503 07:53:18.569099 (+4852627us) ts_tablet_manager.cc:1151] Deleting tablet 797372a021aa48bab4ca695d897164d8
0503 07:53:18.569110 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.569200 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4852400}
I20260503 07:53:18.569680 2816 raft_consensus.cc:2749] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:18.569723 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 797372a021aa48bab4ca695d897164d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 797372a021aa48bab4ca695d897164d8 already in progress: creating tablet
W20260503 07:53:18.570231 986 leader_election.cc:343] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.570338 986 leader_election.cc:304] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.570583 2987 raft_consensus.cc:2749] T ae3fcb4d83f64f6182a78a1a02da39d6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.571357 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1143) took 5278 ms. Trace:
I20260503 07:53:18.571430 1174 rpcz_store.cc:276] 0503 07:53:13.292456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.292492 (+ 36us) service_pool.cc:224] Handling call
0503 07:53:18.571241 (+5278749us) ts_tablet_manager.cc:1151] Deleting tablet 001ded76f1894772898cb660e501984d
0503 07:53:18.571252 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.571340 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5272625}
I20260503 07:53:18.571790 1174 tablet_replica.cc:333] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:18.571961 1174 raft_consensus.cc:2243] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.572258 1174 raft_consensus.cc:2272] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.572758 1174 ts_tablet_manager.cc:1916] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.574296 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1241) took 4857 ms. Trace:
I20260503 07:53:18.574376 1175 rpcz_store.cc:276] 0503 07:53:13.717295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.717391 (+ 96us) service_pool.cc:224] Handling call
0503 07:53:18.574192 (+4856801us) ts_tablet_manager.cc:1151] Deleting tablet 369b0b38c0024cf2ba0ff3d13f1d9276
0503 07:53:18.574200 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.574273 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4856631}
W20260503 07:53:18.574712 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369b0b38c0024cf2ba0ff3d13f1d9276 already in progress: creating tablet
I20260503 07:53:18.576695 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1242) took 4858 ms. Trace:
I20260503 07:53:18.576778 1175 rpcz_store.cc:276] 0503 07:53:13.718152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.718208 (+ 56us) service_pool.cc:224] Handling call
0503 07:53:18.576576 (+4858368us) ts_tablet_manager.cc:1151] Deleting tablet 2b08e403756a4d99867263d0941d2120
0503 07:53:18.576588 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.576681 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4858207}
W20260503 07:53:18.577222 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 2b08e403756a4d99867263d0941d2120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b08e403756a4d99867263d0941d2120 already in progress: creating tablet
I20260503 07:53:18.577899 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e2bbca5c54234a80f23d9399df765" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.583534 1175 tablet_replica.cc:333] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.583513 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21b0b39717f46f6be352c6361bd01c9" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.583710 1175 raft_consensus.cc:2243] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.583979 1175 raft_consensus.cc:2272] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.584474 1175 ts_tablet_manager.cc:1916] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.588766 767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16bc543b2e84e8ca7df6c00f1acc0f7" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.591879 2987 raft_consensus.cc:493] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.592005 2987 raft_consensus.cc:515] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.592597 2987 leader_election.cc:290] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:18.593719 986 leader_election.cc:343] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.593820 986 leader_election.cc:304] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.593782 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.594300 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:18.594561 988 leader_election.cc:343] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.594849 2987 raft_consensus.cc:2749] T 405e2bbca5c54234a80f23d9399df765 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.595455 2964 consensus_queue.cc:1048] T c11304c2f96f4518bedc07c23af81f50 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:18.595468 986 leader_election.cc:343] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.599436 986 leader_election.cc:304] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.599643 2987 raft_consensus.cc:2749] T a21b0b39717f46f6be352c6361bd01c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:18.599968 986 leader_election.cc:343] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.600090 986 leader_election.cc:304] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.604256 2987 raft_consensus.cc:2749] T b16bc543b2e84e8ca7df6c00f1acc0f7 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.605428 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet c0f80a713d1648109f12e11099ebbb5c
I20260503 07:53:18.605970 598 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1677) took 1197 ms. Trace:
I20260503 07:53:18.606060 598 rpcz_store.cc:276] 0503 07:53:17.408802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.699930 (+291128us) service_pool.cc:224] Handling call
0503 07:53:17.732139 (+ 32209us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9db06 00007ff8f7832486 00007ff8f78321b5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:17.732554 (+ 415us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:17.732686 (+ 132us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:17.732764 (+ 78us) catalog_manager.cc:2824] Locking tablets
0503 07:53:17.732910 (+ 146us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:18.605242 (+872332us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:18.605348 (+ 106us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:18.605392 (+ 44us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:18.605949 (+ 557us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.246768 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.388442 (+141674us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.388449 (+ 7us) write_op.cc:435] Acquired schema lock
0503 07:53:18.388497 (+ 48us) tablet.cc:662] Decoding operations
0503 07:53:18.388875 (+ 378us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.388939 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.388945 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.389303 (+ 358us) tablet.cc:701] Row locks acquired
0503 07:53:18.389305 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.389434 (+ 129us) write_op.cc:270] Start()
0503 07:53:18.389517 (+ 83us) write_op.cc:276] Timestamp: P: 1777794798389339 usec, L: 0
0503 07:53:18.389521 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.390177 (+ 656us) log.cc:844] Serialized 725 byte log entry
0503 07:53:18.603952 (+213775us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.604546 (+ 594us) write_op.cc:301] APPLY: starting
0503 07:53:18.604565 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.604637 (+ 72us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.604668 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.604754 (+ 86us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.604799 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:18.604810 (+ 11us) write_op.cc:312] APPLY: finished
0503 07:53:18.604894 (+ 84us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.604962 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.604985 (+ 23us) write_op.cc:454] Released schema lock
0503 07:53:18.604993 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.605088 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.605095 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":73563904,"child_traces":[["op",{"apply.queue_time_us":520,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":518,"num_ops":2,"prepare.queue_time_us":512972,"prepare.run_cpu_time_us":1855,"prepare.run_wall_time_us":143802,"raft.queue_time_us":216,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"replication_time_us":214390,"spinlock_wait_cycles":8064}]]}
I20260503 07:53:18.607506 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f80a713d1648109f12e11099ebbb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.607649 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f80a713d1648109f12e11099ebbb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:18.609242 986 leader_election.cc:343] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.609385 986 leader_election.cc:304] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.609604 2987 raft_consensus.cc:2749] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.613099 1175 ts_tablet_manager.cc:1929] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.613194 1175 log.cc:1199] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/7336c1df59754cd58c0c290b84fc0d7a
I20260503 07:53:18.613565 1175 ts_tablet_manager.cc:1950] T 7336c1df59754cd58c0c290b84fc0d7a P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.632670 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1244) took 4884 ms. Trace:
I20260503 07:53:18.632794 1175 rpcz_store.cc:276] 0503 07:53:13.748133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.748227 (+ 94us) service_pool.cc:224] Handling call
0503 07:53:18.583494 (+4835267us) ts_tablet_manager.cc:1151] Deleting tablet 7336c1df59754cd58c0c290b84fc0d7a
0503 07:53:18.583502 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.587328 (+ 3826us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.613047 (+ 25719us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.632647 (+ 19600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18338,"tablet-delete.queue_time_us":4835082}
I20260503 07:53:18.633208 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 7336c1df59754cd58c0c290b84fc0d7a (table default.Table_d8ce6874d4994d94a17c0514a7528886 [id=6c1e82bcfdc24844a1061e916c0ecca6]) successfully deleted
I20260503 07:53:18.634931 1175 tablet_replica.cc:333] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.635195 1175 raft_consensus.cc:2243] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.636587 1175 raft_consensus.cc:2272] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.637161 1175 ts_tablet_manager.cc:1916] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:18.637224 592 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51204502f2ff403e9e074d8a1b847aeb consensus state has no leader
I20260503 07:53:18.637382 592 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:44308 (request call id 1678) took 1228 ms. Trace:
I20260503 07:53:18.637454 592 rpcz_store.cc:276] 0503 07:53:17.408867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.878910 (+470043us) service_pool.cc:224] Handling call
0503 07:53:17.905077 (+ 26167us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9eda6 00007ff8f7834146 00007ff8f7833e75 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:17.905317 (+ 240us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:17.905528 (+ 211us) catalog_manager.cc:3725] Apply alter schema
0503 07:53:17.905697 (+ 169us) catalog_manager.cc:3757] Acquired catalog manager lock
0503 07:53:17.905772 (+ 75us) catalog_manager.cc:3915] Updating metadata on disk
0503 07:53:18.637037 (+731265us) catalog_manager.cc:3946] Committing alterations to in-memory state
0503 07:53:18.637366 (+ 329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.390608 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.390917 (+ 309us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.390972 (+ 55us) write_op.cc:435] Acquired schema lock
0503 07:53:18.390975 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:18.391203 (+ 228us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.391260 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.391265 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:18.391418 (+ 153us) tablet.cc:701] Row locks acquired
0503 07:53:18.391421 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:18.391568 (+ 147us) write_op.cc:270] Start()
0503 07:53:18.391890 (+ 322us) write_op.cc:276] Timestamp: P: 1777794798391455 usec, L: 0
0503 07:53:18.391894 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.603449 (+211555us) log.cc:844] Serialized 405 byte log entry
0503 07:53:18.636194 (+ 32745us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.636308 (+ 114us) write_op.cc:301] APPLY: starting
0503 07:53:18.636326 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.636373 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.636400 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.636461 (+ 61us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.636495 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:18.636503 (+ 8us) write_op.cc:312] APPLY: finished
0503 07:53:18.636584 (+ 81us) log.cc:844] Serialized 23 byte log entry
0503 07:53:18.636651 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.636670 (+ 19us) write_op.cc:454] Released schema lock
0503 07:53:18.636678 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.636755 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.636762 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":59659008,"child_traces":[["op",{"apply.queue_time_us":45,"apply.run_cpu_time_us":439,"apply.run_wall_time_us":438,"num_ops":1,"prepare.queue_time_us":484279,"prepare.run_cpu_time_us":1612,"prepare.run_wall_time_us":212996,"raft.queue_time_us":632,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":268,"replication_time_us":244178}]]}
I20260503 07:53:18.640430 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_eb6848d9d0ec490e8bbd95a655d6404d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.641001 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb6848d9d0ec490e8bbd95a655d6404d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.639992 3140 tablet.cc:1724] T 54dbfadef15548ec95e4db3725560ca9 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260503 07:53:18.648873 2987 consensus_queue.cc:1048] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.663951 1175 ts_tablet_manager.cc:1929] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.664213 1165 tablet_bootstrap.cc:492] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:18.664345 1165 ts_tablet_manager.cc:1403] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.594s user 0.003s sys 0.004s
I20260503 07:53:18.664984 1165 raft_consensus.cc:359] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.665158 1165 raft_consensus.cc:385] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.665208 1165 raft_consensus.cc:740] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.669103 748 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f80a713d1648109f12e11099ebbb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:17 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.672864 1175 log.cc:1199] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/df60413555764bcab464b18c6a3370ce
I20260503 07:53:18.673287 1175 ts_tablet_manager.cc:1950] T df60413555764bcab464b18c6a3370ce P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.673600 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1247) took 4903 ms. Trace:
I20260503 07:53:18.673719 1175 rpcz_store.cc:276] 0503 07:53:13.770615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.770689 (+ 74us) service_pool.cc:224] Handling call
0503 07:53:18.634878 (+4864189us) ts_tablet_manager.cc:1151] Deleting tablet df60413555764bcab464b18c6a3370ce
0503 07:53:18.634890 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.640124 (+ 5234us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.663900 (+ 23776us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.673585 (+ 9685us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4863969}
I20260503 07:53:18.674256 1175 tablet_replica.cc:333] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.674301 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet df60413555764bcab464b18c6a3370ce (table default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a [id=80c5584e658b4237a6580fd0d0a05a0d]) successfully deleted
I20260503 07:53:18.675004 3070 raft_consensus.cc:493] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:18.675168 3070 raft_consensus.cc:515] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.675560 1175 raft_consensus.cc:2243] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.675704 1175 raft_consensus.cc:2272] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.675798 3070 leader_election.cc:290] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:18.676601 1175 ts_tablet_manager.cc:1916] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:18.676920 851 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 8ffec630db9a430fa3006268b0e28fcd
W20260503 07:53:18.680866 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 001ded76f1894772898cb660e501984d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 001ded76f1894772898cb660e501984d already in progress: creating tablet
W20260503 07:53:18.681401 854 leader_election.cc:343] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: db13f91ef1d740c387bacbb689ddf1a8
I20260503 07:53:18.689774 2987 raft_consensus.cc:493] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.689917 2987 raft_consensus.cc:515] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.690654 2987 leader_election.cc:290] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.697796 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eacb83c81442d4b6bfc25717fe21e8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:18.699214 986 leader_election.cc:343] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.707674 1175 ts_tablet_manager.cc:1929] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.707823 1175 log.cc:1199] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f54aaadc3d22437286303caac65c7cb4
I20260503 07:53:18.716275 2987 raft_consensus.cc:493] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.716444 2987 raft_consensus.cc:515] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.716965 1175 ts_tablet_manager.cc:1950] T f54aaadc3d22437286303caac65c7cb4 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.717173 2987 leader_election.cc:290] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.718240 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3724490a7ed4afc82e4f7ebc1190f76" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.718851 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1253) took 4856 ms. Trace:
I20260503 07:53:18.718993 1175 rpcz_store.cc:276] 0503 07:53:13.862747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.862819 (+ 72us) service_pool.cc:224] Handling call
0503 07:53:18.674176 (+4811357us) ts_tablet_manager.cc:1151] Deleting tablet f54aaadc3d22437286303caac65c7cb4
0503 07:53:18.674187 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.695115 (+ 20928us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.707612 (+ 12497us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.718833 (+ 11221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4811142}
I20260503 07:53:18.719502 1175 tablet_replica.cc:333] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.719830 1175 raft_consensus.cc:2243] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.691356 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eacb83c81442d4b6bfc25717fe21e8" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.718153 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3724490a7ed4afc82e4f7ebc1190f76" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.721227 854 leader_election.cc:304] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:18.720053 986 leader_election.cc:343] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.721509 3070 raft_consensus.cc:2749] T db13f91ef1d740c387bacbb689ddf1a8 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:18.721529 988 leader_election.cc:343] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.721624 988 leader_election.cc:304] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:18.721952 988 leader_election.cc:343] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.722038 988 leader_election.cc:304] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.722209 3132 raft_consensus.cc:2749] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.722384 2987 raft_consensus.cc:2749] T 23eacb83c81442d4b6bfc25717fe21e8 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.722641 1175 raft_consensus.cc:2272] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.723287 1175 ts_tablet_manager.cc:1916] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:18.723744 715 consensus_peers.cc:597] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:18.723877 854 leader_election.cc:343] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 8ffec630db9a430fa3006268b0e28fcd
W20260503 07:53:18.723953 715 consensus_peers.cc:597] T 855100ffa19d4fe7a92ae13ca5171adb P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.723966 854 leader_election.cc:304] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.724160 3070 raft_consensus.cc:2749] T 8ffec630db9a430fa3006268b0e28fcd P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:53:18.724355 715 consensus_peers.cc:597] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.689538 599 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:44308 (request call id 1679) took 1278 ms. Trace:
W20260503 07:53:18.689649 594 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.2:51725 (request call id 214) took 850 ms (client timeout 1000 ms). Trace:
W20260503 07:53:18.731827 585 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 50959.8us
W20260503 07:53:18.731909 594 rpcz_store.cc:269] 0503 07:53:17.839487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.857049 (+ 17562us) service_pool.cc:224] Handling call
0503 07:53:17.865737 (+ 8688us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:18.689630 (+823893us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":17572096}
I20260503 07:53:18.732465 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bc34fecd334a40c2a60d01eb398c6132"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.733155 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc34fecd334a40c2a60d01eb398c6132 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.733225 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.733417 743 tablet_service.cc:1558] Processing DeleteTablet for tablet bd71a81efd3b40c6b96bb77f74e8a4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.733547 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 855100ffa19d4fe7a92ae13ca5171adb with delete_type TABLET_DATA_DELETED (replaced by tablet 822c15b68f61466584eec0702196a5c5) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.733681 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c11304c2f96f4518bedc07c23af81f50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.734256 741 tablet_service.cc:1558] Processing DeleteTablet for tablet bf51c959093d4579a5916c49e1790737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.731835 599 rpcz_store.cc:276] 0503 07:53:17.408934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.916285 (+507351us) service_pool.cc:224] Handling call
0503 07:53:17.959051 (+ 42766us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9cb13 00007ff8f78307c6 00007ff8f78304f5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:17.959963 (+ 912us) catalog_manager.cc:2101] Acquired catalog manager lock
0503 07:53:17.960594 (+ 631us) catalog_manager.cc:2147] Created new table and tablet info
0503 07:53:18.687146 (+726552us) catalog_manager.cc:2207] Wrote table and tablets to system table
0503 07:53:18.687264 (+ 118us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0503 07:53:18.687409 (+ 145us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.603598 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.603727 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.603734 (+ 7us) write_op.cc:435] Acquired schema lock
0503 07:53:18.603737 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:18.603827 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.603838 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.603842 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.603918 (+ 76us) tablet.cc:701] Row locks acquired
0503 07:53:18.603920 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.603946 (+ 26us) write_op.cc:270] Start()
0503 07:53:18.603979 (+ 33us) write_op.cc:276] Timestamp: P: 1777794798603928 usec, L: 0
0503 07:53:18.603982 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.638227 (+ 34245us) log.cc:844] Serialized 433 byte log entry
0503 07:53:18.638409 (+ 182us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007ff8f8eaef22 00007ff8fa297c55 00007ff8fa296779 00007ff8fa29eba0 00007ff8fa29e9ad 0000000000aa4cac 00007ff8ecfdbf6f 00007ff8ecfdf28b 00007ff8ecfdf108 0000000000aa4cac
0503 07:53:18.685743 (+ 47334us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.685858 (+ 115us) write_op.cc:301] APPLY: starting
0503 07:53:18.685876 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.685921 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.685923 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.686027 (+ 104us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.686079 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 07:53:18.686085 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:18.686166 (+ 81us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.686233 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.686258 (+ 25us) write_op.cc:454] Released schema lock
0503 07:53:18.686266 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.686351 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.686355 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":97622912,"child_traces":[["op",{"apply.queue_time_us":46,"apply.run_cpu_time_us":491,"apply.run_wall_time_us":491,"num_ops":2,"prepare.queue_time_us":642424,"prepare.run_cpu_time_us":937,"prepare.run_wall_time_us":34841,"replication_time_us":81727,"spinlock_wait_cycles":78335232}]]}
I20260503 07:53:18.736264 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9d710791f45c4fd48dd1f1ea9a01e532"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.736768 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d710791f45c4fd48dd1f1ea9a01e532 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.737569 1174 ts_tablet_manager.cc:1929] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.737654 1174 log.cc:1199] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/c1c631d3da8f4ec29690c548097a454b
I20260503 07:53:18.737972 1174 ts_tablet_manager.cc:1950] T c1c631d3da8f4ec29690c548097a454b P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
W20260503 07:53:18.696938 596 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.1:41325 (request call id 190) took 1087 ms (client timeout 1000 ms). Trace:
I20260503 07:53:18.704180 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a401317bf551401990260fa0419fd924
I20260503 07:53:18.738660 601 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1681) took 1329 ms. Trace:
I20260503 07:53:18.738742 601 rpcz_store.cc:276] 0503 07:53:17.409098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.126844 (+717746us) service_pool.cc:224] Handling call
0503 07:53:18.129820 (+ 2976us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9db06 00007ff8f7832486 00007ff8f78321b5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:18.185829 (+ 56009us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.185957 (+ 128us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:18.186042 (+ 85us) catalog_manager.cc:2824] Locking tablets
0503 07:53:18.186192 (+ 150us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:18.704006 (+517814us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:18.704096 (+ 90us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:18.704141 (+ 45us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:18.738637 (+ 34496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.639594 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.639669 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.639673 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:18.639675 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.639746 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.639753 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.639757 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.639826 (+ 69us) tablet.cc:701] Row locks acquired
0503 07:53:18.639828 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.639852 (+ 24us) write_op.cc:270] Start()
0503 07:53:18.639875 (+ 23us) write_op.cc:276] Timestamp: P: 1777794798639830 usec, L: 0
0503 07:53:18.639879 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.640041 (+ 162us) log.cc:844] Serialized 725 byte log entry
0503 07:53:18.702391 (+ 62350us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.703145 (+ 754us) write_op.cc:301] APPLY: starting
0503 07:53:18.703154 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.703185 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.703210 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.703266 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.703302 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:18.703308 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:18.703364 (+ 56us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.703400 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.703417 (+ 17us) write_op.cc:454] Released schema lock
0503 07:53:18.703442 (+ 25us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.703506 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.703511 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":6307072,"child_traces":[["op",{"apply.queue_time_us":723,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":348,"num_ops":2,"prepare.queue_time_us":452720,"prepare.run_cpu_time_us":514,"prepare.run_wall_time_us":513,"replication_time_us":62500}]]}
I20260503 07:53:18.739517 1175 ts_tablet_manager.cc:1929] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.739609 1175 log.cc:1199] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/9aa3759511d942bfbc6e50ea2e2f2777
I20260503 07:53:18.739571 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_e7626410afd741caa51dc5e4c26e1ad7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:18.739943 1175 ts_tablet_manager.cc:1950] T 9aa3759511d942bfbc6e50ea2e2f2777 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:18.740048 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7626410afd741caa51dc5e4c26e1ad7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.740525 3139 tablet.cc:1724] T 2146fa5f2fd54bf0baae1681ffb3547b P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260503 07:53:18.704211 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5b9132dec40e4392aeb19613daaa80ca
I20260503 07:53:18.741473 600 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1682) took 1332 ms. Trace:
I20260503 07:53:18.741557 600 rpcz_store.cc:276] 0503 07:53:17.409164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.234219 (+825055us) service_pool.cc:224] Handling call
0503 07:53:18.234741 (+ 522us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.234926 (+ 185us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:18.234994 (+ 68us) catalog_manager.cc:2824] Locking tablets
0503 07:53:18.235157 (+ 163us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:18.703941 (+468784us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:18.704041 (+ 100us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:18.704086 (+ 45us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:18.741452 (+ 37366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.640143 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.640247 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.640251 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:18.640253 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.640336 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.640345 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.640350 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.640433 (+ 83us) tablet.cc:701] Row locks acquired
0503 07:53:18.640435 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.640462 (+ 27us) write_op.cc:270] Start()
0503 07:53:18.640485 (+ 23us) write_op.cc:276] Timestamp: P: 1777794798640440 usec, L: 0
0503 07:53:18.640497 (+ 12us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.640620 (+ 123us) log.cc:844] Serialized 725 byte log entry
0503 07:53:18.702486 (+ 61866us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.703530 (+ 1044us) write_op.cc:301] APPLY: starting
0503 07:53:18.703544 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.703583 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.703609 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.703678 (+ 69us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.703718 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:18.703727 (+ 9us) write_op.cc:312] APPLY: finished
0503 07:53:18.703791 (+ 64us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.703836 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.703856 (+ 20us) write_op.cc:454] Released schema lock
0503 07:53:18.703863 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":86,"child_traces":[["op",{"apply.queue_time_us":987,"apply.run_cpu_time_us":407,"apply.run_wall_time_us":622,"num_ops":2,"prepare.queue_time_us":404194,"prepare.run_cpu_time_us":522,"prepare.run_wall_time_us":521,"replication_time_us":61967,"thread_start_us":17668,"threads_started":1}]]}
I20260503 07:53:18.742161 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a5fb280f25774d6c9d4dc45c968726f6" } modify_external_catalogs: true
I20260503 07:53:18.742316 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_a5fb280f25774d6c9d4dc45c968726f6" } modify_external_catalogs: true
W20260503 07:53:18.704442 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41c0a9d223b040bdb8cd55629914357b consensus state has no leader
I20260503 07:53:18.742971 595 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:44308 (request call id 1680) took 1333 ms. Trace:
I20260503 07:53:18.743217 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a401317bf551401990260fa0419fd924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.743050 595 rpcz_store.cc:276] 0503 07:53:17.409027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.064097 (+655070us) service_pool.cc:224] Handling call
0503 07:53:18.064507 (+ 410us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.064787 (+ 280us) catalog_manager.cc:3725] Apply alter schema
0503 07:53:18.064986 (+ 199us) catalog_manager.cc:3757] Acquired catalog manager lock
0503 07:53:18.065101 (+ 115us) catalog_manager.cc:3915] Updating metadata on disk
0503 07:53:18.703961 (+638860us) catalog_manager.cc:3946] Committing alterations to in-memory state
0503 07:53:18.742956 (+ 38995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.639122 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.639214 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.639219 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:18.639221 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.639291 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.639299 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.639303 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:18.639344 (+ 41us) tablet.cc:701] Row locks acquired
0503 07:53:18.639346 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.639368 (+ 22us) write_op.cc:270] Start()
0503 07:53:18.639390 (+ 22us) write_op.cc:276] Timestamp: P: 1777794798639348 usec, L: 0
0503 07:53:18.639392 (+ 2us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.639505 (+ 113us) log.cc:844] Serialized 405 byte log entry
0503 07:53:18.702329 (+ 62824us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.702551 (+ 222us) write_op.cc:301] APPLY: starting
0503 07:53:18.702577 (+ 26us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.702641 (+ 64us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.702662 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.702717 (+ 55us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.702747 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:18.702755 (+ 8us) write_op.cc:312] APPLY: finished
0503 07:53:18.702873 (+ 118us) log.cc:844] Serialized 23 byte log entry
0503 07:53:18.702947 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.702965 (+ 18us) write_op.cc:454] Released schema lock
0503 07:53:18.702972 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.703067 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.703073 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":129,"apply.run_cpu_time_us":509,"apply.run_wall_time_us":510,"num_ops":1,"prepare.queue_time_us":573499,"prepare.run_cpu_time_us":439,"prepare.run_wall_time_us":426,"replication_time_us":62910}]]}
I20260503 07:53:18.743702 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c41b22db49e54938beddb19dc14da59d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.744212 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c41b22db49e54938beddb19dc14da59d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.719483 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f54aaadc3d22437286303caac65c7cb4 (table default.Table_1aa14272946747ea8c83fed888ea0962 [id=7d8418468e054e5aa3fba50d66896441]) successfully deleted
I20260503 07:53:18.745929 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a401317bf551401990260fa0419fd924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:18.745918 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b9132dec40e4392aeb19613daaa80ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:18.746176 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b9132dec40e4392aeb19613daaa80ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:18.746420 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16aa59d4fdd94bdd82a441af4d665f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.748297 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83e492f9445478f890dd9d90321b41a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:18.748252 596 rpcz_store.cc:269] 0503 07:53:17.609946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.633113 (+ 23167us) service_pool.cc:224] Handling call
0503 07:53:18.696910 (+1063797us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.638471 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.638586 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.638591 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:18.638593 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.638705 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.638720 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.638725 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:18.638785 (+ 60us) tablet.cc:701] Row locks acquired
0503 07:53:18.638787 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.638817 (+ 30us) write_op.cc:270] Start()
0503 07:53:18.638846 (+ 29us) write_op.cc:276] Timestamp: P: 1777794798638794 usec, L: 0
0503 07:53:18.638849 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.639020 (+ 171us) log.cc:844] Serialized 527 byte log entry
0503 07:53:18.685823 (+ 46803us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.686427 (+ 604us) write_op.cc:301] APPLY: starting
0503 07:53:18.686438 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.686473 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.686499 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.686547 (+ 48us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.686573 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:18.686580 (+ 7us) write_op.cc:312] APPLY: finished
0503 07:53:18.686644 (+ 64us) log.cc:844] Serialized 23 byte log entry
0503 07:53:18.686699 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.686714 (+ 15us) write_op.cc:454] Released schema lock
0503 07:53:18.686722 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":570,"apply.run_cpu_time_us":349,"apply.run_wall_time_us":348,"num_ops":1,"prepare.queue_time_us":657306,"prepare.run_cpu_time_us":610,"prepare.run_wall_time_us":609,"replication_time_us":46955,"thread_start_us":16317,"threads_started":1}]]}
I20260503 07:53:18.749684 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8e668d256db348eb8fff1515e0a7a800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:18.750059 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86cee3f40f75423780bc320dbac4bf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.751868 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1356) took 1170 ms. Trace:
I20260503 07:53:18.751933 898 rpcz_store.cc:276] 0503 07:53:17.581162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.214621 (+633459us) service_pool.cc:224] Handling call
0503 07:53:18.299108 (+ 84487us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.299143 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.749321 (+450178us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.751709 (+ 2388us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.751852 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.754554 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9656dfbaad40359a7ff4dc58b76e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.756322 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e4347cef16419f806765f3bf677e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.758113 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1255) took 4895 ms. Trace:
I20260503 07:53:18.758189 1175 rpcz_store.cc:276] 0503 07:53:13.862993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.863069 (+ 76us) service_pool.cc:224] Handling call
0503 07:53:18.719460 (+4856391us) ts_tablet_manager.cc:1151] Deleting tablet 9aa3759511d942bfbc6e50ea2e2f2777
0503 07:53:18.719469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.736591 (+ 17122us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.739469 (+ 2878us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.758092 (+ 18623us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4856244}
I20260503 07:53:18.758584 1175 tablet_replica.cc:333] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.758757 1175 raft_consensus.cc:2243] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.758989 1175 raft_consensus.cc:2272] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.760712 1175 ts_tablet_manager.cc:1916] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.766510 1166 tablet_bootstrap.cc:654] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.767174 1175 ts_tablet_manager.cc:1929] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:18.767275 1175 log.cc:1199] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f4fd9524157c4225885a1f1831982faa
I20260503 07:53:18.767586 1175 ts_tablet_manager.cc:1950] T f4fd9524157c4225885a1f1831982faa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:18.767875 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1254) took 4905 ms. Trace:
I20260503 07:53:18.767958 1175 rpcz_store.cc:276] 0503 07:53:13.862891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.863069 (+ 178us) service_pool.cc:224] Handling call
0503 07:53:18.758542 (+4895473us) ts_tablet_manager.cc:1151] Deleting tablet f4fd9524157c4225885a1f1831982faa
0503 07:53:18.758551 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.764396 (+ 5845us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.767118 (+ 2722us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.767860 (+ 742us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4895215}
I20260503 07:53:18.758508 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 9aa3759511d942bfbc6e50ea2e2f2777 (table default.Table_371c2f73361d47ac88caf3061820323f [id=3283681bb0bd4a83903cc189d90c0b9e]) successfully deleted
W20260503 07:53:18.772112 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e668d256db348eb8fff1515e0a7a800 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.776397 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5ce350ddb947328d4b173dae9b8e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.777614 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1357) took 1196 ms. Trace:
I20260503 07:53:18.777709 891 rpcz_store.cc:276] 0503 07:53:17.581244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.176365 (+595121us) service_pool.cc:224] Handling call
0503 07:53:18.189345 (+ 12980us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.189375 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.757991 (+568616us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.777467 (+ 19476us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.777598 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.785831 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34d76fc72b042b9a4f682e865f44397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.800292 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257bd97e53254034a76e699d8926e21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.808331 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deda702aaf554fc38e43d719b102754f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.809581 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e68de86584803a449d63609f4b2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:18.810889 1165 consensus_queue.cc:260] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.811442 1165 ts_tablet_manager.cc:1434] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.147s user 0.002s sys 0.000s
I20260503 07:53:18.811777 1165 tablet_bootstrap.cc:492] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:18.812758 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a401317bf551401990260fa0419fd924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.813318 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b9132dec40e4392aeb19613daaa80ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:18.828755 598 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:44308 (request call id 1684) took 1157 ms. Trace:
I20260503 07:53:18.829119 598 rpcz_store.cc:276] 0503 07:53:17.670820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.606899 (+936079us) service_pool.cc:224] Handling call
0503 07:53:18.640393 (+ 33494us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d9cb13 00007ff8f78307c6 00007ff8f78304f5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:18.641112 (+ 719us) catalog_manager.cc:2101] Acquired catalog manager lock
0503 07:53:18.641633 (+ 521us) catalog_manager.cc:2147] Created new table and tablet info
0503 07:53:18.827176 (+185543us) catalog_manager.cc:2207] Wrote table and tablets to system table
0503 07:53:18.828247 (+ 1071us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0503 07:53:18.828722 (+ 475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.816754 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.816887 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.816893 (+ 6us) write_op.cc:435] Acquired schema lock
0503 07:53:18.816895 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.816992 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.817006 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.817013 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.817121 (+ 108us) tablet.cc:701] Row locks acquired
0503 07:53:18.817124 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:18.817159 (+ 35us) write_op.cc:270] Start()
0503 07:53:18.817193 (+ 34us) write_op.cc:276] Timestamp: P: 1777794798817118 usec, L: 0
0503 07:53:18.817196 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.817377 (+ 181us) log.cc:844] Serialized 433 byte log entry
0503 07:53:18.824818 (+ 7441us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.824904 (+ 86us) write_op.cc:301] APPLY: starting
0503 07:53:18.824918 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.824970 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.824999 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.825145 (+ 146us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.825192 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 07:53:18.825203 (+ 11us) write_op.cc:312] APPLY: finished
0503 07:53:18.825304 (+ 101us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.825377 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.825398 (+ 21us) write_op.cc:454] Released schema lock
0503 07:53:18.825406 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.825490 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.825496 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":76380544,"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":576,"apply.run_wall_time_us":576,"num_ops":2,"prepare.queue_time_us":174639,"prepare.run_cpu_time_us":733,"prepare.run_wall_time_us":987,"raft.queue_time_us":38,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"replication_time_us":7596}]]}
I20260503 07:53:18.832297 1165 tablet_bootstrap.cc:654] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.834981 594 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:44308 (request call id 1685) took 1114 ms. Trace:
I20260503 07:53:18.835067 594 rpcz_store.cc:276] 0503 07:53:17.720249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.732291 (+1012042us) service_pool.cc:224] Handling call
0503 07:53:18.733248 (+ 957us) catalog_manager.cc:2101] Acquired catalog manager lock
0503 07:53:18.733738 (+ 490us) catalog_manager.cc:2147] Created new table and tablet info
0503 07:53:18.834810 (+101072us) catalog_manager.cc:2207] Wrote table and tablets to system table
0503 07:53:18.834894 (+ 84us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0503 07:53:18.834965 (+ 71us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.817759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.817851 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.817857 (+ 6us) write_op.cc:435] Acquired schema lock
0503 07:53:18.817859 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.817932 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.817940 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.817944 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.817996 (+ 52us) tablet.cc:701] Row locks acquired
0503 07:53:18.817999 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:18.818022 (+ 23us) write_op.cc:270] Start()
0503 07:53:18.818053 (+ 31us) write_op.cc:276] Timestamp: P: 1777794798817983 usec, L: 0
0503 07:53:18.818056 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.818169 (+ 113us) log.cc:844] Serialized 433 byte log entry
0503 07:53:18.833847 (+ 15678us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.833923 (+ 76us) write_op.cc:301] APPLY: starting
0503 07:53:18.833936 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.833974 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.833999 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.834104 (+ 105us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.834137 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 07:53:18.834147 (+ 10us) write_op.cc:312] APPLY: finished
0503 07:53:18.834206 (+ 59us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.834253 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.834268 (+ 15us) write_op.cc:454] Released schema lock
0503 07:53:18.834275 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.834365 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.834371 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":29,"apply.run_cpu_time_us":429,"apply.run_wall_time_us":428,"num_ops":2,"prepare.queue_time_us":83591,"prepare.run_cpu_time_us":469,"prepare.run_wall_time_us":469,"replication_time_us":15762}]]}
I20260503 07:53:18.837555 599 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:44308 (request call id 1686) took 1117 ms. Trace:
I20260503 07:53:18.837651 599 rpcz_store.cc:276] 0503 07:53:17.720340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.736093 (+1015753us) service_pool.cc:224] Handling call
0503 07:53:18.736873 (+ 780us) catalog_manager.cc:2101] Acquired catalog manager lock
0503 07:53:18.737274 (+ 401us) catalog_manager.cc:2147] Created new table and tablet info
0503 07:53:18.837359 (+100085us) catalog_manager.cc:2207] Wrote table and tablets to system table
0503 07:53:18.837449 (+ 90us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0503 07:53:18.837535 (+ 86us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.818251 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.818325 (+ 74us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.818329 (+ 4us) write_op.cc:435] Acquired schema lock
0503 07:53:18.818332 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:18.818386 (+ 54us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.818393 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.818397 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:18.818445 (+ 48us) tablet.cc:701] Row locks acquired
0503 07:53:18.818447 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.818466 (+ 19us) write_op.cc:270] Start()
0503 07:53:18.818484 (+ 18us) write_op.cc:276] Timestamp: P: 1777794798818428 usec, L: 0
0503 07:53:18.818487 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.818598 (+ 111us) log.cc:844] Serialized 433 byte log entry
0503 07:53:18.833918 (+ 15320us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.834047 (+ 129us) write_op.cc:301] APPLY: starting
0503 07:53:18.834060 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.834102 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.834123 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.834207 (+ 84us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.834240 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 07:53:18.834248 (+ 8us) write_op.cc:312] APPLY: finished
0503 07:53:18.834309 (+ 61us) log.cc:844] Serialized 29 byte log entry
0503 07:53:18.834347 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.834361 (+ 14us) write_op.cc:454] Released schema lock
0503 07:53:18.834366 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.834422 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.834426 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":381,"apply.run_wall_time_us":381,"num_ops":2,"prepare.queue_time_us":80593,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":399,"replication_time_us":15413}]]}
I20260503 07:53:18.841933 3140 tablet.cc:1724] T 4ab0752eb4fa49a48cf521f9a072689a P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:18.852325 898 tablet_service.cc:1558] Processing DeleteTablet for tablet db13f91ef1d740c387bacbb689ddf1a8 with delete_type TABLET_DATA_DELETED (replaced by tablet a7907a9cceaa443795275c9cbb62cb22) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:18.860329 716 consensus_peers.cc:597] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf24705f7d004254bf8456c063634d65. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.860574 1171 tablet_bootstrap.cc:492] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.860715 1171 ts_tablet_manager.cc:1403] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.374s user 0.028s sys 0.036s
I20260503 07:53:18.863807 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c2f4561d99794047815860d2a2027750"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.864512 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2f4561d99794047815860d2a2027750 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.865319 595 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1f6a4395bc1544f0b36f4f37f01aeedd" } new_table_name: "default.Table_7e0a7078924a48f5a4fb5831c77c6a89" modify_external_catalogs: true
I20260503 07:53:18.866720 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d2e68e6e0cd14ce1afd21c4a25d2cfc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.867121 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2e68e6e0cd14ce1afd21c4a25d2cfc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.868348 598 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_68197980209d43a18ac2c2e326e37ead" } new_table_name: "default.Table_7d56d24b86ed40dabc8b571be0ebe051" modify_external_catalogs: true
I20260503 07:53:18.870368 2987 raft_consensus.cc:493] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.870481 2987 raft_consensus.cc:515] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.870947 2987 leader_election.cc:290] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.871902 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce8073c9aa549f3b9ee0397984c350b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.872395 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce8073c9aa549f3b9ee0397984c350b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
W20260503 07:53:18.873507 986 leader_election.cc:343] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:18.874591 988 leader_election.cc:343] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:18.874680 988 leader_election.cc:304] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.875219 2816 raft_consensus.cc:2749] T bce8073c9aa549f3b9ee0397984c350b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:18.876901 1171 raft_consensus.cc:359] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.877089 1171 raft_consensus.cc:385] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.877158 1171 raft_consensus.cc:740] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.877404 1171 consensus_queue.cc:260] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.879297 3118 tablet.cc:1724] T 4ab0752eb4fa49a48cf521f9a072689a P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:18.879171 1171 ts_tablet_manager.cc:1434] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260503 07:53:18.882179 1171 tablet_bootstrap.cc:492] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
W20260503 07:53:18.885293 595 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb945c6be9d046dbb795551d5b28c653 consensus state has no leader
I20260503 07:53:18.889061 1171 tablet_bootstrap.cc:654] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.891557 1171 tablet_bootstrap.cc:492] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.891696 1171 ts_tablet_manager.cc:1403] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
W20260503 07:53:18.893595 716 consensus_peers.cc:597] T f4fd9524157c4225885a1f1831982faa P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4fd9524157c4225885a1f1831982faa. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:18.893524 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_90007d3270c3491697ea150681e73a39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:18.894014 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90007d3270c3491697ea150681e73a39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:18.895059 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1353) took 1314 ms. Trace:
I20260503 07:53:18.895221 882 rpcz_store.cc:276] 0503 07:53:17.580825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.178488 (+597663us) service_pool.cc:224] Handling call
0503 07:53:18.209323 (+ 30835us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.209408 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.758953 (+549545us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.894879 (+135926us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.895029 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.892419 1171 raft_consensus.cc:359] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.898893 1171 raft_consensus.cc:385] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.898975 1171 raft_consensus.cc:740] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.899215 1171 consensus_queue.cc:260] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.900964 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:18.901793 1171 ts_tablet_manager.cc:1434] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260503 07:53:18.902024 1171 tablet_bootstrap.cc:492] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.903481 1171 tablet_bootstrap.cc:654] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.910804 1171 tablet_bootstrap.cc:492] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:18.910960 1171 ts_tablet_manager.cc:1403] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260503 07:53:18.911885 1171 raft_consensus.cc:359] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.912086 1171 raft_consensus.cc:385] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.912154 1171 raft_consensus.cc:740] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.915959 1171 consensus_queue.cc:260] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:18.916740 1171 ts_tablet_manager.cc:1434] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260503 07:53:18.916863 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1137) took 5626 ms. Trace:
I20260503 07:53:18.917009 1171 tablet_bootstrap.cc:492] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:18.917002 1174 rpcz_store.cc:276] 0503 07:53:13.290573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.294946 (+ 4373us) service_pool.cc:224] Handling call
0503 07:53:18.571751 (+5276805us) ts_tablet_manager.cc:1151] Deleting tablet c1c631d3da8f4ec29690c548097a454b
0503 07:53:18.571760 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.734725 (+162965us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.737526 (+ 2801us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.916799 (+179273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5271268}
I20260503 07:53:18.917857 1174 tablet_replica.cc:333] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:18.918152 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet c1c631d3da8f4ec29690c548097a454b (table default.Table_82a4b1a149d1448588fbc0ce1e44754d [id=95fc3e91893c440e8498f12f6dfd56d2]) successfully deleted
I20260503 07:53:18.919956 1166 tablet_bootstrap.cc:492] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:18.920116 1166 ts_tablet_manager.cc:1403] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.720s user 0.026s sys 0.042s
I20260503 07:53:18.922575 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1338) took 1530 ms. Trace:
I20260503 07:53:18.922705 897 rpcz_store.cc:276] 0503 07:53:17.392534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.100567 (+708033us) service_pool.cc:224] Handling call
0503 07:53:18.115863 (+ 15296us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.115885 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.747017 (+631132us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.922419 (+175402us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.922557 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.922928 1171 tablet_bootstrap.cc:654] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.933986 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c081581d0e69483a9c4fdc42e9abec77" } new_table_name: "default.Table_167f798efea349f1b2664fe45eceed6d" modify_external_catalogs: true
I20260503 07:53:18.934247 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1337) took 1543 ms. Trace:
I20260503 07:53:18.934370 889 rpcz_store.cc:276] 0503 07:53:17.391416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.100162 (+708746us) service_pool.cc:224] Handling call
0503 07:53:18.115312 (+ 15150us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.115334 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.750825 (+635491us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.934022 (+183197us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.934230 (+ 208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.937691 3070 raft_consensus.cc:493] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:18.937870 3070 raft_consensus.cc:515] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.941072 599 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_95667d645ba543c795df2da82c455756" } new_table_name: "default.Table_c8e5be0015b24530a38db343e838c9b7" modify_external_catalogs: true
I20260503 07:53:18.942492 3132 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:18.942615 3132 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.942791 3070 leader_election.cc:290] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.942965 879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1336) took 1480 ms. Trace:
I20260503 07:53:18.943064 879 rpcz_store.cc:276] 0503 07:53:17.390201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.986309 (+596108us) service_pool.cc:224] Handling call
0503 07:53:18.110270 (+123961us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.110323 (+ 53us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.798539 (+688216us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.870011 (+ 71472us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.870169 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.943123 3132 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:18.943253 851 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5e9d50a71c1a4bf799de34af1064597d
I20260503 07:53:18.944042 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:18.944235 906 raft_consensus.cc:2468] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 2.
I20260503 07:53:18.944685 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:18.945307 988 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.945868 1174 raft_consensus.cc:2243] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:18.945881 3132 raft_consensus.cc:2804] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:53:18.945966 3132 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:18.946039 3132 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:53:18.946166 1174 raft_consensus.cc:2272] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.946687 1174 ts_tablet_manager.cc:1916] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.949127 3132 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.950699 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0"
I20260503 07:53:18.951967 1165 tablet_bootstrap.cc:492] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:18.952147 1165 ts_tablet_manager.cc:1403] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.140s user 0.002s sys 0.001s
I20260503 07:53:18.952301 3132 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 3 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:18.953061 1165 raft_consensus.cc:359] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.953277 1165 raft_consensus.cc:385] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.953358 1165 raft_consensus.cc:740] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.953562 1165 consensus_queue.cc:260] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.954027 1165 ts_tablet_manager.cc:1434] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:18.954993 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:18.955194 906 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:53:18.958619 598 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 532037d672cf49afac0be969e6978589 consensus state has no leader
I20260503 07:53:18.959074 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_be722fc4ce8f434d88dff4dc553a1205" } modify_external_catalogs: true
I20260503 07:53:18.959272 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_be722fc4ce8f434d88dff4dc553a1205" } modify_external_catalogs: true
I20260503 07:53:18.961215 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1349) took 1478 ms. Trace:
I20260503 07:53:18.961314 895 rpcz_store.cc:276] 0503 07:53:17.458421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.140690 (+682269us) service_pool.cc:224] Handling call
0503 07:53:18.141151 (+ 461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.141178 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.855116 (+713938us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.936683 (+ 81567us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:18.936789 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:18.961755 1165 tablet_bootstrap.cc:492] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:18.963359 1165 tablet_bootstrap.cc:654] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:18.975970 1166 raft_consensus.cc:359] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.976235 1166 raft_consensus.cc:385] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:18.976298 1166 raft_consensus.cc:740] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:18.976495 1166 consensus_queue.cc:260] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:18.977610 1175 tablet_replica.cc:333] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:18.977843 1175 raft_consensus.cc:2243] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:18.978112 1175 raft_consensus.cc:2272] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:18.978835 1175 ts_tablet_manager.cc:1916] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:18.978840 2912 consensus_queue.cc:1048] T bd71a81efd3b40c6b96bb77f74e8a4c6 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:18.979025 1166 ts_tablet_manager.cc:1434] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.059s user 0.002s sys 0.000s
I20260503 07:53:18.986151 906 raft_consensus.cc:2468] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c11eb9ffa7845269a6a8000e8ff248f in term 3.
I20260503 07:53:18.986656 988 leader_election.cc:304] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3; no voters: 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:18.987125 2987 raft_consensus.cc:2804] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:53:18.987247 2987 raft_consensus.cc:697] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [term 3 LEADER]: Becoming Leader. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Running, Role: LEADER
I20260503 07:53:18.987483 2987 consensus_queue.cc:237] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.007714 877 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 187) took 2268 ms. Trace:
I20260503 07:53:19.007858 877 rpcz_store.cc:276] 0503 07:53:16.738934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.738984 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:17.570323 (+831339us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x618000023c8c. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59ff9bb52e 00007f59ff7b625c 00007f5a022e2cb8 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8
0503 07:53:19.007675 (+1437352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85668224}
I20260503 07:53:19.014478 874 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 185) took 2301 ms. Trace:
I20260503 07:53:19.014586 874 rpcz_store.cc:276] 0503 07:53:16.712695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.712945 (+ 250us) service_pool.cc:224] Handling call
0503 07:53:18.987346 (+2274401us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x6160000a9a30. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59ff7b5fc3 00007f5a022e2cb8 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:19.014450 (+ 27104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21274880}
I20260503 07:53:19.015401 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ebb0f12d94334be3a5029fb75213499d" } modify_external_catalogs: true
I20260503 07:53:19.015584 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_ebb0f12d94334be3a5029fb75213499d" } modify_external_catalogs: true
I20260503 07:53:19.016295 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1343361e57844986beaedb2c49b4cf01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.016891 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1343361e57844986beaedb2c49b4cf01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.021010 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1348) took 1563 ms. Trace:
I20260503 07:53:19.021104 896 rpcz_store.cc:276] 0503 07:53:17.457872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.139293 (+681421us) service_pool.cc:224] Handling call
0503 07:53:18.139773 (+ 480us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.139801 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.803085 (+663284us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.945559 (+142474us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:19.020993 (+ 75434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.024871 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 086c1b3968fd4ae4be703b72eaf05973
I20260503 07:53:19.025638 2912 consensus_queue.cc:1048] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:19.025694 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.026619 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.034034 598 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1ab085f9bb854edaa2ebdc4cb085db34" } modify_external_catalogs: true
I20260503 07:53:19.034230 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 086c1b3968fd4ae4be703b72eaf05973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.034258 598 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_1ab085f9bb854edaa2ebdc4cb085db34" } modify_external_catalogs: true
I20260503 07:53:19.041937 3151 raft_consensus.cc:493] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.042107 3151 raft_consensus.cc:515] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.042889 3151 leader_election.cc:290] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:19.044075 851 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:19.043685 1173 ts_tablet_manager.cc:1929] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:19.045032 1173 log.cc:1199] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/cac435b09639484ca1ae82f3d4990d48
I20260503 07:53:19.045420 1173 ts_tablet_manager.cc:1950] T cac435b09639484ca1ae82f3d4990d48 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
W20260503 07:53:19.052892 716 consensus_peers.cc:597] T b8bb85190cd94e8282eec9a1bc0efab4 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8bb85190cd94e8282eec9a1bc0efab4. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.059785 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1339) took 1666 ms. Trace:
I20260503 07:53:19.059913 884 rpcz_store.cc:276] 0503 07:53:17.392984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.101220 (+708236us) service_pool.cc:224] Handling call
0503 07:53:18.147923 (+ 46703us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.147942 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.788647 (+640705us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.956501 (+167854us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:19.059764 (+103263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.060119 1166 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.061884 1166 tablet_bootstrap.cc:654] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.059805 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1340) took 1666 ms. Trace:
I20260503 07:53:19.062811 886 rpcz_store.cc:276] 0503 07:53:17.449735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.116386 (+666651us) service_pool.cc:224] Handling call
0503 07:53:18.175810 (+ 59424us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.175837 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.895091 (+719254us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.975177 (+ 80086us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:19.059787 (+ 84610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.063228 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1355) took 1482 ms. Trace:
I20260503 07:53:19.063305 887 rpcz_store.cc:276] 0503 07:53:17.581075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.208933 (+627858us) service_pool.cc:224] Handling call
0503 07:53:18.366976 (+158043us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.367095 (+ 119us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.977333 (+610238us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.006562 (+ 29229us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:19.063215 (+ 56653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.063366 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39898 (request call id 1350) took 1604 ms. Trace:
I20260503 07:53:19.063917 885 rpcz_store.cc:276] 0503 07:53:17.458899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.155103 (+696204us) service_pool.cc:224] Handling call
0503 07:53:18.173265 (+ 18162us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:53:18.173300 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:53:18.779048 (+605748us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.953996 (+174948us) tablet_replica.cc:206] Creating consensus instance
0503 07:53:19.063351 (+109355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.064605 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 923) took 10039 ms. Trace:
I20260503 07:53:19.064741 1173 rpcz_store.cc:276] 0503 07:53:09.024876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.050605 (+ 25729us) service_pool.cc:224] Handling call
0503 07:53:18.153514 (+9102909us) ts_tablet_manager.cc:1151] Deleting tablet cac435b09639484ca1ae82f3d4990d48
0503 07:53:18.153522 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:18.794442 (+640920us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:18.890146 (+ 95704us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.064585 (+174439us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10949,"tablet-delete.queue_time_us":9101956}
I20260503 07:53:19.065379 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet cac435b09639484ca1ae82f3d4990d48 (table default.Table_ea3cc36f50214961844fbc9f28877922 [id=cda676ee3d634f52aeefda3c2680f941]) successfully deleted
I20260503 07:53:19.065783 1173 tablet_replica.cc:333] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:19.066069 1173 raft_consensus.cc:2243] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.066300 1173 raft_consensus.cc:2272] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.066936 1173 ts_tablet_manager.cc:1916] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.069617 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_259468e6a8024773bb49c811211d3bfe" } new_table_name: "default.Table_25e3d67aec27487cb634ad4984994c71" modify_external_catalogs: true
W20260503 07:53:19.094606 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66d715f739ae4cfe857f91a29917c438 consensus state has no leader
I20260503 07:53:19.095928 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f2c07e238fbf48da918e6d865c656929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.096692 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2c07e238fbf48da918e6d865c656929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.101502 2708 raft_consensus.cc:493] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.101648 2708 raft_consensus.cc:515] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.102248 2708 leader_election.cc:290] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.102454 3151 raft_consensus.cc:493] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:19.102577 3151 raft_consensus.cc:515] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.102941 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.103093 3151 leader_election.cc:290] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.103116 1051 raft_consensus.cc:2468] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:19.102200 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6922f158ac92435ab1c25a7b930591be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.103637 716 leader_election.cc:304] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
W20260503 07:53:19.104007 851 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:53:19.104028 2708 raft_consensus.cc:2804] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:19.104101 2708 raft_consensus.cc:493] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:19.104156 2708 raft_consensus.cc:3060] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:19.104249 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6922f158ac92435ab1c25a7b930591be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.106772 2708 raft_consensus.cc:515] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.107355 1165 tablet_bootstrap.cc:492] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.107486 1165 ts_tablet_manager.cc:1403] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.146s user 0.036s sys 0.020s
I20260503 07:53:19.107491 3118 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:19.108028 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:19.108223 1051 raft_consensus.cc:3060] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.108263 1165 raft_consensus.cc:359] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.108402 1165 raft_consensus.cc:385] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.108451 1165 raft_consensus.cc:740] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.108618 1165 consensus_queue.cc:260] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.108660 3140 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:19.109038 1165 ts_tablet_manager.cc:1434] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260503 07:53:19.109319 1165 tablet_bootstrap.cc:492] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.110749 1165 tablet_bootstrap.cc:654] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.110754 1051 raft_consensus.cc:2468] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:19.111233 1171 tablet_bootstrap.cc:492] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.111366 1171 ts_tablet_manager.cc:1403] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.194s user 0.004s sys 0.008s
I20260503 07:53:19.111374 716 leader_election.cc:304] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:19.111665 2924 raft_consensus.cc:2804] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:19.111773 2924 raft_consensus.cc:697] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:19.112020 1171 raft_consensus.cc:359] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.111975 2924 consensus_queue.cc:237] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.112144 1171 raft_consensus.cc:385] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.112221 1171 raft_consensus.cc:740] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.112391 1171 consensus_queue.cc:260] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.112861 1171 ts_tablet_manager.cc:1434] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260503 07:53:19.113130 1171 tablet_bootstrap.cc:492] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.114064 2708 leader_election.cc:290] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.114820 1171 tablet_bootstrap.cc:654] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:19.116627 716 consensus_peers.cc:597] T 9aa3759511d942bfbc6e50ea2e2f2777 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9aa3759511d942bfbc6e50ea2e2f2777. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.128098 878 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 186) took 2414 ms. Trace:
I20260503 07:53:19.129307 1165 tablet_bootstrap.cc:492] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.129437 1165 ts_tablet_manager.cc:1403] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260503 07:53:19.130091 1165 raft_consensus.cc:359] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.130257 1165 raft_consensus.cc:385] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.130312 1165 raft_consensus.cc:740] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.130493 1165 consensus_queue.cc:260] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.130990 1165 ts_tablet_manager.cc:1434] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:19.131247 1165 tablet_bootstrap.cc:492] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.132700 1165 tablet_bootstrap.cc:654] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.133132 1175 ts_tablet_manager.cc:1929] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.133244 1175 log.cc:1199] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/f522dc5e8b12409eb9ed1a763d0db741
I20260503 07:53:19.135093 1174 ts_tablet_manager.cc:1929] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.135205 1174 log.cc:1199] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/2ad24ddc82bd401fb5427e7415af3922
I20260503 07:53:19.135499 1174 ts_tablet_manager.cc:1950] T 2ad24ddc82bd401fb5427e7415af3922 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:19.144953 1171 tablet_bootstrap.cc:492] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.131142 1166 tablet_bootstrap.cc:492] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.138331 1173 ts_tablet_manager.cc:1929] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:19.142403 3120 tablet.cc:1724] T 262678b948bd46b6886277f8dd790441 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:19.145200 1166 ts_tablet_manager.cc:1403] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.085s user 0.009s sys 0.000s
I20260503 07:53:19.145578 1173 log.cc:1199] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/f7654a4a85b6441f9d36527ced775aa2
I20260503 07:53:19.145845 1166 raft_consensus.cc:359] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.145996 1166 raft_consensus.cc:385] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.146065 1166 raft_consensus.cc:740] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.146250 1166 consensus_queue.cc:260] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.146703 1166 ts_tablet_manager.cc:1434] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260503 07:53:19.146909 1166 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.148119 1166 tablet_bootstrap.cc:654] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.151203 906 raft_consensus.cc:3060] T f376fbfbfd804ffcad30dcd55b7afc6a P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.152446 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1149) took 5858 ms. Trace:
I20260503 07:53:19.152562 1174 rpcz_store.cc:276] 0503 07:53:13.294088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.294131 (+ 43us) service_pool.cc:224] Handling call
0503 07:53:18.917771 (+5623640us) ts_tablet_manager.cc:1151] Deleting tablet 2ad24ddc82bd401fb5427e7415af3922
0503 07:53:18.917780 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.011037 (+ 93257us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.135050 (+124013us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.152416 (+ 17366us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5608580}
I20260503 07:53:19.153017 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1148) took 5859 ms. Trace:
I20260503 07:53:19.153091 1174 rpcz_store.cc:276] 0503 07:53:13.294006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.294467 (+ 461us) service_pool.cc:224] Handling call
0503 07:53:19.152879 (+5858412us) ts_tablet_manager.cc:1151] Deleting tablet 7f523d718ae8475390f78cf2af6758da
0503 07:53:19.152894 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.153001 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5842440}
I20260503 07:53:19.153450 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1151) took 5612 ms. Trace:
I20260503 07:53:19.153538 1174 rpcz_store.cc:276] 0503 07:53:13.541217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.541265 (+ 48us) service_pool.cc:224] Handling call
0503 07:53:19.153348 (+5612083us) ts_tablet_manager.cc:1151] Deleting tablet d9269dd6a9af493a8452b7f657355933
0503 07:53:19.153359 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.153435 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5611834}
I20260503 07:53:19.153861 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1152) took 5605 ms. Trace:
I20260503 07:53:19.153941 1174 rpcz_store.cc:276] 0503 07:53:13.548365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.548423 (+ 58us) service_pool.cc:224] Handling call
0503 07:53:19.153765 (+5605342us) ts_tablet_manager.cc:1151] Deleting tablet e1d0e93ae66c46749c4f7e9e495ae60a
0503 07:53:19.153775 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.153847 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5605185}
I20260503 07:53:19.154268 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1153) took 5605 ms. Trace:
I20260503 07:53:19.154350 1174 rpcz_store.cc:276] 0503 07:53:13.548806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.548848 (+ 42us) service_pool.cc:224] Handling call
0503 07:53:19.154171 (+5605323us) ts_tablet_manager.cc:1151] Deleting tablet ef666aa007504682bc044cbd0b56060d
0503 07:53:19.154181 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.154253 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5605191}
I20260503 07:53:19.154664 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1150) took 5613 ms. Trace:
I20260503 07:53:19.154740 1174 rpcz_store.cc:276] 0503 07:53:13.541077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.574412 (+ 33335us) service_pool.cc:224] Handling call
0503 07:53:19.154565 (+5580153us) ts_tablet_manager.cc:1151] Deleting tablet d24ae9e604144ca589008d6697d849df
0503 07:53:19.154575 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.154650 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5564478}
I20260503 07:53:19.155058 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1158) took 5436 ms. Trace:
I20260503 07:53:19.155148 1174 rpcz_store.cc:276] 0503 07:53:13.718720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.718797 (+ 77us) service_pool.cc:224] Handling call
0503 07:53:19.154963 (+5436166us) ts_tablet_manager.cc:1151] Deleting tablet 369b0b38c0024cf2ba0ff3d13f1d9276
0503 07:53:19.154973 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.155044 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5435990}
I20260503 07:53:19.155459 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1157) took 5436 ms. Trace:
I20260503 07:53:19.155540 1174 rpcz_store.cc:276] 0503 07:53:13.718644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.718895 (+ 251us) service_pool.cc:224] Handling call
0503 07:53:19.155365 (+5436470us) ts_tablet_manager.cc:1151] Deleting tablet 797372a021aa48bab4ca695d897164d8
0503 07:53:19.155374 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.155445 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5436324}
I20260503 07:53:19.155810 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1159) took 5437 ms. Trace:
I20260503 07:53:19.155893 1174 rpcz_store.cc:276] 0503 07:53:13.718808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.719012 (+ 204us) service_pool.cc:224] Handling call
0503 07:53:19.155736 (+5436724us) ts_tablet_manager.cc:1151] Deleting tablet 2b08e403756a4d99867263d0941d2120
0503 07:53:19.155742 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.155796 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5436604}
I20260503 07:53:19.156802 1173 ts_tablet_manager.cc:1950] T f7654a4a85b6441f9d36527ced775aa2 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:19.157533 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 922) took 10132 ms. Trace:
I20260503 07:53:19.154593 2916 raft_consensus.cc:493] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.158125 2916 raft_consensus.cc:515] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.158697 2916 leader_election.cc:290] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:19.157720 2987 raft_consensus.cc:493] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.159446 2987 raft_consensus.cc:515] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.161033 2987 leader_election.cc:290] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.161270 1171 ts_tablet_manager.cc:1403] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260503 07:53:19.161515 1173 rpcz_store.cc:276] 0503 07:53:09.024791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.051359 (+ 26568us) service_pool.cc:224] Handling call
0503 07:53:19.065724 (+10014365us) ts_tablet_manager.cc:1151] Deleting tablet f7654a4a85b6441f9d36527ced775aa2
0503 07:53:19.065737 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.122533 (+ 56796us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.138258 (+ 15725us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.157516 (+ 19258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9896,"tablet-delete.queue_time_us":10013046}
I20260503 07:53:19.159179 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7907a9cceaa443795275c9cbb62cb22" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.160418 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14998ce78c64e58ac5b7f651b6b88ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.163486 988 leader_election.cc:343] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:19.163686 988 leader_election.cc:343] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.145095 878 rpcz_store.cc:276] 0503 07:53:16.715756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.715828 (+ 72us) service_pool.cc:224] Handling call
0503 07:53:19.118020 (+2402192us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x616000222d54. stack: 00007f59f2515086 00007f59f2514e40 00007f59f14ce3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f59fe4278c0 00007f5a022e2eaf 00007f59fc6fac36 00007f59fc6fa965 00007f59f950810e 00007f59f9506fee 00007f59f950d228 00007f59f950db8f 00007f59f950d9b8 0000000000aa4cac
0503 07:53:19.128068 (+ 10048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8432384}
I20260503 07:53:19.164515 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet f7654a4a85b6441f9d36527ced775aa2 (table default.Table_c4e16481e61b48ea8c0ffb18d855f20f [id=33d2f8bafa85459697c479cf5e75a165]) successfully deleted
I20260503 07:53:19.164880 1173 tablet_replica.cc:333] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:19.165856 1171 raft_consensus.cc:359] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.166262 1173 raft_consensus.cc:2243] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.167950 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 2ad24ddc82bd401fb5427e7415af3922 (table default.Table_2b316333c1ba4f2fb97307e35ceff30b [id=d03d86f3d47b407fbd9ac6887dd8ef80]) successfully deleted
W20260503 07:53:19.168346 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 7f523d718ae8475390f78cf2af6758da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f523d718ae8475390f78cf2af6758da already in progress: creating tablet
W20260503 07:53:19.168812 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d9269dd6a9af493a8452b7f657355933 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9269dd6a9af493a8452b7f657355933 already in progress: creating tablet
W20260503 07:53:19.169090 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet e1d0e93ae66c46749c4f7e9e495ae60a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1d0e93ae66c46749c4f7e9e495ae60a already in progress: creating tablet
W20260503 07:53:19.169472 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet ef666aa007504682bc044cbd0b56060d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef666aa007504682bc044cbd0b56060d already in progress: creating tablet
W20260503 07:53:19.169780 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet d24ae9e604144ca589008d6697d849df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d24ae9e604144ca589008d6697d849df already in progress: creating tablet
W20260503 07:53:19.170114 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 369b0b38c0024cf2ba0ff3d13f1d9276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369b0b38c0024cf2ba0ff3d13f1d9276 already in progress: creating tablet
I20260503 07:53:19.170997 1173 raft_consensus.cc:2272] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:19.170433 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 797372a021aa48bab4ca695d897164d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 797372a021aa48bab4ca695d897164d8 already in progress: creating tablet
W20260503 07:53:19.171559 585 catalog_manager.cc:4982] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): delete failed for tablet 2b08e403756a4d99867263d0941d2120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b08e403756a4d99867263d0941d2120 already in progress: creating tablet
I20260503 07:53:19.175148 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7907a9cceaa443795275c9cbb62cb22" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.175738 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14998ce78c64e58ac5b7f651b6b88ba" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.185493 885 tablet_service.cc:1511] Processing CreateTablet for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb (DEFAULT_TABLE table=default.Table_b519db3a4e724196a866ea51ea0b86f8 [id=c50a93038f084b85af6e9f2f442ebc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.185883 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:19.187120 716 consensus_peers.cc:597] T f54aaadc3d22437286303caac65c7cb4 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f54aaadc3d22437286303caac65c7cb4. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:19.189438 715 consensus_peers.cc:597] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.189662 741 tablet_service.cc:1511] Processing CreateTablet for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb (DEFAULT_TABLE table=default.Table_b519db3a4e724196a866ea51ea0b86f8 [id=c50a93038f084b85af6e9f2f442ebc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.190013 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.195068 593 catalog_manager.cc:5671] T f376fbfbfd804ffcad30dcd55b7afc6a P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:19.202093 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_1d7224e7dc3a4cb0b4b587d457e44f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.202781 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d7224e7dc3a4cb0b4b587d457e44f78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.213856 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9816136452d14647aeda8398eb5e6864
I20260503 07:53:19.214596 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_04b3a8c84d6149108c5aa8c3fa183a9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.215095 1166 tablet_bootstrap.cc:492] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
W20260503 07:53:19.215128 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04b3a8c84d6149108c5aa8c3fa183a9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.215226 1166 ts_tablet_manager.cc:1403] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.000s
I20260503 07:53:19.215903 1166 raft_consensus.cc:359] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.216063 1166 raft_consensus.cc:385] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.216116 1166 raft_consensus.cc:740] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.216544 1166 consensus_queue.cc:260] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.216825 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9816136452d14647aeda8398eb5e6864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.217016 1166 ts_tablet_manager.cc:1434] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:19.217289 1166 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.217883 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 1cbc01a3510c4cd4b81ae6ccc71fe769
I20260503 07:53:19.218355 597 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1683) took 1547 ms. Trace:
I20260503 07:53:19.218443 597 rpcz_store.cc:276] 0503 07:53:17.670739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.249916 (+579177us) service_pool.cc:224] Handling call
0503 07:53:18.261042 (+ 11126us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.261193 (+ 151us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:18.261248 (+ 55us) catalog_manager.cc:2824] Locking tablets
0503 07:53:19.179609 (+918361us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:19.217747 (+ 38138us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:19.217825 (+ 78us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:19.217857 (+ 32us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:19.218339 (+ 482us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:19.185324 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:19.185429 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:19.185435 (+ 6us) write_op.cc:435] Acquired schema lock
0503 07:53:19.185438 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:19.185535 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:19.185544 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:19.185551 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:19.185646 (+ 95us) tablet.cc:701] Row locks acquired
0503 07:53:19.185649 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:19.185676 (+ 27us) write_op.cc:270] Start()
0503 07:53:19.185703 (+ 27us) write_op.cc:276] Timestamp: P: 1777794799185651 usec, L: 0
0503 07:53:19.185708 (+ 5us) op_driver.cc:348] REPLICATION: starting
0503 07:53:19.185849 (+ 141us) log.cc:844] Serialized 725 byte log entry
0503 07:53:19.211820 (+ 25971us) op_driver.cc:464] REPLICATION: finished
0503 07:53:19.212920 (+ 1100us) write_op.cc:301] APPLY: starting
0503 07:53:19.212930 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:19.212957 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:19.212977 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:19.213023 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:19.213046 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:19.213052 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:19.213098 (+ 46us) log.cc:844] Serialized 29 byte log entry
0503 07:53:19.213134 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.213148 (+ 14us) write_op.cc:454] Released schema lock
0503 07:53:19.213152 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:19.213210 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.213214 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1069,"apply.run_cpu_time_us":284,"apply.run_wall_time_us":283,"num_ops":2,"prepare.queue_time_us":3399,"prepare.run_cpu_time_us":575,"prepare.run_wall_time_us":574,"replication_time_us":26099}]]}
I20260503 07:53:19.218946 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9816136452d14647aeda8398eb5e6864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.219096 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c0b02f6fff484b6b93b1355d8a339122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.219419 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.219551 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:19.219584 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0b02f6fff484b6b93b1355d8a339122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.219830 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1799fea5a17f4a1cbbcd955d3813167c" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:19.220772 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:19.221060 854 leader_election.cc:343] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5e9d50a71c1a4bf799de34af1064597d
I20260503 07:53:19.221762 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 48d3b5589aeb4d8399c415b361cacf2f
I20260503 07:53:19.222193 600 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44308 (request call id 1688) took 1264 ms. Trace:
I20260503 07:53:19.222216 854 leader_election.cc:304] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.222551 1166 tablet_bootstrap.cc:654] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.222262 600 rpcz_store.cc:276] 0503 07:53:17.958240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.742049 (+783809us) service_pool.cc:224] Handling call
0503 07:53:18.742426 (+ 377us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.742558 (+ 132us) catalog_manager.cc:2815] Modifying in-memory table state
0503 07:53:18.742609 (+ 51us) catalog_manager.cc:2824] Locking tablets
0503 07:53:19.180407 (+437798us) catalog_manager.cc:2838] Removing table and tablets from system table
0503 07:53:19.221629 (+ 41222us) catalog_manager.cc:2856] Removing table from by-name map
0503 07:53:19.221707 (+ 78us) catalog_manager.cc:2872] Committing in-memory state
0503 07:53:19.221739 (+ 32us) catalog_manager.cc:2876] Aborting table tasks
0503 07:53:19.222176 (+ 437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:19.183869 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:19.183990 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:19.183998 (+ 8us) write_op.cc:435] Acquired schema lock
0503 07:53:19.184001 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:19.184138 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:19.184149 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:19.184156 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:19.184280 (+ 124us) tablet.cc:701] Row locks acquired
0503 07:53:19.184283 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:19.184320 (+ 37us) write_op.cc:270] Start()
0503 07:53:19.184354 (+ 34us) write_op.cc:276] Timestamp: P: 1777794799184294 usec, L: 0
0503 07:53:19.184359 (+ 5us) op_driver.cc:348] REPLICATION: starting
0503 07:53:19.184554 (+ 195us) log.cc:844] Serialized 756 byte log entry
0503 07:53:19.211695 (+ 27141us) op_driver.cc:464] REPLICATION: finished
0503 07:53:19.211950 (+ 255us) write_op.cc:301] APPLY: starting
0503 07:53:19.211965 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:19.212009 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:19.212032 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:19.212122 (+ 90us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:19.212157 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:19.212163 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:19.212273 (+ 110us) log.cc:844] Serialized 29 byte log entry
0503 07:53:19.212351 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.212368 (+ 17us) write_op.cc:454] Released schema lock
0503 07:53:19.212375 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:19.212444 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.212448 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":208,"apply.run_cpu_time_us":486,"apply.run_wall_time_us":485,"num_ops":2,"prepare.queue_time_us":2678,"prepare.run_cpu_time_us":777,"prepare.run_wall_time_us":777,"replication_time_us":27306}]]}
I20260503 07:53:19.222957 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_c9c4f91172e64186b6c083959ecc2b32" } new_table_name: "default.Table_99a88a8685f34a0d99adf70f29c7000a" modify_external_catalogs: true
I20260503 07:53:19.223600 3151 raft_consensus.cc:2749] T 5e9d50a71c1a4bf799de34af1064597d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:19.223870 875 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 184) took 2616 ms. Trace:
I20260503 07:53:19.224357 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.224450 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.224788 1174 tablet_replica.cc:333] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
W20260503 07:53:19.224970 715 leader_election.cc:343] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.225222 1174 raft_consensus.cc:2243] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:19.225404 715 leader_election.cc:343] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.225557 1174 raft_consensus.cc:2272] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.229753 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet fa3459a8ed6445a0b5ee4c2848941972
I20260503 07:53:19.230577 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cce9cbff5f7f4ca7bed2d90847c009a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.231089 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce9cbff5f7f4ca7bed2d90847c009a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.231782 1166 tablet_bootstrap.cc:492] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.231958 1166 ts_tablet_manager.cc:1403] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260503 07:53:19.232728 887 tablet_service.cc:1558] Processing DeleteTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.232952 1166 raft_consensus.cc:359] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.233217 1166 raft_consensus.cc:385] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.233342 1166 raft_consensus.cc:740] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.233604 1166 consensus_queue.cc:260] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.234539 1166 ts_tablet_manager.cc:1434] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:19.234817 1166 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.235684 751 tablet_service.cc:1558] Processing DeleteTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.241544 3070 raft_consensus.cc:493] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.241761 3070 raft_consensus.cc:515] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.242487 3070 leader_election.cc:290] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.243216 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf24705f7d004254bf8456c063634d65" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.196005 593 catalog_manager.cc:5671] T fc130dcd067f43f08748360a692eb048 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3). New cstate: current_term: 1 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:19.244859 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:19.245510 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:19.245921 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1799fea5a17f4a1cbbcd955d3813167c (table default.Table_95667d645ba543c795df2da82c455756 [id=b74130814629460882428c661bc22952]). Expected version 1 got 0
I20260503 07:53:19.246268 593 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 5ba5f770a448465491160fc72f66a830 (table default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616]). Expected version 1 got 0
I20260503 07:53:19.246500 1166 tablet_bootstrap.cc:654] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.253122 1174 ts_tablet_manager.cc:1916] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:19.256930 715 consensus_peers.cc:597] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.257679 885 tablet_service.cc:1511] Processing CreateTablet for tablet 9c187f58edeb4241981dc86a9a0696d9 (DEFAULT_TABLE table=default.Table_eef39281b2734e50aab81f408f1eaa70 [id=e9efb4a88cb84c739e1d3f423e98db4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.258224 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c187f58edeb4241981dc86a9a0696d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.258644 1166 tablet_bootstrap.cc:492] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.259255 887 tablet_service.cc:1511] Processing CreateTablet for tablet d5d1cc98442c4bc99db116613978135e (DEFAULT_TABLE table=default.Table_f1d1baa03e6c4c499fd3b49d191bf2ed [id=401d1dd94b1f420d807ee64e2ff16b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.259621 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d1cc98442c4bc99db116613978135e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.259708 751 tablet_service.cc:1511] Processing CreateTablet for tablet d5d1cc98442c4bc99db116613978135e (DEFAULT_TABLE table=default.Table_f1d1baa03e6c4c499fd3b49d191bf2ed [id=401d1dd94b1f420d807ee64e2ff16b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.260218 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d1cc98442c4bc99db116613978135e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.261793 741 tablet_service.cc:1511] Processing CreateTablet for tablet 9c187f58edeb4241981dc86a9a0696d9 (DEFAULT_TABLE table=default.Table_eef39281b2734e50aab81f408f1eaa70 [id=e9efb4a88cb84c739e1d3f423e98db4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.262072 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c187f58edeb4241981dc86a9a0696d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.224022 875 rpcz_store.cc:276] 0503 07:53:16.711053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:16.711575 (+ 522us) service_pool.cc:224] Handling call
0503 07:53:19.223790 (+2512215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.272060 1166 ts_tablet_manager.cc:1403] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20260503 07:53:19.272713 1166 raft_consensus.cc:359] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.272908 1166 raft_consensus.cc:385] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.272966 1166 raft_consensus.cc:740] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.175315 1175 ts_tablet_manager.cc:1950] T f522dc5e8b12409eb9ed1a763d0db741 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
W20260503 07:53:19.176295 986 leader_election.cc:343] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.274744 986 leader_election.cc:304] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:19.275121 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 98830.5us
I20260503 07:53:19.204968 2916 raft_consensus.cc:493] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.275797 2916 raft_consensus.cc:515] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.216645 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 9816136452d14647aeda8398eb5e6864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.220592 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbc01a3510c4cd4b81ae6ccc71fe769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.224349 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 48d3b5589aeb4d8399c415b361cacf2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:18 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.232460 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.257018 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb (DEFAULT_TABLE table=default.Table_b519db3a4e724196a866ea51ea0b86f8 [id=c50a93038f084b85af6e9f2f442ebc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.276841 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e8442a881e45c5a4cf19c5c6e5fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.258531 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 9c187f58edeb4241981dc86a9a0696d9 (DEFAULT_TABLE table=default.Table_eef39281b2734e50aab81f408f1eaa70 [id=e9efb4a88cb84c739e1d3f423e98db4b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:19.280957 986 leader_election.cc:343] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.281061 986 leader_election.cc:304] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.281708 2816 raft_consensus.cc:2749] T a7907a9cceaa443795275c9cbb62cb22 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.281728 1166 consensus_queue.cc:260] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.281999 2816 raft_consensus.cc:2749] T c14998ce78c64e58ac5b7f651b6b88ba P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.282438 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c187f58edeb4241981dc86a9a0696d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.284780 2916 leader_election.cc:290] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.285279 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c68ca20b1548d99a5956c20b194964" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.282250 1166 ts_tablet_manager.cc:1434] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
W20260503 07:53:19.285882 988 leader_election.cc:343] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.286768 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1256) took 5423 ms. Trace:
W20260503 07:53:19.287302 854 leader_election.cc:343] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:19.287410 854 leader_election.cc:304] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:19.287564 854 raft_consensus.cc:2686] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:53:19.287479 1175 rpcz_store.cc:276] 0503 07:53:13.863145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.863280 (+ 135us) service_pool.cc:224] Handling call
0503 07:53:18.977535 (+5114255us) ts_tablet_manager.cc:1151] Deleting tablet f522dc5e8b12409eb9ed1a763d0db741
0503 07:53:18.977549 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.028317 (+ 50768us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.133078 (+104761us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.286750 (+153672us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5087683}
W20260503 07:53:19.287813 854 leader_election.cc:343] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5eb48844c2a04b5e8b6f73b9986127ee
I20260503 07:53:19.287842 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet f522dc5e8b12409eb9ed1a763d0db741 (table default.Table_c054b519f1b144dd898d987a82f17322 [id=fb064ff3d350482aba7d72c9f634820e]) successfully deleted
I20260503 07:53:19.287899 854 leader_election.cc:304] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.288125 1175 tablet_replica.cc:333] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.288328 1175 raft_consensus.cc:2243] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.288416 3070 raft_consensus.cc:2749] T 5eb48844c2a04b5e8b6f73b9986127ee P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:19.288514 1175 raft_consensus.cc:2272] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:19.288663 854 leader_election.cc:343] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: cf24705f7d004254bf8456c063634d65
I20260503 07:53:19.288748 854 leader_election.cc:304] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.289131 3070 raft_consensus.cc:2749] T cf24705f7d004254bf8456c063634d65 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.292443 1166 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.292593 1175 ts_tablet_manager.cc:1916] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.293977 1166 tablet_bootstrap.cc:654] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.293970 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d5d1cc98442c4bc99db116613978135e (DEFAULT_TABLE table=default.Table_f1d1baa03e6c4c499fd3b49d191bf2ed [id=401d1dd94b1f420d807ee64e2ff16b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.294307 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d1cc98442c4bc99db116613978135e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.297487 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d8c7697c65704e9098218028138ef4d7 (DEFAULT_TABLE table=default.Table_fec11078918d4d14825cc855928545ae [id=aed4d1285044494ab6e9bed16faa036c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.297842 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c7697c65704e9098218028138ef4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.300987 887 tablet_service.cc:1511] Processing CreateTablet for tablet d8c7697c65704e9098218028138ef4d7 (DEFAULT_TABLE table=default.Table_fec11078918d4d14825cc855928545ae [id=aed4d1285044494ab6e9bed16faa036c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.301332 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c7697c65704e9098218028138ef4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.305596 886 tablet_service.cc:1511] Processing CreateTablet for tablet acd07cc5fda9467aa24f37338a1950fc (DEFAULT_TABLE table=default.Table_4eb95f369ab64235b8e0a908a1475ad9 [id=7c97f490909b4d9cae3e3bbecc92ed9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.305893 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd07cc5fda9467aa24f37338a1950fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.310312 2924 consensus_queue.cc:1048] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:53:19.311161 715 consensus_peers.cc:597] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.324796 1171 raft_consensus.cc:385] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.324895 1171 raft_consensus.cc:740] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.325955 1173 ts_tablet_manager.cc:1916] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.326269 1166 tablet_bootstrap.cc:492] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.326440 1166 ts_tablet_manager.cc:1403] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.001s
I20260503 07:53:19.327204 1166 raft_consensus.cc:359] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.327432 1166 raft_consensus.cc:385] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.327519 1166 raft_consensus.cc:740] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.327755 1166 consensus_queue.cc:260] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.328603 1166 ts_tablet_manager.cc:1434] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:19.328734 1171 consensus_queue.cc:260] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.328969 1166 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.330768 1026 tablet_service.cc:1511] Processing CreateTablet for tablet acd07cc5fda9467aa24f37338a1950fc (DEFAULT_TABLE table=default.Table_4eb95f369ab64235b8e0a908a1475ad9 [id=7c97f490909b4d9cae3e3bbecc92ed9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.331310 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd07cc5fda9467aa24f37338a1950fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.331493 886 tablet_service.cc:1511] Processing CreateTablet for tablet a8278ac95de14578ba4294d909e7573b (DEFAULT_TABLE table=default.Table_8c9a269d6be94b66a7cfac07dbdbdec5 [id=227d8230f98d4d87a223c91cefae6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.331804 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8278ac95de14578ba4294d909e7573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.333890 1020 tablet_service.cc:1511] Processing CreateTablet for tablet a8278ac95de14578ba4294d909e7573b (DEFAULT_TABLE table=default.Table_8c9a269d6be94b66a7cfac07dbdbdec5 [id=227d8230f98d4d87a223c91cefae6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.333890 887 tablet_service.cc:1511] Processing CreateTablet for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba (DEFAULT_TABLE table=default.Table_fbc102fc1aae4f6b875dd1dad5add3fc [id=c944d023b55342ef9ea5be86b0795484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.334227 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8278ac95de14578ba4294d909e7573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.334235 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.343631 1171 ts_tablet_manager.cc:1434] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.182s user 0.002s sys 0.000s
I20260503 07:53:19.344017 1171 tablet_bootstrap.cc:492] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.345329 1171 tablet_bootstrap.cc:654] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.351286 1166 tablet_bootstrap.cc:654] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.364512 1166 tablet_bootstrap.cc:492] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.364722 1166 ts_tablet_manager.cc:1403] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.001s
I20260503 07:53:19.365494 1166 raft_consensus.cc:359] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.365716 1166 raft_consensus.cc:385] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.365803 1166 raft_consensus.cc:740] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.366007 1166 consensus_queue.cc:260] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.366598 1166 ts_tablet_manager.cc:1434] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:19.367206 1166 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.370107 1166 tablet_bootstrap.cc:654] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.373437 751 tablet_service.cc:1511] Processing CreateTablet for tablet d8c7697c65704e9098218028138ef4d7 (DEFAULT_TABLE table=default.Table_fec11078918d4d14825cc855928545ae [id=aed4d1285044494ab6e9bed16faa036c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.373760 1175 ts_tablet_manager.cc:1929] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.373860 1175 log.cc:1199] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/18523493ee4841cb8949826239e2e458
I20260503 07:53:19.373950 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c7697c65704e9098218028138ef4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.374228 1175 ts_tablet_manager.cc:1950] T 18523493ee4841cb8949826239e2e458 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.375707 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c68ca20b1548d99a5956c20b194964" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.376722 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1257) took 5513 ms. Trace:
W20260503 07:53:19.377426 986 leader_election.cc:343] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.378677 1175 rpcz_store.cc:276] 0503 07:53:13.863276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.863367 (+ 91us) service_pool.cc:224] Handling call
0503 07:53:19.288083 (+5424716us) ts_tablet_manager.cc:1151] Deleting tablet 18523493ee4841cb8949826239e2e458
0503 07:53:19.288092 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.318847 (+ 30755us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.373700 (+ 54853us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.376704 (+ 3004us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5424613}
I20260503 07:53:19.378823 986 leader_election.cc:304] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.379699 2916 raft_consensus.cc:2749] T e1c68ca20b1548d99a5956c20b194964 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.380379 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1267) took 5442 ms. Trace:
I20260503 07:53:19.380632 1175 rpcz_store.cc:276] 0503 07:53:13.937581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.937624 (+ 43us) service_pool.cc:224] Handling call
0503 07:53:19.379585 (+5441961us) ts_tablet_manager.cc:1151] Deleting tablet 994d9de9bf5b4dfa9157f84ccd59e294
0503 07:53:19.379596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.380363 (+ 767us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5441781}
I20260503 07:53:19.381254 906 raft_consensus.cc:3060] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.381388 1175 tablet_replica.cc:333] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.381574 1175 raft_consensus.cc:2243] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.381695 1175 raft_consensus.cc:2272] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.382720 3070 raft_consensus.cc:493] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:19.382833 3070 raft_consensus.cc:515] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.383399 3070 leader_election.cc:290] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.385329 1166 tablet_bootstrap.cc:492] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.385445 1166 ts_tablet_manager.cc:1403] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
W20260503 07:53:19.385753 854 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: bdd151f5e0d54bdab58423c24186b38d
I20260503 07:53:19.386438 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 18523493ee4841cb8949826239e2e458 (table default.Table_d86e37b23cee4cec9605969951db1bd3 [id=781a43f54aab4e48ba6c66322d204f2f]) successfully deleted
W20260503 07:53:19.386469 851 leader_election.cc:343] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: bdd151f5e0d54bdab58423c24186b38d
I20260503 07:53:19.386551 851 leader_election.cc:304] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:19.386703 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 994d9de9bf5b4dfa9157f84ccd59e294 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 994d9de9bf5b4dfa9157f84ccd59e294 already in progress: creating tablet
I20260503 07:53:19.386158 1166 raft_consensus.cc:359] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.386885 1166 raft_consensus.cc:385] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.386961 1166 raft_consensus.cc:740] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.387039 3070 raft_consensus.cc:2749] T bdd151f5e0d54bdab58423c24186b38d P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:19.387197 1166 consensus_queue.cc:260] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.387780 1166 ts_tablet_manager.cc:1434] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:19.387830 1174 ts_tablet_manager.cc:1929] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.387974 1174 log.cc:1199] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/3cf72d49cfd24083abee07e0d2190e3e
I20260503 07:53:19.388068 1166 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.390205 1166 tablet_bootstrap.cc:654] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.390985 2964 consensus_queue.cc:1048] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:19.392845 1175 ts_tablet_manager.cc:1916] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.395984 886 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee679bf494eefb1766247dee50b64 (DEFAULT_TABLE table=default.Table_1e9cd3e917c3401c97534f9b3c929429 [id=24962e7d18f744e7ab9b3e4211ec9ab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.396406 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee679bf494eefb1766247dee50b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.399384 1174 ts_tablet_manager.cc:1950] T 3cf72d49cfd24083abee07e0d2190e3e P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:19.399740 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1160) took 5678 ms. Trace:
I20260503 07:53:19.399822 1174 rpcz_store.cc:276] 0503 07:53:13.721626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.721679 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:19.224659 (+5502980us) ts_tablet_manager.cc:1151] Deleting tablet 3cf72d49cfd24083abee07e0d2190e3e
0503 07:53:19.224677 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.301729 (+ 77052us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.387769 (+ 86040us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.399723 (+ 11954us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5434293}
I20260503 07:53:19.401197 887 tablet_service.cc:1511] Processing CreateTablet for tablet ba1d29d72f734b2d97a942de01b49d0a (DEFAULT_TABLE table=default.Table_ea5323e983964f1b9698637fd9c7568c [id=d7b3c1ad8f174e0182a6fe484209ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.401252 884 tablet_service.cc:1511] Processing CreateTablet for tablet b378b4d831c64b0683a280159de56a51 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.401577 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1d29d72f734b2d97a942de01b49d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.401795 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b378b4d831c64b0683a280159de56a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.402662 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b378b4d831c64b0683a280159de56a51 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.402959 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b378b4d831c64b0683a280159de56a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.412645 2964 raft_consensus.cc:493] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.412796 2964 raft_consensus.cc:515] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.413517 2964 leader_election.cc:290] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.414250 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.414389 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.414428 1049 raft_consensus.cc:2468] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:19.414819 715 leader_election.cc:343] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.414927 715 leader_election.cc:304] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:19.415364 2964 raft_consensus.cc:2804] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:19.415441 2964 raft_consensus.cc:493] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:19.415498 2964 raft_consensus.cc:3060] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.418587 2964 raft_consensus.cc:515] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.419126 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ba1d29d72f734b2d97a942de01b49d0a (DEFAULT_TABLE table=default.Table_ea5323e983964f1b9698637fd9c7568c [id=d7b3c1ad8f174e0182a6fe484209ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.419541 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1d29d72f734b2d97a942de01b49d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.419584 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:19.419924 2987 raft_consensus.cc:493] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:53:19.420058 715 leader_election.cc:343] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.420063 2987 raft_consensus.cc:515] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.420641 2987 leader_election.cc:290] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:19.420694 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637462b45502433796daa7a9cd8586d3" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:19.420838 1049 raft_consensus.cc:3060] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.421277 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb2026ec07045f6b38c86f1d5d22462" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.421702 988 leader_election.cc:343] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.423404 1049 raft_consensus.cc:2468] T 637462b45502433796daa7a9cd8586d3 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:19.426326 3120 tablet.cc:1724] T 0f3152281bf44946a4ae806f253ecd85 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:19.428194 751 tablet_service.cc:1511] Processing CreateTablet for tablet acd07cc5fda9467aa24f37338a1950fc (DEFAULT_TABLE table=default.Table_4eb95f369ab64235b8e0a908a1475ad9 [id=7c97f490909b4d9cae3e3bbecc92ed9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.428664 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd07cc5fda9467aa24f37338a1950fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.428785 747 tablet_service.cc:1511] Processing CreateTablet for tablet a8278ac95de14578ba4294d909e7573b (DEFAULT_TABLE table=default.Table_8c9a269d6be94b66a7cfac07dbdbdec5 [id=227d8230f98d4d87a223c91cefae6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.429255 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8278ac95de14578ba4294d909e7573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.432824 716 leader_election.cc:304] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:19.433379 2924 raft_consensus.cc:2804] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:19.433490 2924 raft_consensus.cc:697] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:19.433733 2924 consensus_queue.cc:237] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.435851 1174 tablet_replica.cc:333] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:19.436102 1174 raft_consensus.cc:2243] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.443462 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 3cf72d49cfd24083abee07e0d2190e3e (table default.Table_f42b9c55cc4943d18c8b37b7e1a42002 [id=f80b688eb70244bca8da3d591ddf3c95]) successfully deleted
I20260503 07:53:19.437249 747 tablet_service.cc:1511] Processing CreateTablet for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba (DEFAULT_TABLE table=default.Table_fbc102fc1aae4f6b875dd1dad5add3fc [id=c944d023b55342ef9ea5be86b0795484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.438341 743 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee679bf494eefb1766247dee50b64 (DEFAULT_TABLE table=default.Table_1e9cd3e917c3401c97534f9b3c929429 [id=24962e7d18f744e7ab9b3e4211ec9ab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.444048 1174 raft_consensus.cc:2272] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.444402 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee679bf494eefb1766247dee50b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.445027 2964 leader_election.cc:290] T 637462b45502433796daa7a9cd8586d3 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.445953 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee679bf494eefb1766247dee50b64 (DEFAULT_TABLE table=default.Table_1e9cd3e917c3401c97534f9b3c929429 [id=24962e7d18f744e7ab9b3e4211ec9ab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.446259 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee679bf494eefb1766247dee50b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.449425 1174 ts_tablet_manager.cc:1916] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:19.439884 716 consensus_peers.cc:597] T 18523493ee4841cb8949826239e2e458 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18523493ee4841cb8949826239e2e458. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.441867 758 tablet_service.cc:1511] Processing CreateTablet for tablet ba1d29d72f734b2d97a942de01b49d0a (DEFAULT_TABLE table=default.Table_ea5323e983964f1b9698637fd9c7568c [id=d7b3c1ad8f174e0182a6fe484209ad68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.449954 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1d29d72f734b2d97a942de01b49d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.442875 748 tablet_service.cc:1511] Processing CreateTablet for tablet b378b4d831c64b0683a280159de56a51 (DEFAULT_TABLE table=default.Table_196b3df392d748dc9ff186860f3f2b98 [id=518cbb45226a4328a7cc914736b0c035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.452476 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b378b4d831c64b0683a280159de56a51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:19.462072 587 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 42c82dbdf98947fca0b8aaa9f47f13db (table default.Table_868eb376b61f485b8831572b35e6f606 [id=51d560668ca44003adb4451c0c69b70a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 42c82dbdf98947fca0b8aaa9f47f13db consensus state has no leader
I20260503 07:53:19.466598 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.469534 887 tablet_service.cc:1511] Processing CreateTablet for tablet 6ece446c9a104cb990b3ee87ec70cb5c (DEFAULT_TABLE table=default.Table_39f0ef7ba18e450e8d9d7e33ef6c1fa7 [id=81a6e27155fe407c8639db57efd7d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.470021 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece446c9a104cb990b3ee87ec70cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.474936 2987 raft_consensus.cc:493] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.475142 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 195c65abee2f462fa809d4501026743b (DEFAULT_TABLE table=default.Table_a19960d97e854ff890d7dc2083f0503d [id=dca2683e8145491b974772c5d4ef4d6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.475121 2987 raft_consensus.cc:515] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.475476 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195c65abee2f462fa809d4501026743b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.476143 2987 leader_election.cc:290] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:19.476980 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f24fb277ff43f68dcb0d2ac5faa704" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.477548 988 leader_election.cc:343] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.478124 2987 raft_consensus.cc:493] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.478386 2987 raft_consensus.cc:515] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.479127 2987 leader_election.cc:290] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.479696 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6ece446c9a104cb990b3ee87ec70cb5c (DEFAULT_TABLE table=default.Table_39f0ef7ba18e450e8d9d7e33ef6c1fa7 [id=81a6e27155fe407c8639db57efd7d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.480062 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece446c9a104cb990b3ee87ec70cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.488011 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb2026ec07045f6b38c86f1d5d22462" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.493171 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f24fb277ff43f68dcb0d2ac5faa704" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.493423 1175 ts_tablet_manager.cc:1929] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:19.493880 1175 log.cc:1199] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d7b31b3076214d37a744faa4fa8d585b
I20260503 07:53:19.494239 3070 raft_consensus.cc:493] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.494968 1175 ts_tablet_manager.cc:1950] T d7b31b3076214d37a744faa4fa8d585b P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.495905 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1270) took 5552 ms. Trace:
I20260503 07:53:19.497031 886 tablet_service.cc:1511] Processing CreateTablet for tablet 195c65abee2f462fa809d4501026743b (DEFAULT_TABLE table=default.Table_a19960d97e854ff890d7dc2083f0503d [id=dca2683e8145491b974772c5d4ef4d6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.497430 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195c65abee2f462fa809d4501026743b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.497153 1175 rpcz_store.cc:276] 0503 07:53:13.943245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.943292 (+ 47us) service_pool.cc:224] Handling call
0503 07:53:19.381346 (+5438054us) ts_tablet_manager.cc:1151] Deleting tablet d7b31b3076214d37a744faa4fa8d585b
0503 07:53:19.381356 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.472551 (+ 91195us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.493379 (+ 20828us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.495890 (+ 2511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":5437913}
I20260503 07:53:19.499946 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d7b31b3076214d37a744faa4fa8d585b (table default.Table_399e3cb559dc48b69df2badacac96f6c [id=c92b3bc4731e4254b0c0ea4836119701]) successfully deleted
I20260503 07:53:19.500672 1029 tablet_service.cc:1511] Processing CreateTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 (DEFAULT_TABLE table=default.Table_ebb0f12d94334be3a5029fb75213499d [id=c03ff53d25f84cfea3e68289cc6d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.501120 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3459a8ed6445a0b5ee4c2848941972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.500200 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1271) took 5554 ms. Trace:
I20260503 07:53:19.507447 1175 rpcz_store.cc:276] 0503 07:53:13.945648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.945688 (+ 40us) service_pool.cc:224] Handling call
0503 07:53:19.499989 (+5554301us) ts_tablet_manager.cc:1151] Deleting tablet 6954ec38f7f742eaa7cc05af5b1432d0
0503 07:53:19.499998 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.500183 (+ 185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5554168}
I20260503 07:53:19.508865 1175 tablet_replica.cc:333] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.509174 1175 raft_consensus.cc:2243] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.509423 1175 raft_consensus.cc:2272] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.510634 1175 ts_tablet_manager.cc:1916] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:19.511101 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 6954ec38f7f742eaa7cc05af5b1432d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6954ec38f7f742eaa7cc05af5b1432d0 already in progress: creating tablet
I20260503 07:53:19.517277 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb49d5b35994fe9b383b72f77eaebb6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.520116 1165 tablet_bootstrap.cc:492] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.520279 1165 ts_tablet_manager.cc:1403] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.389s user 0.142s sys 0.193s
I20260503 07:53:19.494361 3070 raft_consensus.cc:515] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.520614 884 tablet_service.cc:1511] Processing CreateTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 (DEFAULT_TABLE table=default.Table_ebb0f12d94334be3a5029fb75213499d [id=c03ff53d25f84cfea3e68289cc6d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.520973 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3459a8ed6445a0b5ee4c2848941972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.520977 1165 raft_consensus.cc:359] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.521124 1165 raft_consensus.cc:385] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.521170 1165 raft_consensus.cc:740] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.521337 1165 consensus_queue.cc:260] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.521770 1165 ts_tablet_manager.cc:1434] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260503 07:53:19.522004 1165 tablet_bootstrap.cc:492] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.522555 915 raft_consensus.cc:3060] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.523382 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.523480 1165 tablet_bootstrap.cc:654] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.523692 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc130dcd067f43f08748360a692eb048" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.524374 854 leader_election.cc:304] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.524606 3149 raft_consensus.cc:2749] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:19.526475 986 leader_election.cc:343] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.526580 986 leader_election.cc:304] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.526830 2987 raft_consensus.cc:2749] T acb2026ec07045f6b38c86f1d5d22462 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.527318 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 924f451ee1474ca780513daf665ffefb (DEFAULT_TABLE table=default.Table_948a8afda7584de9ba7005c1e0cfe63c [id=7031893da64144a6b936e964963bf83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.527623 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f451ee1474ca780513daf665ffefb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:19.527860 986 leader_election.cc:343] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.527964 986 leader_election.cc:304] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.528326 2987 raft_consensus.cc:2749] T 40f24fb277ff43f68dcb0d2ac5faa704 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.520984 3070 leader_election.cc:290] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.534109 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a40f2c0631b7437b86fa58f5f5f81fcc (DEFAULT_TABLE table=default.Table_840c32ea51014f56a1ccff214018c934 [id=61ffa09a639c45cbaac1b5f0e8169fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.534471 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40f2c0631b7437b86fa58f5f5f81fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.538180 1165 tablet_bootstrap.cc:492] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.538332 1165 ts_tablet_manager.cc:1403] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.007s
I20260503 07:53:19.539111 1165 raft_consensus.cc:359] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.539294 1165 raft_consensus.cc:385] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.539374 1165 raft_consensus.cc:740] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.539583 1165 consensus_queue.cc:260] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.540266 1165 ts_tablet_manager.cc:1434] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 07:53:19.540522 1165 tablet_bootstrap.cc:492] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.540685 3175 raft_consensus.cc:493] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.540783 3175 raft_consensus.cc:515] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.541302 3175 leader_election.cc:290] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.541772 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.541917 1049 raft_consensus.cc:2468] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:19.542686 876 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39890 (request call id 188) took 2423 ms. Trace:
I20260503 07:53:19.542775 876 rpcz_store.cc:276] 0503 07:53:17.118729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.118791 (+ 62us) service_pool.cc:224] Handling call
0503 07:53:19.542647 (+2423856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:53:19.542845 716 leader_election.cc:304] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:19.543032 3175 raft_consensus.cc:2804] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:19.543104 3175 raft_consensus.cc:493] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:19.543164 3175 raft_consensus.cc:3060] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.544100 896 tablet_service.cc:1511] Processing CreateTablet for tablet a40f2c0631b7437b86fa58f5f5f81fcc (DEFAULT_TABLE table=default.Table_840c32ea51014f56a1ccff214018c934 [id=61ffa09a639c45cbaac1b5f0e8169fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.544469 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40f2c0631b7437b86fa58f5f5f81fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.545328 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb49d5b35994fe9b383b72f77eaebb6" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.545732 988 leader_election.cc:343] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.545825 3175 raft_consensus.cc:515] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.546517 3175 leader_election.cc:290] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.546967 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:19.547114 1049 raft_consensus.cc:3060] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.547871 1165 tablet_bootstrap.cc:654] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.549635 1049 raft_consensus.cc:2468] T 8f6df58637e047ef9b696f22d7c43e48 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:19.550026 716 leader_election.cc:304] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:19.550242 3175 raft_consensus.cc:2804] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:19.550372 3175 raft_consensus.cc:697] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:19.550597 3175 consensus_queue.cc:237] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.550346 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.561635 715 leader_election.cc:343] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.561758 1174 ts_tablet_manager.cc:1929] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.561863 1174 log.cc:1199] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/7336c1df59754cd58c0c290b84fc0d7a
I20260503 07:53:19.562249 1174 ts_tablet_manager.cc:1950] T 7336c1df59754cd58c0c290b84fc0d7a P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:19.562775 895 tablet_service.cc:1511] Processing CreateTablet for tablet 924f451ee1474ca780513daf665ffefb (DEFAULT_TABLE table=default.Table_948a8afda7584de9ba7005c1e0cfe63c [id=7031893da64144a6b936e964963bf83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.563143 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f451ee1474ca780513daf665ffefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.563103 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1161) took 5829 ms. Trace:
I20260503 07:53:19.563194 1174 rpcz_store.cc:276] 0503 07:53:13.733471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.733557 (+ 86us) service_pool.cc:224] Handling call
0503 07:53:19.435787 (+5702230us) ts_tablet_manager.cc:1151] Deleting tablet 7336c1df59754cd58c0c290b84fc0d7a
0503 07:53:19.435801 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.484916 (+ 49115us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.561685 (+ 76769us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.563080 (+ 1395us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5702021}
I20260503 07:53:19.563560 1174 tablet_replica.cc:333] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:19.563782 1174 raft_consensus.cc:2243] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.563941 1174 raft_consensus.cc:2272] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.566282 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6df58637e047ef9b696f22d7c43e48" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:19.566737 715 leader_election.cc:343] T 8f6df58637e047ef9b696f22d7c43e48 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.581053 3120 tablet.cc:1724] T 5ba5f770a448465491160fc72f66a830 P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:19.582281 1166 tablet_bootstrap.cc:492] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.582481 1166 ts_tablet_manager.cc:1403] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.194s user 0.008s sys 0.004s
I20260503 07:53:19.590899 3149 raft_consensus.cc:493] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.591030 3149 raft_consensus.cc:515] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.591604 3149 leader_election.cc:290] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
W20260503 07:53:19.592554 851 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 2ad24ddc82bd401fb5427e7415af3922
W20260503 07:53:19.593080 854 leader_election.cc:343] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 2ad24ddc82bd401fb5427e7415af3922
I20260503 07:53:19.593165 854 leader_election.cc:304] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.593549 3149 raft_consensus.cc:2749] T 2ad24ddc82bd401fb5427e7415af3922 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.598870 1174 ts_tablet_manager.cc:1916] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.614322 1165 tablet_bootstrap.cc:492] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.614459 1165 ts_tablet_manager.cc:1403] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.074s user 0.006s sys 0.000s
I20260503 07:53:19.618247 1165 raft_consensus.cc:359] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.618438 1165 raft_consensus.cc:385] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.618528 1165 raft_consensus.cc:740] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.618741 1165 consensus_queue.cc:260] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.618839 1166 raft_consensus.cc:359] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.618991 1166 raft_consensus.cc:385] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.619040 1166 raft_consensus.cc:740] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.619278 1166 consensus_queue.cc:260] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.619388 1165 ts_tablet_manager.cc:1434] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20260503 07:53:19.619705 1165 tablet_bootstrap.cc:492] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.622263 1165 tablet_bootstrap.cc:654] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.626104 1166 ts_tablet_manager.cc:1434] T df60413555764bcab464b18c6a3370ce P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
W20260503 07:53:19.626518 986 leader_election.cc:343] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.626637 986 leader_election.cc:304] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.627251 2916 raft_consensus.cc:2749] T 6fb49d5b35994fe9b383b72f77eaebb6 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:53:19.632768 3194 log.cc:927] Time spent T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260503 07:53:19.635407 1020 tablet_service.cc:1511] Processing CreateTablet for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba (DEFAULT_TABLE table=default.Table_fbc102fc1aae4f6b875dd1dad5add3fc [id=c944d023b55342ef9ea5be86b0795484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.636711 1166 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.647643 1166 tablet_bootstrap.cc:654] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.647821 2987 raft_consensus.cc:493] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.647933 2987 raft_consensus.cc:515] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.648610 2987 leader_election.cc:290] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:19.649823 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6772fe0377b249be9e247ec93cf50719" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.650791 988 leader_election.cc:343] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.656615 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_83395244447a4a89ac906fece539aa27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.657158 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83395244447a4a89ac906fece539aa27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.658545 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4e50c697b3d540baa679fe0efe2c6f66" } new_table_name: "default.Table_b4ea088b95f74eac822cfce8594829a9" modify_external_catalogs: true
W20260503 07:53:19.659651 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ef452f8361c4aedbac532c5f7669612 consensus state has no leader
I20260503 07:53:19.659956 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4f59c103b06341e19b57cda023692011"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.660435 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f59c103b06341e19b57cda023692011 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.661491 3199 tablet.cc:1724] T c0ceddd751644d20bcbda15a462d5342 P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:19.661645 597 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eef39281b2734e50aab81f408f1eaa70" } new_table_name: "default.Table_d35ce1ad22ae4e74b1bad396f9186ca0" modify_external_catalogs: true
I20260503 07:53:19.662241 1175 ts_tablet_manager.cc:1929] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.662338 1175 log.cc:1199] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/26032d89839340988fce30f458e785fa
I20260503 07:53:19.662715 1175 ts_tablet_manager.cc:1950] T 26032d89839340988fce30f458e785fa P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.667580 1173 ts_tablet_manager.cc:1929] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:19.667702 1173 log.cc:1199] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/94cd6a702c59445882a81ca2e3a0f3f6
I20260503 07:53:19.668032 1173 ts_tablet_manager.cc:1950] T 94cd6a702c59445882a81ca2e3a0f3f6 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:19.668681 2912 raft_consensus.cc:493] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:19.668845 2912 raft_consensus.cc:515] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.668956 1171 tablet_bootstrap.cc:492] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.669077 1171 ts_tablet_manager.cc:1403] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.325s user 0.002s sys 0.000s
I20260503 07:53:19.669450 2912 leader_election.cc:290] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.669701 1171 raft_consensus.cc:359] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.669842 1171 raft_consensus.cc:385] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.669890 1171 raft_consensus.cc:740] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.670080 1171 consensus_queue.cc:260] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.670702 1171 ts_tablet_manager.cc:1434] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 07:53:19.671759 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_cc7be5935f854d1ea182c4eb9ce3ac83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.672061 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeae3f9b2ecf4bf09ef01be9ac42eeba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:19.672260 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc7be5935f854d1ea182c4eb9ce3ac83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.678745 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1272) took 5729 ms. Trace:
I20260503 07:53:19.678843 1175 rpcz_store.cc:276] 0503 07:53:13.949516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.949560 (+ 44us) service_pool.cc:224] Handling call
0503 07:53:19.508813 (+5559253us) ts_tablet_manager.cc:1151] Deleting tablet 26032d89839340988fce30f458e785fa
0503 07:53:19.508825 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.515372 (+ 6547us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.662189 (+146817us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.678722 (+ 16533us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5559030}
I20260503 07:53:19.679181 1175 tablet_replica.cc:333] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.679374 1175 raft_consensus.cc:2243] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.681782 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 26032d89839340988fce30f458e785fa (table default.Table_1d33b7920244493683c5f12e1bef5a9a [id=11a2c74d8372450eadd5f5eb5e031241]) successfully deleted
I20260503 07:53:19.679529 1175 raft_consensus.cc:2272] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.682587 1175 ts_tablet_manager.cc:1916] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.688853 3079 log.cc:826] T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Log is configured to *not* fsync() on all Append() calls
I20260503 07:53:19.689466 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 924) took 10664 ms. Trace:
I20260503 07:53:19.689620 1173 rpcz_store.cc:276] 0503 07:53:09.024977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.056624 (+ 31647us) service_pool.cc:224] Handling call
0503 07:53:19.164836 (+10108212us) ts_tablet_manager.cc:1151] Deleting tablet 94cd6a702c59445882a81ca2e3a0f3f6
0503 07:53:19.164845 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.653268 (+488423us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.667511 (+ 14243us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.689444 (+ 21933us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5259,"tablet-delete.queue_time_us":10107487}
I20260503 07:53:19.690012 1173 tablet_replica.cc:333] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:19.690218 1173 raft_consensus.cc:2243] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.690414 1173 raft_consensus.cc:2272] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.690925 1173 ts_tablet_manager.cc:1916] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.694846 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 94cd6a702c59445882a81ca2e3a0f3f6 (table default.Table_51fb3eec8b874340a588a54ee74d00cf [id=4b72deda123e4973bb5bad7303ca2fbd]) successfully deleted
W20260503 07:53:19.707402 597 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c187f58edeb4241981dc86a9a0696d9 consensus state has no leader
I20260503 07:53:19.707773 1171 tablet_bootstrap.cc:492] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.707765 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_557490923aff4617bea08659402eddf8" } modify_external_catalogs: true
I20260503 07:53:19.707960 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_557490923aff4617bea08659402eddf8" } modify_external_catalogs: true
I20260503 07:53:19.709443 1171 tablet_bootstrap.cc:654] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:19.709499 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c0f4e9d8cdc4fa99f813376a4adfe3d consensus state has no leader
I20260503 07:53:19.709834 596 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_9d5d2666362f435690d584889f448008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.710302 596 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d5d2666362f435690d584889f448008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.713052 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_00a5ff003ba74e7b93006dc720605b27" } new_table_name: "default.Table_6eef6f99932a4628ac1344762ed4b56f" modify_external_catalogs: true
I20260503 07:53:19.714721 598 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d63d756541b94a5a8994322c8200a4e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.715153 598 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d63d756541b94a5a8994322c8200a4e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.716158 1173 ts_tablet_manager.cc:1929] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:19.717026 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_6b16340dd7264cc69f864a6583481be4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.717406 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b16340dd7264cc69f864a6583481be4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.722736 1173 log.cc:1199] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/56749914e1a349f0876f52157affdf69
I20260503 07:53:19.723090 1175 ts_tablet_manager.cc:1929] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.723291 1171 tablet_bootstrap.cc:492] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.723417 1171 ts_tablet_manager.cc:1403] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260503 07:53:19.723730 1173 ts_tablet_manager.cc:1950] T 56749914e1a349f0876f52157affdf69 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:19.723995 1171 raft_consensus.cc:359] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.724207 1171 raft_consensus.cc:385] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.724278 1171 raft_consensus.cc:740] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.724488 1171 consensus_queue.cc:260] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.725003 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 928) took 10550 ms. Trace:
I20260503 07:53:19.725399 1171 ts_tablet_manager.cc:1434] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260503 07:53:19.725662 1171 tablet_bootstrap.cc:492] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.726853 1171 tablet_bootstrap.cc:654] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.729056 592 catalog_manager.cc:5671] T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:19.729713 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet c0ceddd751644d20bcbda15a462d5342 (table default.Table_f753dec874b841f18bf08be5433c6402 [id=36a30c4e7a864127b873fc19a9b9cfd5]). Expected version 1 got 0
I20260503 07:53:19.730759 1173 rpcz_store.cc:276] 0503 07:53:09.174763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.182023 (+ 7260us) service_pool.cc:224] Handling call
0503 07:53:19.689971 (+10507948us) ts_tablet_manager.cc:1151] Deleting tablet 56749914e1a349f0876f52157affdf69
0503 07:53:19.689979 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.693935 (+ 3956us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.716098 (+ 22163us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.724982 (+ 8884us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10505082}
I20260503 07:53:19.732690 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 927) took 10558 ms. Trace:
I20260503 07:53:19.723310 1175 log.cc:1199] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/956600f557b84dac98be63ffe14f4e19
I20260503 07:53:19.735486 1173 rpcz_store.cc:276] 0503 07:53:09.174617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.182603 (+ 7986us) service_pool.cc:224] Handling call
0503 07:53:19.732563 (+10549960us) ts_tablet_manager.cc:1151] Deleting tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc
0503 07:53:19.732576 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.732673 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10547518}
I20260503 07:53:19.736334 1173 tablet_replica.cc:333] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:19.736599 1175 ts_tablet_manager.cc:1950] T 956600f557b84dac98be63ffe14f4e19 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.732525 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 56749914e1a349f0876f52157affdf69 (table default.Table_b052f67527974a2baf9cedbcd25453a9 [id=198bfe0e6ac442aa87aba492634e7a71]) successfully deleted
W20260503 07:53:19.738334 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f87f44e03e46b1bcc0fe1bcdc78ebc already in progress: creating tablet
I20260503 07:53:19.738508 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1275) took 5776 ms. Trace:
I20260503 07:53:19.729911 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:19.738920 592 catalog_manager.cc:5671] T d08b5135cb77444bb5ff35c5f9d68129 P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:19.739355 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:19.740200 1175 rpcz_store.cc:276] 0503 07:53:13.962384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.962434 (+ 50us) service_pool.cc:224] Handling call
0503 07:53:19.679136 (+5716702us) ts_tablet_manager.cc:1151] Deleting tablet 956600f557b84dac98be63ffe14f4e19
0503 07:53:19.679145 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.706767 (+ 27622us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.723033 (+ 16266us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.738489 (+ 15456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5716531}
I20260503 07:53:19.740422 592 catalog_manager.cc:5671] T 2eb33e9818334d4a8ea4e648c3dd7cac P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:19.740903 592 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
I20260503 07:53:19.741122 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 956600f557b84dac98be63ffe14f4e19 (table default.Table_20770d6cc8c7480c97d762c6d7a087f4 [id=acb7469dcfea490bbb8e7a596577fd39]) successfully deleted
I20260503 07:53:19.741406 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1280) took 5751 ms. Trace:
I20260503 07:53:19.742877 1175 rpcz_store.cc:276] 0503 07:53:13.989772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.989814 (+ 42us) service_pool.cc:224] Handling call
0503 07:53:19.741286 (+5751472us) ts_tablet_manager.cc:1151] Deleting tablet c9fdc7738d1e4df6aed3a85c4cee3f72
0503 07:53:19.741295 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.741390 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5743905}
I20260503 07:53:19.742422 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.743486 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ea5f9f9964fbdb8eb92e6059e2531" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.744477 915 raft_consensus.cc:2368] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a924c2134c54fa0bb164825da53bdd0 for earlier term 2. Current term is 3.
I20260503 07:53:19.744864 1173 raft_consensus.cc:2243] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.741688 1171 tablet_bootstrap.cc:492] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.745465 1171 ts_tablet_manager.cc:1403] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260503 07:53:19.746132 1171 raft_consensus.cc:359] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.746276 1171 raft_consensus.cc:385] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.746349 1171 raft_consensus.cc:740] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
W20260503 07:53:19.746701 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet c9fdc7738d1e4df6aed3a85c4cee3f72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9fdc7738d1e4df6aed3a85c4cee3f72 already in progress: creating tablet
I20260503 07:53:19.746767 1175 tablet_replica.cc:333] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.746536 1173 raft_consensus.cc:2272] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.746935 1175 raft_consensus.cc:2243] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.747825 1175 raft_consensus.cc:2272] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.748440 1173 ts_tablet_manager.cc:1916] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.748611 1175 ts_tablet_manager.cc:1916] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.752641 1171 consensus_queue.cc:260] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.755518 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet a0aae05395da4c2e9b14b6d619d7453d
I20260503 07:53:19.756482 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet a0aae05395da4c2e9b14b6d619d7453d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.756513 597 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4fa48e379ec44c65b934bd27193a5a43" } modify_external_catalogs: true
I20260503 07:53:19.756659 597 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4fa48e379ec44c65b934bd27193a5a43" } modify_external_catalogs: true
I20260503 07:53:19.756708 885 tablet_service.cc:1558] Processing DeleteTablet for tablet a0aae05395da4c2e9b14b6d619d7453d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.756831 1171 ts_tablet_manager.cc:1434] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260503 07:53:19.757164 1171 tablet_bootstrap.cc:492] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.758633 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_20770d6cc8c7480c97d762c6d7a087f4" } modify_external_catalogs: true
I20260503 07:53:19.758762 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_20770d6cc8c7480c97d762c6d7a087f4" } modify_external_catalogs: true
I20260503 07:53:19.762076 601 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d56d24b86ed40dabc8b571be0ebe051" } modify_external_catalogs: true
I20260503 07:53:19.762774 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 6649b63c3d6242dabd3f431f0286e85e from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:19.760247 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_014c7be2e3314cbd9bd3ca3d74c74621" } modify_external_catalogs: true
I20260503 07:53:19.763840 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_014c7be2e3314cbd9bd3ca3d74c74621" } modify_external_catalogs: true
I20260503 07:53:19.764242 601 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_7d56d24b86ed40dabc8b571be0ebe051" } modify_external_catalogs: true
I20260503 07:53:19.764559 1171 tablet_bootstrap.cc:654] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.771574 3149 raft_consensus.cc:493] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:19.771734 3149 raft_consensus.cc:515] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.780194 1171 tablet_bootstrap.cc:492] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.780324 1171 ts_tablet_manager.cc:1403] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20260503 07:53:19.781770 1173 ts_tablet_manager.cc:1929] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:19.782081 1175 ts_tablet_manager.cc:1929] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.782629 3149 leader_election.cc:290] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:19.783839 854 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 314f539af5e44f048ff42619fcda1943
I20260503 07:53:19.784186 1175 log.cc:1199] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/b5f31f37e97345bb9187865e38ee1d61
I20260503 07:53:19.784896 1175 ts_tablet_manager.cc:1950] T b5f31f37e97345bb9187865e38ee1d61 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.783039 1171 raft_consensus.cc:359] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.786643 1171 raft_consensus.cc:385] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.786736 1171 raft_consensus.cc:740] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.786763 1173 log.cc:1199] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/efbf07a603be411895839aece99fa78c
I20260503 07:53:19.787082 1171 consensus_queue.cc:260] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.787197 1173 ts_tablet_manager.cc:1950] T efbf07a603be411895839aece99fa78c P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:19.788244 1171 ts_tablet_manager.cc:1434] T 336e5470149f41819b25e1f774cc7229 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260503 07:53:19.788491 1171 tablet_bootstrap.cc:492] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.788954 598 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 6649b63c3d6242dabd3f431f0286e85e
I20260503 07:53:19.789166 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 930) took 10591 ms. Trace:
I20260503 07:53:19.789722 598 catalog_manager.cc:6741] ReplaceTablet: tablet 6649b63c3d6242dabd3f431f0286e85e deleted and replaced by tablet 8a52baca7a6e4238b4092d2e44e0dae8
I20260503 07:53:19.789772 1171 tablet_bootstrap.cc:654] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.789908 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6649b63c3d6242dabd3f431f0286e85e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a52baca7a6e4238b4092d2e44e0dae8) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.789935 598 master_service.cc:954] ReplaceTablet: received request to replace tablet 18523493ee4841cb8949826239e2e458 from {username='slave'} at 127.0.0.1:44308
I20260503 07:53:19.790266 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 5cc695ff556240299788c02f416410c2
I20260503 07:53:19.789518 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 6649b63c3d6242dabd3f431f0286e85e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a52baca7a6e4238b4092d2e44e0dae8) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.791203 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cc695ff556240299788c02f416410c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.791253 597 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 468a420c2a87466398cad5dfd959b3be
I20260503 07:53:19.791472 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cc695ff556240299788c02f416410c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.786449 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1285) took 5666 ms. Trace:
I20260503 07:53:19.791865 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 468a420c2a87466398cad5dfd959b3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.791911 1175 rpcz_store.cc:276] 0503 07:53:14.119714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.124305 (+ 4591us) service_pool.cc:224] Handling call
0503 07:53:19.746722 (+5622417us) ts_tablet_manager.cc:1151] Deleting tablet b5f31f37e97345bb9187865e38ee1d61
0503 07:53:19.746731 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.751532 (+ 4801us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.782026 (+ 30494us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.786434 (+ 4408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5622154}
I20260503 07:53:19.792225 1175 tablet_replica.cc:333] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.792263 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet b5f31f37e97345bb9187865e38ee1d61 (table default.Table_c67ae44b27fa46c4b568beb02732c1eb [id=9ea7f1b5db1a43d9b63c50bf55f704bf]) successfully deleted
I20260503 07:53:19.792563 601 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 532037d672cf49afac0be969e6978589
I20260503 07:53:19.789279 1173 rpcz_store.cc:276] 0503 07:53:09.197304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.201780 (+ 4476us) service_pool.cc:224] Handling call
0503 07:53:19.736282 (+10534502us) ts_tablet_manager.cc:1151] Deleting tablet efbf07a603be411895839aece99fa78c
0503 07:53:19.736294 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.772446 (+ 36152us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.781702 (+ 9256us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.789149 (+ 7447us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10534117}
I20260503 07:53:19.792378 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 468a420c2a87466398cad5dfd959b3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.793184 1175 raft_consensus.cc:2243] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.793514 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 532037d672cf49afac0be969e6978589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:19.793973 1175 raft_consensus.cc:2272] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.793895 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 532037d672cf49afac0be969e6978589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:19.794186 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet efbf07a603be411895839aece99fa78c (table default.Table_549762b2162d47ac9e5f217fafbdf632 [id=f3ecff770eaa43189f03f040c674fb15]) successfully deleted
I20260503 07:53:19.794800 1175 ts_tablet_manager.cc:1916] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.795091 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 929) took 10600 ms. Trace:
I20260503 07:53:19.795224 1173 rpcz_store.cc:276] 0503 07:53:09.194540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.202530 (+ 7990us) service_pool.cc:224] Handling call
0503 07:53:19.794972 (+10592442us) ts_tablet_manager.cc:1151] Deleting tablet baf176bdc6d54088846ee5eaf5e61447
0503 07:53:19.794981 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.795076 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10592234}
W20260503 07:53:19.795631 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet baf176bdc6d54088846ee5eaf5e61447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baf176bdc6d54088846ee5eaf5e61447 already in progress: creating tablet
I20260503 07:53:19.795881 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 931) took 10565 ms. Trace:
I20260503 07:53:19.800220 1173 rpcz_store.cc:276] 0503 07:53:09.230235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.233502 (+ 3267us) service_pool.cc:224] Handling call
0503 07:53:19.795765 (+10562263us) ts_tablet_manager.cc:1151] Deleting tablet 91b9a724c6354a9eb17cc024c8f84669
0503 07:53:19.795777 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.795860 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10561974}
I20260503 07:53:19.804559 915 raft_consensus.cc:3060] T b4df94a7071f472c8962206d51c44429 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:19.815253 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6ece446c9a104cb990b3ee87ec70cb5c (DEFAULT_TABLE table=default.Table_39f0ef7ba18e450e8d9d7e33ef6c1fa7 [id=81a6e27155fe407c8639db57efd7d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.816355 741 tablet_service.cc:1511] Processing CreateTablet for tablet 195c65abee2f462fa809d4501026743b (DEFAULT_TABLE table=default.Table_a19960d97e854ff890d7dc2083f0503d [id=dca2683e8145491b974772c5d4ef4d6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.816548 751 tablet_service.cc:1511] Processing CreateTablet for tablet fa3459a8ed6445a0b5ee4c2848941972 (DEFAULT_TABLE table=default.Table_ebb0f12d94334be3a5029fb75213499d [id=c03ff53d25f84cfea3e68289cc6d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.817909 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece446c9a104cb990b3ee87ec70cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.818233 715 leader_election.cc:400] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) with higher term. Message: Invalid argument: T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a924c2134c54fa0bb164825da53bdd0 for earlier term 2. Current term is 3.
I20260503 07:53:19.818322 758 tablet_service.cc:1511] Processing CreateTablet for tablet a40f2c0631b7437b86fa58f5f5f81fcc (DEFAULT_TABLE table=default.Table_840c32ea51014f56a1ccff214018c934 [id=61ffa09a639c45cbaac1b5f0e8169fea]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:19.818444 3196 log.cc:927] Time spent T c5a6b2fbf1ea4a109a63f0b3d224434a P 4a924c2134c54fa0bb164825da53bdd0: Append to log took a long time: real 0.183s user 0.000s sys 0.000s
I20260503 07:53:19.819078 743 tablet_service.cc:1558] Processing DeleteTablet for tablet a0aae05395da4c2e9b14b6d619d7453d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.819154 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 6649b63c3d6242dabd3f431f0286e85e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a52baca7a6e4238b4092d2e44e0dae8) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.819427 1174 ts_tablet_manager.cc:1929] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.819805 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195c65abee2f462fa809d4501026743b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.820093 715 leader_election.cc:403] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:53:19.820392 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40f2c0631b7437b86fa58f5f5f81fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.823827 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet 7336c1df59754cd58c0c290b84fc0d7a (table default.Table_d8ce6874d4994d94a17c0514a7528886 [id=6c1e82bcfdc24844a1061e916c0ecca6]) successfully deleted
I20260503 07:53:19.824877 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3459a8ed6445a0b5ee4c2848941972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.824925 1174 log.cc:1199] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/df60413555764bcab464b18c6a3370ce
I20260503 07:53:19.824968 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 532037d672cf49afac0be969e6978589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.827714 748 tablet_service.cc:1511] Processing CreateTablet for tablet 924f451ee1474ca780513daf665ffefb (DEFAULT_TABLE table=default.Table_948a8afda7584de9ba7005c1e0cfe63c [id=7031893da64144a6b936e964963bf83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:19.829969 1175 ts_tablet_manager.cc:1929] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.832355 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 468a420c2a87466398cad5dfd959b3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:19.833251 2912 raft_consensus.cc:3060] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:53:19.833300 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 932) took 10486 ms. Trace:
I20260503 07:53:19.833263 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cc695ff556240299788c02f416410c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:19.833463 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 72917.5us
I20260503 07:53:19.833384 1173 rpcz_store.cc:276] 0503 07:53:09.346791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.348329 (+ 1538us) service_pool.cc:224] Handling call
0503 07:53:19.800704 (+10452375us) ts_tablet_manager.cc:1151] Deleting tablet fe059e59c2b24ead87ef36e5b7cac5bf
0503 07:53:19.833144 (+ 32440us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.833277 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10425701}
W20260503 07:53:19.834089 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet fe059e59c2b24ead87ef36e5b7cac5bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe059e59c2b24ead87ef36e5b7cac5bf already in progress: creating tablet
I20260503 07:53:19.835811 1175 log.cc:1199] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/d7e4ba72b51a4343be56d56f93693939
I20260503 07:53:19.835368 2987 raft_consensus.cc:493] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.835995 2987 raft_consensus.cc:515] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.836616 2987 leader_election.cc:290] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:19.830610 1171 tablet_bootstrap.cc:492] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.836971 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05134e2081544b5fb7694d63265b047b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:19.837180 1171 ts_tablet_manager.cc:1403] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.002s
W20260503 07:53:19.837487 988 leader_election.cc:343] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.837895 1171 raft_consensus.cc:359] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.838058 1171 raft_consensus.cc:385] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.838127 1171 raft_consensus.cc:740] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.838317 1171 consensus_queue.cc:260] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.838863 1175 ts_tablet_manager.cc:1950] T d7e4ba72b51a4343be56d56f93693939 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.839388 1171 ts_tablet_manager.cc:1434] T 0422b379bbf34a8e8773541f2336f477 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260503 07:53:19.841588 851 leader_election.cc:343] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 314f539af5e44f048ff42619fcda1943
I20260503 07:53:19.841697 851 leader_election.cc:304] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.842182 3149 raft_consensus.cc:2749] T 314f539af5e44f048ff42619fcda1943 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:19.842856 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6772fe0377b249be9e247ec93cf50719" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.843132 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f451ee1474ca780513daf665ffefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:19.846190 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05134e2081544b5fb7694d63265b047b" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.852329 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 934) took 10348 ms. Trace:
I20260503 07:53:19.852507 1173 rpcz_store.cc:276] 0503 07:53:09.504049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.505040 (+ 991us) service_pool.cc:224] Handling call
0503 07:53:19.834106 (+10329066us) ts_tablet_manager.cc:1151] Deleting tablet c7a7ad2250a3414aa5167d54c2c90941
0503 07:53:19.852206 (+ 18100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.852308 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10328872}
I20260503 07:53:19.853035 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 933) took 10371 ms. Trace:
I20260503 07:53:19.853165 1173 rpcz_store.cc:276] 0503 07:53:09.481602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:09.481721 (+ 119us) service_pool.cc:224] Handling call
0503 07:53:19.852943 (+10371222us) ts_tablet_manager.cc:1151] Deleting tablet f2de368e66424e4d9edf7c840ac8071e
0503 07:53:19.852952 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.853022 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10346324}
I20260503 07:53:19.853561 1173 tablet_replica.cc:333] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
W20260503 07:53:19.853688 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c7a7ad2250a3414aa5167d54c2c90941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7a7ad2250a3414aa5167d54c2c90941 already in progress: creating tablet
I20260503 07:53:19.853788 1173 raft_consensus.cc:2243] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.853924 1173 raft_consensus.cc:2272] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260503 07:53:19.853924 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet f2de368e66424e4d9edf7c840ac8071e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2de368e66424e4d9edf7c840ac8071e already in progress: creating tablet
I20260503 07:53:19.854532 1173 ts_tablet_manager.cc:1916] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.860216 1174 ts_tablet_manager.cc:1950] T df60413555764bcab464b18c6a3370ce P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:19.860606 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1164) took 6096 ms. Trace:
I20260503 07:53:19.861160 1174 rpcz_store.cc:276] 0503 07:53:13.764345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.764444 (+ 99us) service_pool.cc:224] Handling call
0503 07:53:19.563508 (+5799064us) ts_tablet_manager.cc:1151] Deleting tablet df60413555764bcab464b18c6a3370ce
0503 07:53:19.563521 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.631936 (+ 68415us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.817581 (+185645us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.860575 (+ 42994us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5798875}
I20260503 07:53:19.861541 1174 tablet_replica.cc:333] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:19.861756 1174 raft_consensus.cc:2243] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:19.862082 1171 tablet_bootstrap.cc:492] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.862107 1174 raft_consensus.cc:2272] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.862692 1174 ts_tablet_manager.cc:1916] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.866020 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet df60413555764bcab464b18c6a3370ce (table default.Table_b60d2b9f7ffd4d23a1c4274e4a463e7a [id=80c5584e658b4237a6580fd0d0a05a0d]) successfully deleted
I20260503 07:53:19.866236 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_bc446450c9a2416fb06853218eaac16d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.862895 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1284) took 5743 ms. Trace:
W20260503 07:53:19.866822 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc446450c9a2416fb06853218eaac16d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.866765 1166 tablet_bootstrap.cc:492] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.867769 1166 ts_tablet_manager.cc:1403] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.232s user 0.002s sys 0.002s
I20260503 07:53:19.866678 1175 rpcz_store.cc:276] 0503 07:53:14.118975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.178374 (+ 59399us) service_pool.cc:224] Handling call
0503 07:53:19.792173 (+5613799us) ts_tablet_manager.cc:1151] Deleting tablet d7e4ba72b51a4343be56d56f93693939
0503 07:53:19.792195 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.797876 (+ 5681us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.829908 (+ 32032us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.861807 (+ 31899us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5613569}
I20260503 07:53:19.868845 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1287) took 5652 ms. Trace:
I20260503 07:53:19.872315 3198 tablet.cc:1724] T c0ceddd751644d20bcbda15a462d5342 P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260503 07:53:19.872530 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet d7e4ba72b51a4343be56d56f93693939 (table default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]) successfully deleted
I20260503 07:53:19.872684 1175 rpcz_store.cc:276] 0503 07:53:14.216545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.216598 (+ 53us) service_pool.cc:224] Handling call
0503 07:53:19.868722 (+5652124us) ts_tablet_manager.cc:1151] Deleting tablet f8d3ed6f8cec419b9f581435941e6120
0503 07:53:19.868732 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.868829 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5651910}
W20260503 07:53:19.873450 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet f8d3ed6f8cec419b9f581435941e6120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8d3ed6f8cec419b9f581435941e6120 already in progress: creating tablet
I20260503 07:53:19.874504 1175 tablet_replica.cc:333] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:19.874430 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f12f841b713b48aa8797d2c8732d5074"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.874876 1175 raft_consensus.cc:2243] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260503 07:53:19.874969 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f12f841b713b48aa8797d2c8732d5074 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.875041 1175 raft_consensus.cc:2272] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.875577 1175 ts_tablet_manager.cc:1916] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.876415 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f31f75d9bd0541f7a62bcbf8be57f4d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.876796 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f31f75d9bd0541f7a62bcbf8be57f4d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.876036 1166 raft_consensus.cc:359] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.877895 1166 raft_consensus.cc:385] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.878577 1166 raft_consensus.cc:740] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.882020 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e7ee98eb4e1c43d6b75dffac36f9c655" } new_table_name: "default.Table_67210695431142bd85101b928567da2f" modify_external_catalogs: true
I20260503 07:53:19.880946 1166 consensus_queue.cc:260] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.887800 597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_87791dc0821e44beba7880b0e6a99673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.888315 1171 tablet_bootstrap.cc:654] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:19.888319 597 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87791dc0821e44beba7880b0e6a99673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:19.893306 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8e1c96c4955484c99afd98d2644b37a consensus state has no leader
I20260503 07:53:19.896863 1166 ts_tablet_manager.cc:1434] T 4de65c754b47440a914f3f2bdb86059c P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260503 07:53:19.897195 1166 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.898851 1166 tablet_bootstrap.cc:654] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.899771 2912 raft_consensus.cc:2749] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) with higher term. Message: Invalid argument: T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a924c2134c54fa0bb164825da53bdd0 for earlier term 2. Current term is 3.
I20260503 07:53:19.900295 828 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:19.912130 3149 raft_consensus.cc:493] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.912284 3149 raft_consensus.cc:515] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.912801 3149 leader_election.cc:290] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.912753 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_69cd921a9fd947eeab7249ecdfb5f4cc" } new_table_name: "default.Table_14500fa03b3a49f38cd96db4e9f43f65" modify_external_catalogs: true
I20260503 07:53:19.913331 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bb85190cd94e8282eec9a1bc0efab4" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:19.916013 1173 ts_tablet_manager.cc:1929] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:19.916136 1173 log.cc:1199] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/54bf46b34b1043e2ab6c9f8b2c871227
I20260503 07:53:19.916460 1173 ts_tablet_manager.cc:1950] T 54bf46b34b1043e2ab6c9f8b2c871227 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:19.917220 1165 tablet_bootstrap.cc:492] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:19.917198 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 935) took 9785 ms. Trace:
I20260503 07:53:19.917279 1173 rpcz_store.cc:276] 0503 07:53:10.131589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.131892 (+ 303us) service_pool.cc:224] Handling call
0503 07:53:19.853520 (+9721628us) ts_tablet_manager.cc:1151] Deleting tablet 54bf46b34b1043e2ab6c9f8b2c871227
0503 07:53:19.853528 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.858056 (+ 4528us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.915961 (+ 57905us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.917179 (+ 1218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9721460}
I20260503 07:53:19.917394 601 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_f7dde28afa9b437ea37a5c5c4ce12d6c" } new_table_name: "default.Table_86004da4b0a54439b1b066ea33a8beda" modify_external_catalogs: true
I20260503 07:53:19.917712 1173 tablet_replica.cc:333] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:19.917724 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 54bf46b34b1043e2ab6c9f8b2c871227 (table default.Table_417aebd794cf47178e1eb3faf7d6b585 [id=7f7ff8e8793f4901b3760ea87ec68d81]) successfully deleted
I20260503 07:53:19.917924 1173 raft_consensus.cc:2243] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:19.918063 1173 raft_consensus.cc:2272] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.918045 1165 ts_tablet_manager.cc:1403] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.298s user 0.015s sys 0.031s
I20260503 07:53:19.918501 1173 ts_tablet_manager.cc:1916] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:19.918778 3149 raft_consensus.cc:493] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.918875 3149 raft_consensus.cc:515] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.919258 1165 raft_consensus.cc:359] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.919358 3149 leader_election.cc:290] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:19.919487 1165 raft_consensus.cc:385] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.919602 1165 raft_consensus.cc:740] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.919917 1171 tablet_bootstrap.cc:492] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.920208 1171 ts_tablet_manager.cc:1403] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.002s
W20260503 07:53:19.920488 851 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:19.919872 1165 consensus_queue.cc:260] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.921325 1171 raft_consensus.cc:359] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.921581 1171 raft_consensus.cc:385] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.921665 1171 raft_consensus.cc:740] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.921953 1165 ts_tablet_manager.cc:1434] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260503 07:53:19.921978 1171 consensus_queue.cc:260] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.922358 1165 tablet_bootstrap.cc:492] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:19.922786 1171 ts_tablet_manager.cc:1434] T e04bceb67d194f21bab9e7aa790d5a04 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:19.923115 1174 ts_tablet_manager.cc:1929] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:19.923218 1171 tablet_bootstrap.cc:492] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.923316 1174 log.cc:1199] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-0/wal/wals/d7e4ba72b51a4343be56d56f93693939
I20260503 07:53:19.923743 1174 ts_tablet_manager.cc:1950] T d7e4ba72b51a4343be56d56f93693939 P 4a924c2134c54fa0bb164825da53bdd0: Deleting consensus metadata
I20260503 07:53:19.924059 1174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46968 (request call id 1170) took 6056 ms. Trace:
I20260503 07:53:19.930008 1174 rpcz_store.cc:276] 0503 07:53:13.867817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:13.873787 (+ 5970us) service_pool.cc:224] Handling call
0503 07:53:19.861455 (+5987668us) ts_tablet_manager.cc:1151] Deleting tablet d7e4ba72b51a4343be56d56f93693939
0503 07:53:19.861464 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.905477 (+ 44013us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.923029 (+ 17552us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.924031 (+ 1002us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5987476}
I20260503 07:53:19.930563 585 catalog_manager.cc:5002] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): tablet d7e4ba72b51a4343be56d56f93693939 (table default.Table_1b897d165d7c42a79a3da9e23142bd98 [id=55fd1c1ab5e14df08ac7e026d4eee0f0]) successfully deleted
I20260503 07:53:19.930480 1174 tablet_replica.cc:333] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: stopping tablet replica
I20260503 07:53:19.931238 1174 raft_consensus.cc:2243] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:19.932260 1166 tablet_bootstrap.cc:492] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:19.933020 1166 ts_tablet_manager.cc:1403] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
W20260503 07:53:19.934679 601 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c54e1e24a1f48788280713893df5928 consensus state has no leader
I20260503 07:53:19.935047 601 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c3ed55bfa6f04df9a0cafc1090ddd100"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.935851 601 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3ed55bfa6f04df9a0cafc1090ddd100 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.937115 1174 raft_consensus.cc:2272] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:19.937700 1174 ts_tablet_manager.cc:1916] T cf24705f7d004254bf8456c063634d65 P 4a924c2134c54fa0bb164825da53bdd0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:19.937790 716 consensus_peers.cc:597] T b5f31f37e97345bb9187865e38ee1d61 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5f31f37e97345bb9187865e38ee1d61. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:19.938201 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16aa59d4fdd94bdd82a441af4d665f2c consensus state has no leader
I20260503 07:53:19.938561 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_827e718a70bc4d6d9e9ca9b77384c312"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:19.938261 1171 tablet_bootstrap.cc:654] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.890906 3202 raft_consensus.cc:493] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.938407 1166 raft_consensus.cc:359] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.939604 3202 raft_consensus.cc:515] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.940518 2924 raft_consensus.cc:493] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.940004 1166 raft_consensus.cc:385] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.940639 2924 raft_consensus.cc:515] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.940616 1166 raft_consensus.cc:740] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.941148 2924 leader_election.cc:290] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:19.942075 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.942615 715 leader_election.cc:343] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.942270 1166 consensus_queue.cc:260] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.945338 1166 ts_tablet_manager.cc:1434] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260503 07:53:19.946700 1166 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:19.953778 1165 tablet_bootstrap.cc:654] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.953943 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:19.954169 1049 raft_consensus.cc:2468] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
W20260503 07:53:19.959028 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_827e718a70bc4d6d9e9ca9b77384c312 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:19.961423 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:42215, user_credentials={real_user=slave}} blocked reactor thread for 114633us
I20260503 07:53:19.961931 3199 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260503 07:53:19.962554 986 leader_election.cc:343] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.962705 986 leader_election.cc:304] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.963717 2987 raft_consensus.cc:2749] T 6772fe0377b249be9e247ec93cf50719 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.964843 1175 ts_tablet_manager.cc:1929] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260503 07:53:19.964951 1175 log.cc:1199] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/26da686862f44940b13c7790e00ea3b1
W20260503 07:53:19.965056 986 consensus_peers.cc:597] T 3cf72d49cfd24083abee07e0d2190e3e P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Couldn't send request to peer 4a924c2134c54fa0bb164825da53bdd0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cf72d49cfd24083abee07e0d2190e3e. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:19.965404 1175 ts_tablet_manager.cc:1950] T 26da686862f44940b13c7790e00ea3b1 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:19.966110 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1286) took 5753 ms. Trace:
I20260503 07:53:19.966187 1175 rpcz_store.cc:276] 0503 07:53:14.212387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.216929 (+ 4542us) service_pool.cc:224] Handling call
0503 07:53:19.874464 (+5657535us) ts_tablet_manager.cc:1151] Deleting tablet 26da686862f44940b13c7790e00ea3b1
0503 07:53:19.874472 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.878485 (+ 4013us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.964794 (+ 86309us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:19.966092 (+ 1298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5657328}
W20260503 07:53:19.966446 986 leader_election.cc:343] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:19.966547 986 leader_election.cc:304] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:19.966573 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet 26da686862f44940b13c7790e00ea3b1 (table default.Table_11cf25210559486dacae5baa7290ef46 [id=bfd20c8eae3a49eabc6fdf562ee6e2ff]) successfully deleted
I20260503 07:53:19.966727 2987 raft_consensus.cc:2749] T 05134e2081544b5fb7694d63265b047b P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.966944 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1290) took 5353 ms. Trace:
I20260503 07:53:19.967032 1175 rpcz_store.cc:276] 0503 07:53:14.612980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.613199 (+ 219us) service_pool.cc:224] Handling call
0503 07:53:19.966817 (+5353618us) ts_tablet_manager.cc:1151] Deleting tablet 10a29807ce9b4ccabafeb059afb9bdae
0503 07:53:19.966825 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.966911 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5353437}
W20260503 07:53:19.967427 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 10a29807ce9b4ccabafeb059afb9bdae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10a29807ce9b4ccabafeb059afb9bdae already in progress: creating tablet
I20260503 07:53:19.967800 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1293) took 5346 ms. Trace:
I20260503 07:53:19.967892 1175 rpcz_store.cc:276] 0503 07:53:14.621710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.628045 (+ 6335us) service_pool.cc:224] Handling call
0503 07:53:19.967676 (+5339631us) ts_tablet_manager.cc:1151] Deleting tablet 17db30b1109845d783ade7c4860a3d0d
0503 07:53:19.967685 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.967785 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5339411}
W20260503 07:53:19.968314 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 17db30b1109845d783ade7c4860a3d0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17db30b1109845d783ade7c4860a3d0d already in progress: creating tablet
I20260503 07:53:19.968803 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:19.969285 3079 log.cc:927] Time spent T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Append to log took a long time: real 0.061s user 0.004s sys 0.000s
I20260503 07:53:19.971065 915 raft_consensus.cc:1275] T 538ea5f9f9964fbdb8eb92e6059e2531 P 48acfab19cf04a069d5166d663adb3c3 [term 3 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:53:19.971596 2987 consensus_queue.cc:1048] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:53:19.972869 1166 tablet_bootstrap.cc:654] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.976956 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_8701f9797b364fd3a6fecb9bac34c93d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:19.977522 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8701f9797b364fd3a6fecb9bac34c93d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:19.983639 1171 tablet_bootstrap.cc:492] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:19.983770 1171 ts_tablet_manager.cc:1403] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.000s
I20260503 07:53:19.984342 3120 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 48acfab19cf04a069d5166d663adb3c3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:19.984479 1171 raft_consensus.cc:359] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.984606 1171 raft_consensus.cc:385] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:19.984553 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d63d756541b94a5a8994322c8200a4e9" } modify_external_catalogs: true
I20260503 07:53:19.984651 1171 raft_consensus.cc:740] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:19.984679 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d63d756541b94a5a8994322c8200a4e9" } modify_external_catalogs: true
I20260503 07:53:19.985152 1171 consensus_queue.cc:260] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:19.985638 1171 ts_tablet_manager.cc:1434] T 7cca44c2622e4f9493d71e59fc3056ae P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260503 07:53:19.988371 1171 tablet_bootstrap.cc:492] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:19.991030 1171 tablet_bootstrap.cc:654] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:19.999066 3211 raft_consensus.cc:493] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:19.999200 3211 raft_consensus.cc:515] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:19.999879 3211 leader_election.cc:290] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:20.000980 600 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet dd799f51afc54c968c2dcc96f0862579
I20260503 07:53:20.001554 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_68406bd365a8436db1ba7c29c23aa199" } new_table_name: "default.Table_07a7b17096f94a9d87485686d58e0533" modify_external_catalogs: true
I20260503 07:53:20.003931 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e5486a610142e0af6406d328ece5e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:20.004453 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1295) took 5363 ms. Trace:
I20260503 07:53:20.004555 1175 rpcz_store.cc:276] 0503 07:53:14.642720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.643610 (+ 890us) service_pool.cc:224] Handling call
0503 07:53:20.004287 (+5360677us) ts_tablet_manager.cc:1151] Deleting tablet 1df4fefd52434b118e1ed016d5d629bb
0503 07:53:20.004310 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.004432 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5360322}
W20260503 07:53:20.004933 988 leader_election.cc:343] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.005221 588 catalog_manager.cc:4982] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): delete failed for tablet 1df4fefd52434b118e1ed016d5d629bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df4fefd52434b118e1ed016d5d629bb already in progress: creating tablet
I20260503 07:53:20.005664 1175 tablet_replica.cc:333] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:20.005939 1175 raft_consensus.cc:2243] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:20.006425 1175 raft_consensus.cc:2272] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:20.007045 1175 ts_tablet_manager.cc:1916] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260503 07:53:20.023312 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25e59c5111f0465d856344b0a18e5756 consensus state has no leader
I20260503 07:53:20.023707 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_fba3543d8bd846ac9b426631ed3bfb0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.024246 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fba3543d8bd846ac9b426631ed3bfb0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:20.024437 854 leader_election.cc:343] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: b8bb85190cd94e8282eec9a1bc0efab4
I20260503 07:53:20.024574 854 leader_election.cc:304] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
W20260503 07:53:20.024971 854 leader_election.cc:343] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 057b62a991b74c859045a74df7dc716f
I20260503 07:53:20.025064 854 leader_election.cc:304] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.025475 3070 raft_consensus.cc:2749] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.025617 3070 raft_consensus.cc:2749] T 057b62a991b74c859045a74df7dc716f P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:19.954600 716 leader_election.cc:304] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:20.027112 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:40179, user_credentials={real_user=slave}} blocked reactor thread for 72536.1us
I20260503 07:53:20.027616 2924 raft_consensus.cc:2804] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:20.027690 2924 raft_consensus.cc:493] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:53:19.969255 715 leader_election.cc:343] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.027777 2924 raft_consensus.cc:3060] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:20.027860 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 58618.8us
I20260503 07:53:19.969403 3202 leader_election.cc:290] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.029443 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:20.029608 1050 raft_consensus.cc:2468] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:19.998873 3198 tablet.cc:1724] T 399acb90cf124fcf8a75bf936e3e426f P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260503 07:53:20.012485 774 raft_consensus.cc:1275] T 538ea5f9f9964fbdb8eb92e6059e2531 P 4a924c2134c54fa0bb164825da53bdd0 [term 3 FOLLOWER]: Refusing update from remote peer 0c11eb9ffa7845269a6a8000e8ff248f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:53:20.024356 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e5486a610142e0af6406d328ece5e5" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:20.030301 2924 raft_consensus.cc:515] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.030809 2924 leader_election.cc:290] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.032837 3149 raft_consensus.cc:493] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.032956 3149 raft_consensus.cc:515] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.033530 3149 leader_election.cc:290] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:20.034220 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_18f017d5ee284fa0b99f416128c0b30e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.034683 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18f017d5ee284fa0b99f416128c0b30e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.035048 965 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:20.035257 716 leader_election.cc:304] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:20.035678 716 consensus_peers.cc:597] T f522dc5e8b12409eb9ed1a763d0db741 P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f522dc5e8b12409eb9ed1a763d0db741. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:20.035781 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:20.036350 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:20.036522 1048 raft_consensus.cc:3060] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.038969 1048 raft_consensus.cc:2468] T fa97597fa7a1435995f13e189db1f3fa P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:20.040904 1173 ts_tablet_manager.cc:1929] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260503 07:53:20.041042 1173 log.cc:1199] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/cc7a0272fdc34044af78ba21b6ca31bc
I20260503 07:53:20.041188 2924 raft_consensus.cc:2804] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:20.041256 2924 raft_consensus.cc:493] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:20.041365 2924 raft_consensus.cc:3060] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.042213 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4ec84885bf494620b7b7cf94b7346303"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.042666 986 leader_election.cc:343] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.043030 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ec84885bf494620b7b7cf94b7346303 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.043313 986 leader_election.cc:304] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.043979 2987 raft_consensus.cc:2749] T 52e5486a610142e0af6406d328ece5e5 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.044679 2924 raft_consensus.cc:515] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.045264 2924 leader_election.cc:290] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.045564 2987 consensus_queue.cc:1048] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:53:20.045635 2912 raft_consensus.cc:493] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.045755 2912 raft_consensus.cc:515] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.046307 2912 leader_election.cc:290] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.046715 906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:20.047767 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef666aa007504682bc044cbd0b56060d" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:20.048764 716 leader_election.cc:304] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:20.049057 1173 ts_tablet_manager.cc:1950] T cc7a0272fdc34044af78ba21b6ca31bc P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:20.049073 2912 raft_consensus.cc:2804] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:20.049187 2912 raft_consensus.cc:697] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:20.049436 2912 consensus_queue.cc:237] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.050729 600 master_service.cc:954] ReplaceTablet: received request to replace tablet d41561b867914a1aabe5f015176d54c7 from {username='slave'} at 127.0.0.1:44308
W20260503 07:53:20.048760 715 leader_election.cc:343] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.051261 715 leader_election.cc:343] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.053418 716 leader_election.cc:343] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: ef666aa007504682bc044cbd0b56060d
I20260503 07:53:20.053510 716 leader_election.cc:304] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a924c2134c54fa0bb164825da53bdd0; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:20.053893 3202 consensus_queue.cc:1048] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:53:20.054219 3202 raft_consensus.cc:2749] T ef666aa007504682bc044cbd0b56060d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.056591 1165 tablet_bootstrap.cc:492] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:20.058027 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5776840523f54e6bb18d674815d3b447" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:20.058216 1048 raft_consensus.cc:3060] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.058962 1171 tablet_bootstrap.cc:492] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:20.059178 1171 ts_tablet_manager.cc:1403] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260503 07:53:20.059867 1171 raft_consensus.cc:359] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.060151 1171 raft_consensus.cc:385] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.060227 1100 heartbeater.cc:344] Connected to a master server at 127.0.105.61:41759
I20260503 07:53:20.060355 1171 raft_consensus.cc:740] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.060657 1171 consensus_queue.cc:260] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.062404 917 raft_consensus.cc:3060] T fc130dcd067f43f08748360a692eb048 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:20.067248 3079 log.cc:927] Time spent T 00000000000000000000000000000000 P cd4eda3aaddc4d46a7e8b24b782a7e5c: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
I20260503 07:53:20.068708 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 937) took 9936 ms. Trace:
I20260503 07:53:20.068954 1173 rpcz_store.cc:276] 0503 07:53:10.131766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.132614 (+ 848us) service_pool.cc:224] Handling call
0503 07:53:19.917671 (+9785057us) ts_tablet_manager.cc:1151] Deleting tablet cc7a0272fdc34044af78ba21b6ca31bc
0503 07:53:19.917680 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:19.982504 (+ 64824us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.040857 (+ 58353us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.068686 (+ 27829us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9784931}
I20260503 07:53:20.069614 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet cc7a0272fdc34044af78ba21b6ca31bc (table default.Table_003d62e0eb9b4711b3ac9683b00fd194 [id=7a595153294c4f79a8984bb23c8a1d72]) successfully deleted
I20260503 07:53:20.077225 1173 tablet_replica.cc:333] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:20.077540 1173 raft_consensus.cc:2243] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:53:20.069916 1048 raft_consensus.cc:2468] T 5776840523f54e6bb18d674815d3b447 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:20.077968 1173 pending_rounds.cc:70] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Trying to abort 1 pending ops.
I20260503 07:53:20.075798 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b547a24cfa4478a90d3035a59a3381" candidate_uuid: "48acfab19cf04a069d5166d663adb3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:20.078115 1173 pending_rounds.cc:77] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281847456224768000 op_type: NO_OP noop_request { }
I20260503 07:53:20.078244 1173 raft_consensus.cc:2889] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:53:20.078413 1173 raft_consensus.cc:2272] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:20.079064 1173 ts_tablet_manager.cc:1916] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:20.079222 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa97597fa7a1435995f13e189db1f3fa" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
I20260503 07:53:20.069281 3175 raft_consensus.cc:493] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.078554 716 leader_election.cc:304] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:20.083220 3175 raft_consensus.cc:515] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.083784 3175 leader_election.cc:290] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.083911 3175 raft_consensus.cc:2804] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:20.084025 3175 raft_consensus.cc:697] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:20.084229 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:20.084275 3175 consensus_queue.cc:237] T 5776840523f54e6bb18d674815d3b447 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.085175 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:20.085352 1048 raft_consensus.cc:2468] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:20.086416 716 leader_election.cc:304] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:20.087363 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 0708cababc844e51ab7da2950664c2c5
I20260503 07:53:20.087432 2924 raft_consensus.cc:2804] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:20.087550 2924 raft_consensus.cc:493] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:20.087639 2924 raft_consensus.cc:3060] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.088023 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bec8690e29ea4e8382846d3c96263603" } modify_external_catalogs: true
I20260503 07:53:20.088514 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 0708cababc844e51ab7da2950664c2c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.088532 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 0708cababc844e51ab7da2950664c2c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.088917 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0708cababc844e51ab7da2950664c2c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:19 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.088963 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_bec8690e29ea4e8382846d3c96263603" } modify_external_catalogs: true
I20260503 07:53:20.089576 1171 ts_tablet_manager.cc:1434] T 6de27712304a49a9aaaeaff474e61f08 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
I20260503 07:53:20.089908 1171 tablet_bootstrap.cc:492] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:20.087471 1165 ts_tablet_manager.cc:1403] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.165s user 0.002s sys 0.002s
I20260503 07:53:20.091215 1165 raft_consensus.cc:359] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.091374 1165 raft_consensus.cc:385] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.091425 1165 raft_consensus.cc:740] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.092110 854 leader_election.cc:304] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.092514 3149 raft_consensus.cc:2749] T 17b547a24cfa4478a90d3035a59a3381 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.094158 2924 raft_consensus.cc:515] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:20.097896 715 leader_election.cc:343] T fa97597fa7a1435995f13e189db1f3fa P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.098239 715 leader_election.cc:343] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.098994 1171 tablet_bootstrap.cc:654] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:20.099177 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 9ebe35052c634a8baa45fe333d46baf7
I20260503 07:53:20.099743 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.100008 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.100147 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb390da88f1447448a900b2aa205b223" } modify_external_catalogs: true
I20260503 07:53:20.100505 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ebe35052c634a8baa45fe333d46baf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.100675 1175 ts_tablet_manager.cc:1929] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260503 07:53:20.100780 1175 log.cc:1199] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-2/wal/wals/af0c0f5999ee4b9cae56cbb3695de12f
I20260503 07:53:20.100303 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_eb390da88f1447448a900b2aa205b223" } modify_external_catalogs: true
I20260503 07:53:20.102111 1166 tablet_bootstrap.cc:492] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:20.102249 1166 ts_tablet_manager.cc:1403] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.156s user 0.005s sys 0.001s
I20260503 07:53:20.102926 1166 raft_consensus.cc:359] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.103098 1166 raft_consensus.cc:385] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.103163 1166 raft_consensus.cc:740] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.103363 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:20.103976 715 leader_election.cc:343] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.106271 1165 consensus_queue.cc:260] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.106876 1165 ts_tablet_manager.cc:1434] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260503 07:53:20.107211 1165 tablet_bootstrap.cc:492] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0: Bootstrap starting.
I20260503 07:53:20.108769 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet 8d0487d02934453fbb25104f3b8fe732
I20260503 07:53:20.108912 1165 tablet_bootstrap.cc:654] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:20.109473 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d0487d02934453fbb25104f3b8fe732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.109540 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_641a845999b54069807be5903205cfcd" } modify_external_catalogs: true
I20260503 07:53:20.109614 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d0487d02934453fbb25104f3b8fe732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.109679 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_641a845999b54069807be5903205cfcd" } modify_external_catalogs: true
I20260503 07:53:20.109820 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d0487d02934453fbb25104f3b8fe732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.112691 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff4e3f16c1413c858ed955c77497c9" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:20.112914 1048 raft_consensus.cc:3060] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.112514 2924 leader_election.cc:290] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.115944 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:20.116999 1048 raft_consensus.cc:2468] T 23ff4e3f16c1413c858ed955c77497c9 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:20.119118 716 leader_election.cc:304] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:20.121840 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
W20260503 07:53:20.122432 988 consensus_peers.cc:597] T 4bb8d47da511422d9665326520d35601 P 0c11eb9ffa7845269a6a8000e8ff248f -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260503 07:53:20.122975 600 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet d41561b867914a1aabe5f015176d54c7
I20260503 07:53:20.123214 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:20.123332 600 catalog_manager.cc:6741] ReplaceTablet: tablet d41561b867914a1aabe5f015176d54c7 deleted and replaced by tablet bd14a1fd271a41d79ab616c1a0a056cd
I20260503 07:53:20.123348 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet e1c68ca20b1548d99a5956c20b194964 (table default.Table_7962d29839a24f099242e1ca51bcb7b1 [id=3bf0d22137ba4a6191166b11d603c6dc]). Expected version 2 got 0
I20260503 07:53:20.123633 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_74452d866a074cfb9419d59209546e49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:20.123729 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet c0ceddd751644d20bcbda15a462d5342 (table default.Table_f753dec874b841f18bf08be5433c6402 [id=36a30c4e7a864127b873fc19a9b9cfd5]). Expected version 1 got 0
I20260503 07:53:20.123919 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 4ab0752eb4fa49a48cf521f9a072689a (table default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21]). Expected version 3 got 0
W20260503 07:53:20.124089 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74452d866a074cfb9419d59209546e49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.124541 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d41561b867914a1aabe5f015176d54c7 with delete_type TABLET_DATA_DELETED (replaced by tablet bd14a1fd271a41d79ab616c1a0a056cd) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.125368 886 tablet_service.cc:1558] Processing DeleteTablet for tablet d41561b867914a1aabe5f015176d54c7 with delete_type TABLET_DATA_DELETED (replaced by tablet bd14a1fd271a41d79ab616c1a0a056cd) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.125743 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet d41561b867914a1aabe5f015176d54c7 with delete_type TABLET_DATA_DELETED (replaced by tablet bd14a1fd271a41d79ab616c1a0a056cd) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.124115 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet a7907a9cceaa443795275c9cbb62cb22 (table default.Table_e4ae69024f594a199dc5ccabcf7cdddb [id=040b2bdef1584c959f5b5f1f2eaa8429]). Expected version 1 got 0
I20260503 07:53:20.127063 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1799fea5a17f4a1cbbcd955d3813167c (table default.Table_95667d645ba543c795df2da82c455756 [id=b74130814629460882428c661bc22952]). Expected version 1 got 0
I20260503 07:53:20.128364 1166 consensus_queue.cc:260] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.129019 1166 ts_tablet_manager.cc:1434] T b269ee59036d4c2f866b6b2bf45c35cf P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260503 07:53:20.129298 1166 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:20.131219 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c470c4991ab84345acd1fa52cc2b1763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.131795 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c470c4991ab84345acd1fa52cc2b1763 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.132730 594 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]). Expected version 3 got 0
I20260503 07:53:20.132845 1173 ts_tablet_manager.cc:1929] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:20.133873 1173 log.cc:1199] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/9e162006cee34182b51f97629a174509
I20260503 07:53:20.134564 1173 ts_tablet_manager.cc:1950] T 9e162006cee34182b51f97629a174509 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:20.135200 2912 raft_consensus.cc:2804] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:20.135972 2912 raft_consensus.cc:697] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:20.135046 596 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: Sending DeleteTablet for 3 replicas of tablet ca703988c5a04a298b21a48b62bb6779
I20260503 07:53:20.139925 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet ca703988c5a04a298b21a48b62bb6779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.140538 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_21c7a07f359c40da89a6c8624d48ef7a" } new_table_name: "default.Table_0bf4290f26c74e548700daf1b9356bbc" modify_external_catalogs: true
I20260503 07:53:20.140844 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:20.141187 601 catalog_manager.cc:5671] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "4a924c2134c54fa0bb164825da53bdd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260503 07:53:20.141436 1171 tablet_bootstrap.cc:492] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:20.141571 1171 ts_tablet_manager.cc:1403] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.002s
I20260503 07:53:20.141711 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet 1799fea5a17f4a1cbbcd955d3813167c (table default.Table_95667d645ba543c795df2da82c455756 [id=b74130814629460882428c661bc22952]). Expected version 1 got 0
I20260503 07:53:20.142215 1171 raft_consensus.cc:359] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.142289 601 catalog_manager.cc:5763] TS 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:20.142367 1171 raft_consensus.cc:385] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.142416 1171 raft_consensus.cc:740] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.142270 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_ef89860a17bc4d72ba61df537dca1e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.143663 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef89860a17bc4d72ba61df537dca1e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:20.148352 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87ab024dd97c48e5a290c7fa64b4891c consensus state has no leader
I20260503 07:53:20.154547 3202 raft_consensus.cc:493] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.154776 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_7bdf48cd6a32442da6681fd6cfee1265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.155228 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bdf48cd6a32442da6681fd6cfee1265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.159261 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:20.160282 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet e1c68ca20b1548d99a5956c20b194964 (table default.Table_7962d29839a24f099242e1ca51bcb7b1 [id=3bf0d22137ba4a6191166b11d603c6dc]). Expected version 2 got 0
I20260503 07:53:20.159390 1171 consensus_queue.cc:260] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.160774 2916 raft_consensus.cc:493] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.160881 2916 raft_consensus.cc:515] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.161413 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet a7907a9cceaa443795275c9cbb62cb22 (table default.Table_e4ae69024f594a199dc5ccabcf7cdddb [id=040b2bdef1584c959f5b5f1f2eaa8429]). Expected version 1 got 0
I20260503 07:53:20.161659 2916 leader_election.cc:290] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215)
I20260503 07:53:20.164460 1171 ts_tablet_manager.cc:1434] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20260503 07:53:20.165045 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 031f91b3b3ca4bca856d3c3ee99e9e3a (table default.Table_15dd029cb53247c6811a9dd3788b7b68 [id=fcaa462aa73a43eb843bca8d01848c05]). Expected version 2 got 0
I20260503 07:53:20.165370 598 catalog_manager.cc:5671] T 538ea5f9f9964fbdb8eb92e6059e2531 P 0c11eb9ffa7845269a6a8000e8ff248f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260503 07:53:20.166155 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:20.166700 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet d08b5135cb77444bb5ff35c5f9d68129 (table default.Table_16e24ea564f14a3681373d5a30b276be [id=fb0d1da177a747329c3e8ad69aaf88d5]). Expected version 3 got 0
I20260503 07:53:20.138953 886 tablet_service.cc:1558] Processing DeleteTablet for tablet ca703988c5a04a298b21a48b62bb6779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.170486 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 938) took 10038 ms. Trace:
I20260503 07:53:20.170599 1173 rpcz_store.cc:276] 0503 07:53:10.131849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.132761 (+ 912us) service_pool.cc:224] Handling call
0503 07:53:20.069510 (+9936749us) ts_tablet_manager.cc:1151] Deleting tablet 9e162006cee34182b51f97629a174509
0503 07:53:20.077154 (+ 7644us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.129765 (+ 52611us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.132799 (+ 3034us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.170467 (+ 37668us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9936655}
I20260503 07:53:20.171021 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 9e162006cee34182b51f97629a174509 (table default.Table_17f168c46dea4d82a0beacb34d4387a1 [id=19a3a0124a32452e9577d75e6ba7bc97]) successfully deleted
I20260503 07:53:20.171327 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 939) took 10007 ms. Trace:
I20260503 07:53:20.171401 1173 rpcz_store.cc:276] 0503 07:53:10.163962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.164007 (+ 45us) service_pool.cc:224] Handling call
0503 07:53:20.170924 (+10006917us) ts_tablet_manager.cc:1151] Deleting tablet 2beb13a5d2844d44a3146d7937c8e964
0503 07:53:20.170934 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.171310 (+ 376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10006769}
I20260503 07:53:20.171692 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 941) took 10000 ms. Trace:
I20260503 07:53:20.171763 1173 rpcz_store.cc:276] 0503 07:53:10.171451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.171496 (+ 45us) service_pool.cc:224] Handling call
0503 07:53:20.171605 (+10000109us) ts_tablet_manager.cc:1151] Deleting tablet 0f707cb0257c4d6182ec331a235ba06c
0503 07:53:20.171614 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.171679 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9999975}
W20260503 07:53:20.171816 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 2beb13a5d2844d44a3146d7937c8e964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2beb13a5d2844d44a3146d7937c8e964 already in progress: creating tablet
I20260503 07:53:20.172058 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 948) took 9833 ms. Trace:
I20260503 07:53:20.172129 1173 rpcz_store.cc:276] 0503 07:53:10.338123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.338169 (+ 46us) service_pool.cc:224] Handling call
0503 07:53:20.171964 (+9833795us) ts_tablet_manager.cc:1151] Deleting tablet 57261ae6531348d7bdd8deb5dfd980b4
0503 07:53:20.171971 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.172034 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9833599}
I20260503 07:53:20.170480 596 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_456974f93b2c49cd8e91e745926dc00d" } new_table_name: "default.Table_2ea55750a4c340c19dab664e3b508426" modify_external_catalogs: true
W20260503 07:53:20.172802 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 0f707cb0257c4d6182ec331a235ba06c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f707cb0257c4d6182ec331a235ba06c already in progress: creating tablet
W20260503 07:53:20.173009 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 57261ae6531348d7bdd8deb5dfd980b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57261ae6531348d7bdd8deb5dfd980b4 already in progress: creating tablet
I20260503 07:53:20.173260 600 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_9d5d2666362f435690d584889f448008" } new_table_name: "default.Table_aa8e4c662fa149e9bb2278ac2d7a2aa6" modify_external_catalogs: true
I20260503 07:53:20.174324 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 949) took 9836 ms. Trace:
I20260503 07:53:20.174398 1173 rpcz_store.cc:276] 0503 07:53:10.338258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.338647 (+ 389us) service_pool.cc:224] Handling call
0503 07:53:20.172327 (+9833680us) ts_tablet_manager.cc:1151] Deleting tablet b38735fd577548b192131a769daa1d78
0503 07:53:20.172335 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.174307 (+ 1972us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9833511}
I20260503 07:53:20.174705 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 950) took 9758 ms. Trace:
W20260503 07:53:20.174805 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet b38735fd577548b192131a769daa1d78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38735fd577548b192131a769daa1d78 already in progress: creating tablet
I20260503 07:53:20.174774 1173 rpcz_store.cc:276] 0503 07:53:10.415776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.415854 (+ 78us) service_pool.cc:224] Handling call
0503 07:53:20.174613 (+9758759us) ts_tablet_manager.cc:1151] Deleting tablet 8dbca27f54064345b374b0cea96ca1c4
0503 07:53:20.174621 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.174689 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9758511}
I20260503 07:53:20.175081 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 951) took 9682 ms. Trace:
W20260503 07:53:20.175101 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet 8dbca27f54064345b374b0cea96ca1c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dbca27f54064345b374b0cea96ca1c4 already in progress: creating tablet
I20260503 07:53:20.175144 1173 rpcz_store.cc:276] 0503 07:53:10.492855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.493186 (+ 331us) service_pool.cc:224] Handling call
0503 07:53:20.174983 (+9681797us) ts_tablet_manager.cc:1151] Deleting tablet c5a592a14c3e4659ba81754cbe62c438
0503 07:53:20.174990 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.175067 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9681450}
I20260503 07:53:20.175426 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 952) took 9609 ms. Trace:
W20260503 07:53:20.175453 587 catalog_manager.cc:4982] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): delete failed for tablet c5a592a14c3e4659ba81754cbe62c438 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5a592a14c3e4659ba81754cbe62c438 already in progress: creating tablet
I20260503 07:53:20.175498 1173 rpcz_store.cc:276] 0503 07:53:10.566446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.566586 (+ 140us) service_pool.cc:224] Handling call
0503 07:53:20.175342 (+9608756us) ts_tablet_manager.cc:1151] Deleting tablet 6720679e01e44baaa1501c8dbadba08a
0503 07:53:20.175351 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.175413 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9608436}
I20260503 07:53:20.175707 1173 tablet_replica.cc:333] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: stopping tablet replica
I20260503 07:53:20.175863 1173 raft_consensus.cc:2243] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:20.175982 1173 raft_consensus.cc:2272] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:20.176524 1173 ts_tablet_manager.cc:1916] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:20.179601 2912 consensus_queue.cc:237] T 23ff4e3f16c1413c858ed955c77497c9 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.148563 1166 tablet_bootstrap.cc:654] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:20.162537 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d79df088f24420b99a9c984f9700e80" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:20.183189 988 leader_election.cc:343] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.183822 886 tablet_service.cc:1511] Processing CreateTablet for tablet c7a871add8f84b4284ab0d5496c5ac7e (DEFAULT_TABLE table=default.Table_6922f158ac92435ab1c25a7b930591be [id=060ccba0331c463a93173fbf772f2f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.184228 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a871add8f84b4284ab0d5496c5ac7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.184450 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c7a871add8f84b4284ab0d5496c5ac7e (DEFAULT_TABLE table=default.Table_6922f158ac92435ab1c25a7b930591be [id=060ccba0331c463a93173fbf772f2f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.185511 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7 (DEFAULT_TABLE table=default.Table_f2c07e238fbf48da918e6d865c656929 [id=e740c7e87e804f69b6390e640615a28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.185835 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.187252 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet 1799fea5a17f4a1cbbcd955d3813167c (table default.Table_95667d645ba543c795df2da82c455756 [id=b74130814629460882428c661bc22952]). Expected version 1 got 0
I20260503 07:53:20.187796 1166 tablet_bootstrap.cc:492] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3: No bootstrap required, opened a new log
I20260503 07:53:20.188233 1166 ts_tablet_manager.cc:1403] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.001s
I20260503 07:53:20.190289 598 catalog_manager.cc:5763] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179) does not have the latest schema for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da]). Expected version 3 got 0
I20260503 07:53:20.190554 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7 (DEFAULT_TABLE table=default.Table_f2c07e238fbf48da918e6d865c656929 [id=e740c7e87e804f69b6390e640615a28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.190969 887 tablet_service.cc:1511] Processing CreateTablet for tablet 40cb4bb81aef4e729392acb91226d1da (DEFAULT_TABLE table=default.Table_1343361e57844986beaedb2c49b4cf01 [id=a08eebb14c4442b5ae59877baef283ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.191319 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cb4bb81aef4e729392acb91226d1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.191361 595 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_e3e0b03821b8462eb3438302013eda36 [id=63f0f416d7c54be89355008b47b3c7a7] alter complete (version 4)
I20260503 07:53:20.192106 599 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:44308 (request call id 1697) took 1308 ms. Trace:
I20260503 07:53:20.192075 1166 raft_consensus.cc:359] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.192253 1166 raft_consensus.cc:385] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.192299 1166 raft_consensus.cc:740] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48acfab19cf04a069d5166d663adb3c3, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.191576 593 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_11c94f42fdb74455a513cdd269339d90 [id=a8e0e85f02244d0b845242b0d59eedce] alter complete (version 2)
I20260503 07:53:20.192467 594 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_dbbd6408455f4eaa9a772b5b7d85d445 [id=0a3183eb2a7d4d9ebe87627bc031f95c] alter complete (version 6)
I20260503 07:53:20.192476 1166 consensus_queue.cc:260] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
W20260503 07:53:20.193360 595 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.2:51725 (request call id 216) took 1335 ms (client timeout 1000 ms). Trace:
W20260503 07:53:20.193435 595 rpcz_store.cc:269] 0503 07:53:18.857742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.885475 (+ 27733us) service_pool.cc:224] Handling call
0503 07:53:20.193323 (+1307848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.960672 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.960824 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.960829 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:18.960831 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:18.960919 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.960930 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.960934 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:18.960989 (+ 55us) tablet.cc:701] Row locks acquired
0503 07:53:18.960991 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.961022 (+ 31us) write_op.cc:270] Start()
0503 07:53:18.961061 (+ 39us) write_op.cc:276] Timestamp: P: 1777794798960966 usec, L: 0
0503 07:53:18.961064 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.961858 (+ 794us) log.cc:844] Serialized 356 byte log entry
0503 07:53:18.967513 (+ 5655us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.967718 (+ 205us) write_op.cc:301] APPLY: starting
0503 07:53:18.967731 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.967768 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.967793 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.967839 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.967867 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:18.967874 (+ 7us) write_op.cc:312] APPLY: finished
0503 07:53:18.967931 (+ 57us) log.cc:844] Serialized 23 byte log entry
0503 07:53:18.967983 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.967995 (+ 12us) write_op.cc:454] Released schema lock
0503 07:53:18.968000 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.968077 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.968081 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":168,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":348,"num_ops":1,"prepare.queue_time_us":62580,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":1258,"replication_time_us":6422}]]}
I20260503 07:53:20.194088 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_4d84f9bc1dde452c8f75c42f7ea6b3ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.194548 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d84f9bc1dde452c8f75c42f7ea6b3ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.154723 3202 raft_consensus.cc:515] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.196288 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ca703988c5a04a298b21a48b62bb6779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:20 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.196935 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:20.197108 1171 tablet_bootstrap.cc:492] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:20.196424 3202 leader_election.cc:290] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.197117 1049 raft_consensus.cc:2468] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:20.197986 716 leader_election.cc:304] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:20.198315 3202 raft_consensus.cc:2804] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:20.198401 3202 raft_consensus.cc:493] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:20.192171 599 rpcz_store.cc:276] 0503 07:53:18.883552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.940956 (+ 57404us) service_pool.cc:224] Handling call
0503 07:53:18.941256 (+ 300us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0503 07:53:18.941547 (+ 291us) catalog_manager.cc:3725] Apply alter schema
0503 07:53:18.941755 (+ 208us) catalog_manager.cc:3757] Acquired catalog manager lock
0503 07:53:18.941826 (+ 71us) catalog_manager.cc:3915] Updating metadata on disk
0503 07:53:18.972748 (+ 30922us) catalog_manager.cc:3946] Committing alterations to in-memory state
0503 07:53:20.192088 (+1219340us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:18.963104 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:18.963182 (+ 78us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:18.963189 (+ 7us) write_op.cc:435] Acquired schema lock
0503 07:53:18.963193 (+ 4us) tablet.cc:662] Decoding operations
0503 07:53:18.963272 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:18.963281 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:18.963285 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:18.963331 (+ 46us) tablet.cc:701] Row locks acquired
0503 07:53:18.963333 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:18.963360 (+ 27us) write_op.cc:270] Start()
0503 07:53:18.963384 (+ 24us) write_op.cc:276] Timestamp: P: 1777794798963305 usec, L: 0
0503 07:53:18.963388 (+ 4us) op_driver.cc:348] REPLICATION: starting
0503 07:53:18.963614 (+ 226us) log.cc:844] Serialized 405 byte log entry
0503 07:53:18.967650 (+ 4036us) op_driver.cc:464] REPLICATION: finished
0503 07:53:18.968887 (+ 1237us) write_op.cc:301] APPLY: starting
0503 07:53:18.968895 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:18.968917 (+ 22us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:18.968935 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:18.968963 (+ 28us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:18.968983 (+ 20us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:18.968990 (+ 7us) write_op.cc:312] APPLY: finished
0503 07:53:18.969029 (+ 39us) log.cc:844] Serialized 23 byte log entry
0503 07:53:18.969071 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.969082 (+ 11us) write_op.cc:454] Released schema lock
0503 07:53:18.969087 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:18.969141 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:18.969144 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1211,"apply.run_cpu_time_us":247,"apply.run_wall_time_us":247,"num_ops":1,"prepare.queue_time_us":20920,"prepare.run_cpu_time_us":502,"prepare.run_wall_time_us":584,"replication_time_us":4252}]]}
I20260503 07:53:20.199182 599 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_d6e6366ec7bf4d2aa8266996642fab3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.199627 599 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6e6366ec7bf4d2aa8266996642fab3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.199694 748 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7 (DEFAULT_TABLE table=default.Table_f2c07e238fbf48da918e6d865c656929 [id=e740c7e87e804f69b6390e640615a28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.199745 758 tablet_service.cc:1511] Processing CreateTablet for tablet c7a871add8f84b4284ab0d5496c5ac7e (DEFAULT_TABLE table=default.Table_6922f158ac92435ab1c25a7b930591be [id=060ccba0331c463a93173fbf772f2f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.200109 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.200392 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a871add8f84b4284ab0d5496c5ac7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.201408 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a871add8f84b4284ab0d5496c5ac7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.204402 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4f52c88cc94beeaf8dc952ec29f3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.205473 3149 raft_consensus.cc:493] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c11eb9ffa7845269a6a8000e8ff248f)
I20260503 07:53:20.205598 3149 raft_consensus.cc:515] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.206166 3149 leader_election.cc:290] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
W20260503 07:53:20.207263 854 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:20.207756 3198 tablet.cc:1724] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:20.207854 3199 tablet.cc:1724] T 1799fea5a17f4a1cbbcd955d3813167c P 0c11eb9ffa7845269a6a8000e8ff248f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260503 07:53:20.210156 3202 raft_consensus.cc:3060] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:20.213099 715 consensus_peers.cc:597] T 1799fea5a17f4a1cbbcd955d3813167c P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Couldn't send request to peer 48acfab19cf04a069d5166d663adb3c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:53:20.213212 715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 67124.4us
I20260503 07:53:20.213361 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d79df088f24420b99a9c984f9700e80" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:20.213675 1171 tablet_bootstrap.cc:654] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
W20260503 07:53:20.214262 851 leader_election.cc:343] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Not found: Tablet not found: 5deea77f36d540bb8f721657b7e3500e
I20260503 07:53:20.214365 851 leader_election.cc:304] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48acfab19cf04a069d5166d663adb3c3; no voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.214897 3149 raft_consensus.cc:2749] T 5deea77f36d540bb8f721657b7e3500e P 48acfab19cf04a069d5166d663adb3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:53:20.215230 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:20.215643 715 leader_election.cc:343] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:53:20.216035 986 leader_election.cc:343] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.216221 986 leader_election.cc:304] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.216465 2916 raft_consensus.cc:2749] T 8d79df088f24420b99a9c984f9700e80 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.217154 741 tablet_service.cc:1511] Processing CreateTablet for tablet 40cb4bb81aef4e729392acb91226d1da (DEFAULT_TABLE table=default.Table_1343361e57844986beaedb2c49b4cf01 [id=a08eebb14c4442b5ae59877baef283ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.218215 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cb4bb81aef4e729392acb91226d1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.224970 3202 raft_consensus.cc:515] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.225558 3202 leader_election.cc:290] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.226161 1175 ts_tablet_manager.cc:1950] T af0c0f5999ee4b9cae56cbb3695de12f P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting consensus metadata
I20260503 07:53:20.227764 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:20.228225 715 leader_election.cc:343] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.230747 601 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_8532361d74204ac08795dd35d212bec2 [id=c5ff12b9cdb742e4956843dd88285d21] alter complete (version 3)
I20260503 07:53:20.234151 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 40cb4bb81aef4e729392acb91226d1da (DEFAULT_TABLE table=default.Table_1343361e57844986beaedb2c49b4cf01 [id=a08eebb14c4442b5ae59877baef283ca]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:20.236253 596 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7833f2abd0ff48e88fe7c5fbdaac037e consensus state has no leader
W20260503 07:53:20.236407 600 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05ea6723509d41bdae474fddfcdb3263 has no consensus state
I20260503 07:53:20.236752 596 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fc75b63b6b0640e1a4616681196b67f6" } modify_external_catalogs: true
I20260503 07:53:20.236792 600 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_352e0f0f19a14b3bb88b9e11ab0a4308"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.237262 600 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_352e0f0f19a14b3bb88b9e11ab0a4308 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.237236 596 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_fc75b63b6b0640e1a4616681196b67f6" } modify_external_catalogs: true
I20260503 07:53:20.238335 592 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_7304bba45276469fb11717cd6aa019d3 [id=690d003e59fc4a3f8da82e986e048616] alter complete (version 1)
I20260503 07:53:20.239404 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c1b04c89a64f8d9429203c46894d39" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:20.239574 1052 raft_consensus.cc:3060] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:20.241478 593 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.3:37895 (request call id 139) took 2570 ms (client timeout 1000 ms). Trace:
W20260503 07:53:20.241597 592 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.1:41325 (request call id 191) took 1622 ms (client timeout 1000 ms). Trace:
I20260503 07:53:20.242193 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet f4fd9524157c4225885a1f1831982faa with delete_type TABLET_DATA_DELETED (replaced by tablet 07f79085c25d43e58f221af146d252cf) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.242355 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.242486 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 18523493ee4841cb8949826239e2e458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.242672 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.242825 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2be28ad252ff47879caa1021fdf5db66 with delete_type TABLET_DATA_DELETED (replaced by tablet 31864ef969e94f5e9e9a7987ed88feb6) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.242960 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f522dc5e8b12409eb9ed1a763d0db741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243088 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet e2dcbb5010e346fca99dffdbdbb337f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243225 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243245 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ab44832fbf224a069d958cf745d914f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1905c11361bb445bb54ef394b76bbefe) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243413 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5776840523f54e6bb18d674815d3b447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:05 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243556 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f6df58637e047ef9b696f22d7c43e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:20.241550 593 rpcz_store.cc:269] 0503 07:53:17.670769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:17.680868 (+ 10099us) service_pool.cc:224] Handling call
0503 07:53:17.691982 (+ 11114us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:20.241459 (+2549477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:19.286984 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:19.287158 (+ 174us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:19.287167 (+ 9us) write_op.cc:435] Acquired schema lock
0503 07:53:19.287172 (+ 5us) tablet.cc:662] Decoding operations
0503 07:53:19.287333 (+ 161us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:19.287351 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:19.287359 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:53:19.287503 (+ 144us) tablet.cc:701] Row locks acquired
0503 07:53:19.287507 (+ 4us) write_op.cc:260] PREPARE: finished
0503 07:53:19.287554 (+ 47us) write_op.cc:270] Start()
0503 07:53:19.287601 (+ 47us) write_op.cc:276] Timestamp: P: 1777794799287514 usec, L: 0
0503 07:53:19.287606 (+ 5us) op_driver.cc:348] REPLICATION: starting
0503 07:53:19.287862 (+ 256us) log.cc:844] Serialized 901 byte log entry
0503 07:53:19.652826 (+364964us) op_driver.cc:464] REPLICATION: finished
0503 07:53:19.654980 (+ 2154us) write_op.cc:301] APPLY: starting
0503 07:53:19.654989 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:19.655013 (+ 24us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:19.655031 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:19.655073 (+ 42us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:19.655095 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:53:19.655101 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:19.655142 (+ 41us) log.cc:844] Serialized 29 byte log entry
0503 07:53:19.655171 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.655185 (+ 14us) write_op.cc:454] Released schema lock
0503 07:53:19.655189 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:19.655255 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.655258 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:19.664767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:19.664862 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:19.664867 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:19.664869 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:19.664936 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:19.664942 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:19.664947 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:19.664986 (+ 39us) tablet.cc:701] Row locks acquired
0503 07:53:19.664988 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:19.665010 (+ 22us) write_op.cc:270] Start()
0503 07:53:19.665030 (+ 20us) write_op.cc:276] Timestamp: P: 1777794799664988 usec, L: 0
0503 07:53:19.665033 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:19.665161 (+ 128us) log.cc:844] Serialized 356 byte log entry
0503 07:53:19.704579 (+ 39418us) op_driver.cc:464] REPLICATION: finished
0503 07:53:19.706230 (+ 1651us) write_op.cc:301] APPLY: starting
0503 07:53:19.706238 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:19.706260 (+ 22us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:19.706304 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:19.706335 (+ 31us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:19.706356 (+ 21us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:19.706362 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:19.706402 (+ 40us) log.cc:844] Serialized 23 byte log entry
0503 07:53:19.706431 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.706440 (+ 9us) write_op.cc:454] Released schema lock
0503 07:53:19.706444 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:19.706494 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.706497 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":874,"reported_tablets":29,"spinlock_wait_cycles":21755776,"child_traces":[["op",{"apply.queue_time_us":2122,"apply.run_cpu_time_us":254,"apply.run_wall_time_us":254,"num_ops":2,"prepare.queue_time_us":39903,"prepare.run_cpu_time_us":982,"prepare.run_wall_time_us":982,"replication_time_us":365207}],["op",{"apply.queue_time_us":1627,"apply.run_cpu_time_us":257,"apply.run_wall_time_us":256,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":439,"prepare.run_wall_time_us":439,"replication_time_us":39534}]]}
I20260503 07:53:20.243667 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet df60413555764bcab464b18c6a3370ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.243867 593 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_4f525a07b4e84b15abed3e131a3fedc6" } new_table_name: "default.Table_a5293eebca4642f68d36475d3e1777fc" modify_external_catalogs: true
I20260503 07:53:20.243958 1052 raft_consensus.cc:2468] T c1c1b04c89a64f8d9429203c46894d39 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:20.244338 716 leader_election.cc:304] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
W20260503 07:53:20.248591 425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.2:44381, user_credentials={real_user=slave}} blocked reactor thread for 81265.4us
I20260503 07:53:20.249248 595 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_f9c292ae5ae4416a8c632d83d53e69e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.249675 595 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9c292ae5ae4416a8c632d83d53e69e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:20.241698 592 rpcz_store.cc:269] 0503 07:53:18.619497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.638154 (+ 18657us) service_pool.cc:224] Handling call
0503 07:53:20.241575 (+1603421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:19.741770 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:19.741878 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:19.741886 (+ 8us) write_op.cc:435] Acquired schema lock
0503 07:53:19.741889 (+ 3us) tablet.cc:662] Decoding operations
0503 07:53:19.742021 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:19.742031 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:19.742035 (+ 4us) tablet.cc:685] Acquiring locks for 3 operations
0503 07:53:19.742143 (+ 108us) tablet.cc:701] Row locks acquired
0503 07:53:19.742147 (+ 4us) write_op.cc:260] PREPARE: finished
0503 07:53:19.742184 (+ 37us) write_op.cc:270] Start()
0503 07:53:19.742220 (+ 36us) write_op.cc:276] Timestamp: P: 1777794799742149 usec, L: 0
0503 07:53:19.742223 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:19.742397 (+ 174us) log.cc:844] Serialized 1275 byte log entry
0503 07:53:19.752763 (+ 10366us) op_driver.cc:464] REPLICATION: finished
0503 07:53:19.752876 (+ 113us) write_op.cc:301] APPLY: starting
0503 07:53:19.752890 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:19.752928 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:19.752948 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:19.753009 (+ 61us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:19.753035 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0503 07:53:19.753041 (+ 6us) write_op.cc:312] APPLY: finished
0503 07:53:19.753095 (+ 54us) log.cc:844] Serialized 35 byte log entry
0503 07:53:19.753135 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.753156 (+ 21us) write_op.cc:454] Released schema lock
0503 07:53:19.753164 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:19.753231 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:19.753234 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 07:53:20.194994 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:20.195094 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:20.195099 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:20.195101 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:20.195179 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:20.195189 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:20.195194 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:20.195245 (+ 51us) tablet.cc:701] Row locks acquired
0503 07:53:20.195247 (+ 2us) write_op.cc:260] PREPARE: finished
0503 07:53:20.195273 (+ 26us) write_op.cc:270] Start()
0503 07:53:20.195302 (+ 29us) write_op.cc:276] Timestamp: P: 1777794800195247 usec, L: 0
0503 07:53:20.195305 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:20.195526 (+ 221us) log.cc:844] Serialized 356 byte log entry
0503 07:53:20.235186 (+ 39660us) op_driver.cc:464] REPLICATION: finished
0503 07:53:20.235730 (+ 544us) write_op.cc:301] APPLY: starting
0503 07:53:20.235743 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:20.235769 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:20.235810 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:20.235848 (+ 38us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:20.235871 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:20.235876 (+ 5us) write_op.cc:312] APPLY: finished
0503 07:53:20.235928 (+ 52us) log.cc:844] Serialized 23 byte log entry
0503 07:53:20.235967 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:20.235980 (+ 13us) write_op.cc:454] Released schema lock
0503 07:53:20.235986 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:20.236043 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:20.236047 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"spinlock_wait_cycles":72960,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":350,"apply.run_wall_time_us":350,"num_ops":3,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":713,"replication_time_us":10498}],["op",{"apply.queue_time_us":513,"apply.run_cpu_time_us":305,"apply.run_wall_time_us":305,"mutex_wait_us":215,"num_ops":1,"prepare.queue_time_us":1690,"prepare.run_cpu_time_us":526,"prepare.run_wall_time_us":587,"replication_time_us":39864}]]}
I20260503 07:53:20.236824 597 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 04ac6a9a921d4741bacf707b8f217874: default.Table_167f798efea349f1b2664fe45eceed6d [id=6f2dee6dc12f4eb1a99cf69412d2d256] alter complete (version 2)
I20260503 07:53:20.250999 1166 ts_tablet_manager.cc:1434] T 4bb8d47da511422d9665326520d35601 P 48acfab19cf04a069d5166d663adb3c3: Time spent starting tablet: real 0.062s user 0.002s sys 0.000s
I20260503 07:53:20.251995 1166 tablet_bootstrap.cc:492] T 2be28ad252ff47879caa1021fdf5db66 P 48acfab19cf04a069d5166d663adb3c3: Bootstrap starting.
I20260503 07:53:20.255606 887 tablet_service.cc:1558] Processing DeleteTablet for tablet b8bb85190cd94e8282eec9a1bc0efab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.255824 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e162006cee34182b51f97629a174509 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e688661ecdc4ba1b8b8c0867499fe4d) from {username='slave'} at 127.0.0.1:39898
W20260503 07:53:20.258780 716 consensus_peers.cc:597] T 26032d89839340988fce30f458e785fa P 4a924c2134c54fa0bb164825da53bdd0 -> Peer 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): Couldn't send request to peer 0c11eb9ffa7845269a6a8000e8ff248f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26032d89839340988fce30f458e785fa. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:53:20.260090 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ad24ddc82bd401fb5427e7415af3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.261672 741 tablet_service.cc:1558] Processing DeleteTablet for tablet df60413555764bcab464b18c6a3370ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.263947 2924 raft_consensus.cc:2804] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:20.264312 2924 raft_consensus.cc:697] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:20.264362 592 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_c6933480422548cb925ede87569083f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 07:53:20.264586 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c631d3da8f4ec29690c548097a454b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:57 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:20.264853 592 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6933480422548cb925ede87569083f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:53:20.264604 2924 consensus_queue.cc:237] T c1c1b04c89a64f8d9429203c46894d39 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.268208 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 26032d89839340988fce30f458e785fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268431 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c1b04c89a64f8d9429203c46894d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:56 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268595 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f31f37e97345bb9187865e38ee1d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:02 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268538 886 tablet_service.cc:1511] Processing CreateTablet for tablet b8964491849b4a099146d3eba89bd75f (DEFAULT_TABLE table=default.Table_90007d3270c3491697ea150681e73a39 [id=b255fe50a41c41ba82781a32fa44c51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.268723 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f54aaadc3d22437286303caac65c7cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:55 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268756 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet bce8073c9aa549f3b9ee0397984c350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:58 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268855 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c14998ce78c64e58ac5b7f651b6b88ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.268900 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8964491849b4a099146d3eba89bd75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.268903 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 405e2bbca5c54234a80f23d9399df765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:00 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.269013 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3fcb4d83f64f6182a78a1a02da39d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b9a34f66d342fcbff7f8b8adb28b80) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.272886 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 23eacb83c81442d4b6bfc25717fe21e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:59 UTC) from {username='slave'} at 127.0.0.1:47074
I20260503 07:53:20.273260 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fb49d5b35994fe9b383b72f77eaebb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4db7807a41124ed192096d89fd740ddf) from {username='slave'} at 127.0.0.1:47074
W20260503 07:53:20.273293 594 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet b16bc543b2e84e8ca7df6c00f1acc0f7 (table default.Table_fa9fc162a5f0431a9e07ae11cb3308af [id=3d5fb91471ec4d8684efb6faca6738da], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet b16bc543b2e84e8ca7df6c00f1acc0f7 consensus state has no leader
W20260503 07:53:20.274057 594 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.3:37895 (request call id 140) took 1449 ms (client timeout 1000 ms). Trace:
I20260503 07:53:20.274252 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 7336c1df59754cd58c0c290b84fc0d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:53:13 UTC) from {username='slave'} at 127.0.0.1:46968
W20260503 07:53:20.274451 594 rpcz_store.cc:269] 0503 07:53:18.824229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:18.835583 (+ 11354us) service_pool.cc:224] Handling call
0503 07:53:18.869398 (+ 33815us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x616000041254. stack: 00007ff8ecf96086 00007ff8ecf95e40 00007ff8ebf4f3ad 000000000099adb4 000000000099ad7d 00007ff8fc31e6bd 00007ff8fc31e7b3 00007ff8f8edcb21 00007ff900c10bad 00007ff900d97358 00007ff8f782dca6 00007ff8f782d9d5 00007ff8f3f8910e 00007ff8f3f87fee 00007ff8f3f8e228 00007ff8f3f8eb8f
0503 07:53:20.274034 (+1404636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:53:20.158774 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:53:20.158872 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:53:20.158877 (+ 5us) write_op.cc:435] Acquired schema lock
0503 07:53:20.158879 (+ 2us) tablet.cc:662] Decoding operations
0503 07:53:20.158960 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:53:20.158969 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0503 07:53:20.158975 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:53:20.159026 (+ 51us) tablet.cc:701] Row locks acquired
0503 07:53:20.159029 (+ 3us) write_op.cc:260] PREPARE: finished
0503 07:53:20.159065 (+ 36us) write_op.cc:270] Start()
0503 07:53:20.159093 (+ 28us) write_op.cc:276] Timestamp: P: 1777794800159030 usec, L: 0
0503 07:53:20.159096 (+ 3us) op_driver.cc:348] REPLICATION: starting
0503 07:53:20.159206 (+ 110us) log.cc:844] Serialized 356 byte log entry
0503 07:53:20.172361 (+ 13155us) op_driver.cc:464] REPLICATION: finished
0503 07:53:20.172454 (+ 93us) write_op.cc:301] APPLY: starting
0503 07:53:20.172461 (+ 7us) tablet.cc:1367] starting BulkCheckPresence
0503 07:53:20.172481 (+ 20us) tablet.cc:1370] finished BulkCheckPresence
0503 07:53:20.172502 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:53:20.172552 (+ 50us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:53:20.172579 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:53:20.172586 (+ 7us) write_op.cc:312] APPLY: finished
0503 07:53:20.172646 (+ 60us) log.cc:844] Serialized 23 byte log entry
0503 07:53:20.172976 (+ 330us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:20.173006 (+ 30us) write_op.cc:454] Released schema lock
0503 07:53:20.173011 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0503 07:53:20.173069 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:53:20.173072 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":48,"spinlock_wait_cycles":73719040,"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":337,"apply.run_wall_time_us":605,"mutex_wait_us":277,"num_ops":1,"prepare.queue_time_us":806,"prepare.run_cpu_time_us":491,"prepare.run_wall_time_us":490,"replication_time_us":13248,"spinlock_wait_cycles":384}]]}
I20260503 07:53:20.275395 2916 raft_consensus.cc:493] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.275504 2916 raft_consensus.cc:515] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.275969 2916 leader_election.cc:290] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:20.276582 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0987f089de9f4175af34a86b61ad85c4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
I20260503 07:53:20.276561 594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44308:
name: "default.Table_397f86d0f1c9476fa4e8d5ceffda0526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:53:20.276969 594 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_397f86d0f1c9476fa4e8d5ceffda0526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260503 07:53:20.276986 988 leader_election.cc:343] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.275846 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet fc130dcd067f43f08748360a692eb048 (table default.Table_3b237288873a43c9a5f6c65306a1218f [id=c08288249590438bbcacc49fb2e3ee49]). Expected version 1 got 0
I20260503 07:53:20.277504 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 538ea5f9f9964fbdb8eb92e6059e2531 (table default.Table_1bbaa09393684afab1b6a6fc08e6f378 [id=ec636e2291634547aa977f3ab2a26ea7]). Expected version 1 got 0
I20260503 07:53:20.277639 597 catalog_manager.cc:5763] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381) does not have the latest schema for tablet 17b547a24cfa4478a90d3035a59a3381 (table default.Table_c4135cff65ad477085e4794cc3ae37e7 [id=c7971e2f537a41a599b1f9d07135641d]). Expected version 2 got 0
I20260503 07:53:20.278940 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cf72d49cfd24083abee07e0d2190e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-03 07:52:54 UTC) from {username='slave'} at 127.0.0.1:46968
I20260503 07:53:20.279795 885 tablet_service.cc:1558] Processing DeleteTablet for tablet cf24705f7d004254bf8456c063634d65 with delete_type TABLET_DATA_DELETED (replaced by tablet e0fdfb3008a14b1cb18aee69c400743d) from {username='slave'} at 127.0.0.1:39898
I20260503 07:53:20.280687 2987 raft_consensus.cc:493] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.280809 2987 raft_consensus.cc:515] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.281384 2987 leader_election.cc:290] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215), 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381)
I20260503 07:53:20.283350 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b8964491849b4a099146d3eba89bd75f (DEFAULT_TABLE table=default.Table_90007d3270c3491697ea150681e73a39 [id=b255fe50a41c41ba82781a32fa44c51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.285614 885 tablet_service.cc:1511] Processing CreateTablet for tablet 2d53638c403e4d0c99b54c7dd9862d31 (DEFAULT_TABLE table=default.Table_d2e68e6e0cd14ce1afd21c4a25d2cfc4 [id=53cf5c2d4de445d3987d1b404c071ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.286033 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d53638c403e4d0c99b54c7dd9862d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.286919 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031f91b3b3ca4bca856d3c3ee99e9e3a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:20.287322 988 leader_election.cc:343] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.288662 1166 tablet_bootstrap.cc:654] T 2be28ad252ff47879caa1021fdf5db66 P 48acfab19cf04a069d5166d663adb3c3: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:20.291699 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0987f089de9f4175af34a86b61ad85c4" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:20.292335 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031f91b3b3ca4bca856d3c3ee99e9e3a" candidate_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a924c2134c54fa0bb164825da53bdd0" is_pre_election: true
I20260503 07:53:20.294559 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cb4bb81aef4e729392acb91226d1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.295032 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8964491849b4a099146d3eba89bd75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.298748 599 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b1d6f7f8766843359ad26aac3c60ecbf" } modify_external_catalogs: true
I20260503 07:53:20.298892 599 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_b1d6f7f8766843359ad26aac3c60ecbf" } modify_external_catalogs: true
I20260503 07:53:20.301191 758 tablet_service.cc:1511] Processing CreateTablet for tablet 2d53638c403e4d0c99b54c7dd9862d31 (DEFAULT_TABLE table=default.Table_d2e68e6e0cd14ce1afd21c4a25d2cfc4 [id=53cf5c2d4de445d3987d1b404c071ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.301537 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d53638c403e4d0c99b54c7dd9862d31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:53:20.301932 986 leader_election.cc:343] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.302026 986 leader_election.cc:304] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.302220 2987 raft_consensus.cc:2749] T 0987f089de9f4175af34a86b61ad85c4 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.302315 741 tablet_service.cc:1511] Processing CreateTablet for tablet 2b4e4071eb5145d6a84394907da541f6 (DEFAULT_TABLE table=default.Table_8e668d256db348eb8fff1515e0a7a800 [id=d9ea7a0955724fba9f3977a10c0a791f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260503 07:53:20.302538 986 leader_election.cc:343] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a924c2134c54fa0bb164825da53bdd0 (127.0.105.1:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.302630 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4e4071eb5145d6a84394907da541f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.302616 986 leader_election.cc:304] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f; no voters: 48acfab19cf04a069d5166d663adb3c3, 4a924c2134c54fa0bb164825da53bdd0
I20260503 07:53:20.302775 2987 raft_consensus.cc:2749] T 031f91b3b3ca4bca856d3c3ee99e9e3a P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:53:20.306568 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2d53638c403e4d0c99b54c7dd9862d31 (DEFAULT_TABLE table=default.Table_d2e68e6e0cd14ce1afd21c4a25d2cfc4 [id=53cf5c2d4de445d3987d1b404c071ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.306885 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d53638c403e4d0c99b54c7dd9862d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.307276 748 tablet_service.cc:1511] Processing CreateTablet for tablet b8964491849b4a099146d3eba89bd75f (DEFAULT_TABLE table=default.Table_90007d3270c3491697ea150681e73a39 [id=b255fe50a41c41ba82781a32fa44c51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.307569 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8964491849b4a099146d3eba89bd75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.312125 917 raft_consensus.cc:3060] T b8bb85190cd94e8282eec9a1bc0efab4 P 48acfab19cf04a069d5166d663adb3c3 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:53:20.314855 593 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4068720834a4ff088139dd907ff9cb9 consensus state has no leader
I20260503 07:53:20.315002 2912 raft_consensus.cc:493] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:53:20.315033 886 tablet_service.cc:1511] Processing CreateTablet for tablet 2b4e4071eb5145d6a84394907da541f6 (DEFAULT_TABLE table=default.Table_8e668d256db348eb8fff1515e0a7a800 [id=d9ea7a0955724fba9f3977a10c0a791f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.315122 2912 raft_consensus.cc:515] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.315382 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4e4071eb5145d6a84394907da541f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.315707 2912 leader_election.cc:290] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.316093 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" is_pre_election: true
I20260503 07:53:20.316505 1052 raft_consensus.cc:2468] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 0.
I20260503 07:53:20.316856 716 leader_election.cc:304] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters:
I20260503 07:53:20.317087 2912 raft_consensus.cc:2804] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:53:20.317184 2912 raft_consensus.cc:493] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:53:20.317238 2912 raft_consensus.cc:3060] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.317207 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3" is_pre_election: true
W20260503 07:53:20.317639 715 leader_election.cc:343] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.319569 2912 raft_consensus.cc:515] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.320218 2912 leader_election.cc:290] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Requested vote from peers 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381), 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179)
I20260503 07:53:20.320653 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c11eb9ffa7845269a6a8000e8ff248f"
I20260503 07:53:20.320750 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47074 (request call id 1334) took 5464 ms. Trace:
I20260503 07:53:20.320785 1052 raft_consensus.cc:3060] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:53:20.320930 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053b644e68e04a80966f374883170221" candidate_uuid: "4a924c2134c54fa0bb164825da53bdd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48acfab19cf04a069d5166d663adb3c3"
W20260503 07:53:20.321350 715 leader_election.cc:343] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:53:20.322041 593 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2a6aac10a79471f91a7e631116df017" } modify_external_catalogs: true
I20260503 07:53:20.322220 593 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_e2a6aac10a79471f91a7e631116df017" } modify_external_catalogs: true
I20260503 07:53:20.323474 1052 raft_consensus.cc:2468] T 053b644e68e04a80966f374883170221 P 0c11eb9ffa7845269a6a8000e8ff248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a924c2134c54fa0bb164825da53bdd0 in term 1.
I20260503 07:53:20.323644 600 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d2b114c9425a4bb282bf4e119705dfa9" } modify_external_catalogs: true
I20260503 07:53:20.323781 600 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44308:
table { table_name: "default.Table_d2b114c9425a4bb282bf4e119705dfa9" } modify_external_catalogs: true
I20260503 07:53:20.323853 716 leader_election.cc:304] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c11eb9ffa7845269a6a8000e8ff248f, 4a924c2134c54fa0bb164825da53bdd0; no voters: 48acfab19cf04a069d5166d663adb3c3
I20260503 07:53:20.324095 2912 raft_consensus.cc:2804] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:53:20.324366 2912 raft_consensus.cc:697] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Running, Role: LEADER
I20260503 07:53:20.324621 2912 consensus_queue.cc:237] T 053b644e68e04a80966f374883170221 P 4a924c2134c54fa0bb164825da53bdd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.325275 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2b4e4071eb5145d6a84394907da541f6 (DEFAULT_TABLE table=default.Table_8e668d256db348eb8fff1515e0a7a800 [id=d9ea7a0955724fba9f3977a10c0a791f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.325572 1171 tablet_bootstrap.cc:492] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f: No bootstrap required, opened a new log
I20260503 07:53:20.325580 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4e4071eb5145d6a84394907da541f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.325688 1171 ts_tablet_manager.cc:1403] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent bootstrapping tablet: real 0.129s user 0.001s sys 0.001s
I20260503 07:53:20.326267 1171 raft_consensus.cc:359] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.326496 1171 raft_consensus.cc:385] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.326543 1171 raft_consensus.cc:740] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c11eb9ffa7845269a6a8000e8ff248f, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.326721 1171 consensus_queue.cc:260] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } } peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } }
I20260503 07:53:20.327159 1171 ts_tablet_manager.cc:1434] T 98e7006b4f9a48f58815ed3c8d2fea10 P 0c11eb9ffa7845269a6a8000e8ff248f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260503 07:53:20.327391 1171 tablet_bootstrap.cc:492] T f9e78eb6d2a3489dbb15806dd93867a4 P 0c11eb9ffa7845269a6a8000e8ff248f: Bootstrap starting.
I20260503 07:53:20.328625 1171 tablet_bootstrap.cc:654] T f9e78eb6d2a3489dbb15806dd93867a4 P 0c11eb9ffa7845269a6a8000e8ff248f: Neither blocks nor log segments found. Creating new log.
I20260503 07:53:20.329018 1173 ts_tablet_manager.cc:1929] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260503 07:53:20.329098 1173 log.cc:1199] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Deleting WAL directory at /tmp/dist-test-taskCEB381/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1777794763418903-420-0/minicluster-data/ts-1/wal/wals/64c6dad26de642879307b7dca6ae85f5
I20260503 07:53:20.329409 1173 ts_tablet_manager.cc:1950] T 64c6dad26de642879307b7dca6ae85f5 P 48acfab19cf04a069d5166d663adb3c3: Deleting consensus metadata
I20260503 07:53:20.330031 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 953) took 9748 ms. Trace:
I20260503 07:53:20.330098 1173 rpcz_store.cc:276] 0503 07:53:10.581365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:10.581429 (+ 64us) service_pool.cc:224] Handling call
0503 07:53:20.175673 (+9594244us) ts_tablet_manager.cc:1151] Deleting tablet 64c6dad26de642879307b7dca6ae85f5
0503 07:53:20.175680 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.215244 (+ 39564us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.328973 (+113729us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.330016 (+ 1043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9593998}
I20260503 07:53:20.330467 587 catalog_manager.cc:5002] TS 48acfab19cf04a069d5166d663adb3c3 (127.0.105.2:44381): tablet 64c6dad26de642879307b7dca6ae85f5 (table default.Table_045b6da91766482c8248e5d78e7c2da2 [id=52b6e1329fa443bd8a370f4e6ce56d51]) successfully deleted
I20260503 07:53:20.330896 1173 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39898 (request call id 967) took 9252 ms. Trace:
I20260503 07:53:20.332289 1175 rpcz_store.cc:276] 0503 07:53:14.855766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:53:14.855803 (+ 37us) service_pool.cc:224] Handling call
0503 07:53:20.005608 (+5149805us) ts_tablet_manager.cc:1151] Deleting tablet af0c0f5999ee4b9cae56cbb3695de12f
0503 07:53:20.005621 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:53:20.039950 (+ 34329us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.100601 (+ 60651us) tablet_metadata.cc:665] Metadata flushed
0503 07:53:20.320729 (+220128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5149593}
I20260503 07:53:20.332728 588 catalog_manager.cc:5002] TS 0c11eb9ffa7845269a6a8000e8ff248f (127.0.105.3:40179): tablet af0c0f5999ee4b9cae56cbb3695de12f (table default.Table_fc2f1060428149818159c2074b32f1f0 [id=f334cc96ca794a41a2fcd3fc170444d4]) successfully deleted
I20260503 07:53:20.332808 1175 tablet_replica.cc:333] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: stopping tablet replica
I20260503 07:53:20.333058 1175 raft_consensus.cc:2243] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260503 07:53:20.333212 1175 raft_consensus.cc:2272] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260503 07:53:20.333774 1175 ts_tablet_manager.cc:1916] T a3724490a7ed4afc82e4f7ebc1190f76 P 0c11eb9ffa7845269a6a8000e8ff248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260503 07:53:20.334386 741 tablet_service.cc:1511] Processing CreateTablet for tablet d51f975d92c64ef0b36f8e35baddab25 (DEFAULT_TABLE table=default.Table_e7626410afd741caa51dc5e4c26e1ad7 [id=208b5b7609b6495bb8db1ba7ddbdfc26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.338613 1165 tablet_bootstrap.cc:492] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0: No bootstrap required, opened a new log
I20260503 07:53:20.338655 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d51f975d92c64ef0b36f8e35baddab25 (DEFAULT_TABLE table=default.Table_e7626410afd741caa51dc5e4c26e1ad7 [id=208b5b7609b6495bb8db1ba7ddbdfc26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 07:53:20.338735 1165 ts_tablet_manager.cc:1403] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0: Time spent bootstrapping tablet: real 0.232s user 0.009s sys 0.002s
I20260503 07:53:20.338979 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f975d92c64ef0b36f8e35baddab25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:53:20.339380 1165 raft_consensus.cc:359] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 42215 } }
I20260503 07:53:20.339558 1165 raft_consensus.cc:385] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:53:20.339614 1165 raft_consensus.cc:740] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a924c2134c54fa0bb164825da53bdd0, State: Initialized, Role: FOLLOWER
I20260503 07:53:20.339802 1165 consensus_queue.cc:260] T 8c0bcb9ab72a482ca07447ff392ae49d P 4a924c2134c54fa0bb164825da53bdd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48acfab19cf04a069d5166d663adb3c3" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 44381 } } peers { permanent_uuid: "0c11eb9ffa7845269a6a8000e8ff248f" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 40179 } } peers { permanent_uuid: "4a924c2134c54fa0bb164825da53bdd0" member_type: VOTER last_known_addr { host: "127.0.105.1"